-- Logs begin at Tue 2022-06-14 23:36:26 UTC, end at Wed 2022-06-15 00:54:57 UTC. -- Jun 15 00:20:35.195682 dv-cinder-835384-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 15 00:20:35.206248 dv-cinder-835384-6-smb devstack@keystone.service[80180]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 15 00:20:35.206797 dv-cinder-835384-6-smb devstack@keystone.service[80180]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 15 00:20:35 2022] *** Jun 15 00:20:35.206797 dv-cinder-835384-6-smb devstack@keystone.service[80180]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 15 00:20:35.206797 dv-cinder-835384-6-smb devstack@keystone.service[80180]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 15 00:20:35.206797 dv-cinder-835384-6-smb devstack@keystone.service[80180]: nodename: dv-cinder-835384-6-smb Jun 15 00:20:35.206797 dv-cinder-835384-6-smb devstack@keystone.service[80180]: machine: x86_64 Jun 15 00:20:35.206797 dv-cinder-835384-6-smb devstack@keystone.service[80180]: clock source: unix Jun 15 00:20:35.206797 dv-cinder-835384-6-smb devstack@keystone.service[80180]: pcre jit disabled Jun 15 00:20:35.206797 dv-cinder-835384-6-smb devstack@keystone.service[80180]: detected number of CPU cores: 4 Jun 15 00:20:35.206797 dv-cinder-835384-6-smb devstack@keystone.service[80180]: current working directory: / Jun 15 00:20:35.206797 dv-cinder-835384-6-smb devstack@keystone.service[80180]: detected binary path: /usr/bin/uwsgi-core Jun 15 00:20:35.206797 dv-cinder-835384-6-smb devstack@keystone.service[80180]: your processes number limit is 47680 Jun 15 00:20:35.206797 dv-cinder-835384-6-smb devstack@keystone.service[80180]: your memory page size is 4096 bytes Jun 15 00:20:35.206797 dv-cinder-835384-6-smb devstack@keystone.service[80180]: detected max file descriptor number: 2048 Jun 15 00:20:35.206797 dv-cinder-835384-6-smb devstack@keystone.service[80180]: lock engine: pthread robust mutexes Jun 15 00:20:35.206797 dv-cinder-835384-6-smb devstack@keystone.service[80180]: thunder lock: enabled Jun 15 00:20:35.207644 dv-cinder-835384-6-smb devstack@keystone.service[80180]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 15 00:20:35.207644 dv-cinder-835384-6-smb devstack@keystone.service[80180]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 15 00:20:35.250148 dv-cinder-835384-6-smb devstack@keystone.service[80180]: Python main interpreter initialized at 0x55ec77cb69c0 Jun 15 00:20:35.250148 dv-cinder-835384-6-smb devstack@keystone.service[80180]: python threads support enabled Jun 15 00:20:35.250148 dv-cinder-835384-6-smb devstack@keystone.service[80180]: your server socket listen backlog is limited to 100 connections Jun 15 00:20:35.250148 dv-cinder-835384-6-smb devstack@keystone.service[80180]: your mercy for graceful operations on workers is 90 seconds Jun 15 00:20:35.250475 dv-cinder-835384-6-smb devstack@keystone.service[80180]: mapped 403077 bytes (393 KB) for 2 cores Jun 15 00:20:35.250539 dv-cinder-835384-6-smb devstack@keystone.service[80180]: *** Operational MODE: preforking *** Jun 15 00:20:35.250808 dv-cinder-835384-6-smb devstack@keystone.service[80180]: *** uWSGI is running in multiple interpreter mode *** Jun 15 00:20:35.250808 dv-cinder-835384-6-smb devstack@keystone.service[80180]: spawned uWSGI master process (pid: 80180) Jun 15 00:20:35.251015 dv-cinder-835384-6-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 15 00:20:35.257370 dv-cinder-835384-6-smb devstack@keystone.service[80180]: spawned uWSGI worker 1 (pid: 80188, cores: 1) Jun 15 00:20:35.257370 dv-cinder-835384-6-smb devstack@keystone.service[80180]: spawned uWSGI worker 2 (pid: 80189, cores: 1) Jun 15 00:20:35.257370 dv-cinder-835384-6-smb devstack@keystone.service[80180]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 15 00:20:40.624859 dv-cinder-835384-6-smb devstack@keystone.service[80188]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 00:20:40.624859 dv-cinder-835384-6-smb devstack@keystone.service[80188]: from cryptography.utils import int_from_bytes Jun 15 00:20:40.625751 dv-cinder-835384-6-smb devstack@keystone.service[80189]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 00:20:40.625751 dv-cinder-835384-6-smb devstack@keystone.service[80189]: from cryptography.utils import int_from_bytes Jun 15 00:20:40.626162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 00:20:40.626162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: from cryptography.utils import int_from_bytes Jun 15 00:20:40.626272 dv-cinder-835384-6-smb devstack@keystone.service[80189]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 15 00:20:40.626272 dv-cinder-835384-6-smb devstack@keystone.service[80189]: from cryptography.utils import int_from_bytes Jun 15 00:20:40.674187 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 00:20:40.674356 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 15 00:20:40.674452 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 00:20:40.674532 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 15 00:20:40.674600 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] command line args: [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 00:20:40.674668 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] command line args: [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 15 00:20:40.674821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 00:20:40.674963 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 15 00:20:40.675041 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ================================================================================ {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 00:20:40.675128 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ================================================================================ {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 15 00:20:40.675205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] admin_token = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.675278 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] admin_token = **** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.675465 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] config_dir = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.675603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] config_dir = [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.675680 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.675742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.675814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] config_source = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.675881 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] config_source = [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.675941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] debug = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.676001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] debug = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.676155 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.676420 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.676508 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.676574 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.676698 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.676779 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.676915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.676995 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.677190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.677306 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.677527 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] list_limit = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.677627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.677705 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] log_config_append = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.677772 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] log_config_append = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.677836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.677901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.677960 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] log_dir = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.678023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] log_dir = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.678182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] log_file = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.678294 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] log_file = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.678397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.678497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.678579 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.678702 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.678792 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.678855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.679069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.679197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.679333 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.679426 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.679510 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.679646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.679769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.679891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.679974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.680044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.680166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.680303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.680387 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.680450 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.680572 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.680655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.680723 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.680836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.680915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.680985 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.681194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.681330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.681467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.681555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.681991 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.682126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.682126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] publish_errors = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.682283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] publish_errors = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.682352 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.682431 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.682608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.682742 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.682823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.682902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.682971 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.683061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.683229 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.683347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.683438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] standard_threads = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.683566 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] standard_threads = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.683652 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.683724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.683900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.684034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.684034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.684187 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.684187 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] use_journal = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.684320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] use_journal = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.684393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] use_json = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.684472 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] use_json = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.684545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] use_stderr = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.684628 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] use_stderr = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.684702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] use_syslog = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.684779 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] use_syslog = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.684932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.685067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 15 00:20:40.685154 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.685238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.685433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.685573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.685657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.685735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.685903 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.685998 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.686158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.686246 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.686389 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.686472 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.686637 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.686730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.686874 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.686956 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.687117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.687204 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.687364 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.687455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.687615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.687697 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.687848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.687929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.688092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.688186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.688323 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.688406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.688570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.688652 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.688817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.688985 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.689061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.689143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.689293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.689391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.689572 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.689666 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.689813 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.689895 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.690050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.690131 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.690282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.690367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.690542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.690619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.690791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.690868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.691040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.691125 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.691268 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.691348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.691498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.691575 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.691726 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.691803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.691958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.692035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.692205 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.692281 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.692453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.692538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.692683 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.692760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.692910 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.692992 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.693181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.693260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.693452 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.693543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.693687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.693764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.693938 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.694017 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.694165 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.694247 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.694398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.694475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.694627 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.694700 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.694854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.694931 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.695083 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.695159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.695309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.695387 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.695538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.695615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.695769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.695845 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.696016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.696095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.696244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.696328 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.696475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.696552 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.696704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.696784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.696938 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.697020 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.697167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.697245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.697437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.697517 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.697667 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.697743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.698054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.698175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.698175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.698303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.698362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.698420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.698575 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.698643 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.698805 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.698913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.699020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.699166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.699272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.699360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.699509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.699595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.699741 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.699827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.699972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.700062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.700229 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.700308 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.700465 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.700544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.700693 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.700776 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.700927 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.701000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.701167 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.701247 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.701464 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.701586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.701706 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.701864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.701945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.702059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.702183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.702269 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.702421 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.702548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.702654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.702735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.702888 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.702966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.703134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.703225 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.703370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.703449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.703602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.703678 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.703844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.703930 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.704078 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.704156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.704313 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.704389 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.704542 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.704629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.704778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.704854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.705007 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.705095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.705268 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.705380 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.705533 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.705611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.705771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.705848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.706006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.706162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.706238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.706309 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.706465 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.706544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.706699 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.706784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.706931 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.707024 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.707161 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.707238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.707387 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.707470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.707826 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.707918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.707993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.708065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.708137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.708208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.708278 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.708358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.708492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.708572 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.708786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.708905 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.709025 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.709106 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.709281 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.709382 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.799713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.799972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.800265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] auth.external = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.800399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.800484 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.800705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.800830 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.800951 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.external = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.801060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.801248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.801438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] auth.password = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.801555 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] auth.token = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.801656 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.801844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.801971 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.802053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.password = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.802142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.802333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] auth.token = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.802497 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.802734 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.802860 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.802951 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.803040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.803218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.803360 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.803448 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.803525 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.803703 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] credential.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.803842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.803926 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.804001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.804199 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.804325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.804408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.804497 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.804683 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.804808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.804890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.804965 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.805165 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.805307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.805431 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.805516 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.805674 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.805759 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.805910 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.806004 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.806169 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.806255 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.806430 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.806520 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.806677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.806771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.806943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.807027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.807197 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.807281 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.807459 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.807553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.807700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] federation.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.807784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.807942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.808027 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.808193 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.808287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.808446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.808804 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.808891 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.808966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.809039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.809124 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.809200 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.809274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.809418 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.809505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.809654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.809752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.809911 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.809995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.810150 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.810233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.810412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.810504 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.810647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.810731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.810902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.810986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.811147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.811225 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.811368 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.811449 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.811597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.811678 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.811849 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.811930 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.812082 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.812163 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.812320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.812399 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.812570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.812650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.812804 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.812882 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.813048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.813128 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.813277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.813382 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.813543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.813624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.813784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.813865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.814027 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.814109 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.814265 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.814344 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.814517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.814597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.814765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.814846 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.815018 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.815097 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.815275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.815360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.815516 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.815598 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.815749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.815829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.815987 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.816067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.816222 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.816302 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.816458 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.816537 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.816699 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.816777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.816938 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.817020 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.817182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.817262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.817436 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.817518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.817686 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.817768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.817935 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.818014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.818197 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.818277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.818445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.818533 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.818695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.818837 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.818918 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.818993 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.819157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.819239 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.819390 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.819471 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.819629 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.819699 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.819928 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.820071 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.820195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.820320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.820443 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.820566 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.820705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.820832 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.820958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.821080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.821204 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.821326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.821482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.821611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.821611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.821860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.821987 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.822112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.822246 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.822372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.822494 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.822618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.822742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.822875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.823001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.823126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.823257 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.823382 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.823517 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.823650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.823775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.823900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.824026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.824151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.824275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.824408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.824533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.824658 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.824782 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.824907 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.825032 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.825168 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.825301 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.825489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.825612 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.825738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.825864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.826000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.826084 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.826213 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.826334 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.826460 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.826586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.826720 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.826846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.826981 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.827108 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.827234 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.827359 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.827493 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.827616 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.827740 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.827866 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.827987 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.828110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.828241 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.828363 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.828485 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.828606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.828739 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.828861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.828995 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.829118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.829243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.829410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.829533 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.829659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.829795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.829922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.830053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.830179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.830305 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.830429 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.830570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.830695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.830819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.830943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.831066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.831192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.831325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.831451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.831576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.831700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.831830 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.831956 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.832088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.832223 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.832348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.832473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.832597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.832721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] resource.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.832854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.832994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.833114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.833237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.833383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.833507 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.833989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.834115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.834239 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.834371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.834495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.834618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.834748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.834871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.834999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.835122 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.835244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.835367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.835565 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.835691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] role.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.835814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.835937 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] role.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.836059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.836195 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.836327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.836449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.836572 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] role.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.836695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.836818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] role.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.836939 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.837069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.837192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.837314 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.837484 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.837613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.837745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.837884 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.838010 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.838135 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.838259 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.838384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.838516 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.838640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.838767 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.838891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.839016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.839141 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.839273 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.839399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.839480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.839653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.839653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.839894 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.840026 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.840226 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.840347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.840473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.840473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.840707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.840843 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.840969 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.841093 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.841218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.841378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.841510 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.841644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.841770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.841897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.842022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.842147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.842273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.842406 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.842530 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.842655 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.842780 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.842906 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.843048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.843174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.843299 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.843424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.843549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.843672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.843822 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.843948 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.844072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.844194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.844316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.844437 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.844567 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.844700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] token.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.844825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.844949 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.845071 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.845195 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.845325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.845470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.845548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] token.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.845622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.845694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.845767 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.845853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.845929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.846002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.846074 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.846147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.846219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.846301 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.846375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.846448 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.846520 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.846593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.846665 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.846746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.846821 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.846894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.846966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.847039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.847112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.847193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.847267 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.847342 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.847414 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.847487 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.847563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.847646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.847722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.connection = **** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.847803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.847891 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.847967 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.848040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.848118 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.848200 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.848275 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.connection = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.848355 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.848438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.848513 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.848586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.848659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.848659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.848801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.848876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.848948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.848948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.849082 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.849155 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.849235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.849309 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.849412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.849486 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.849559 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.849631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.849716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.849716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.849851 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.849926 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.849999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.850072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.850152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.850228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.850300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.850468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.850549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.850623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80188) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 00:20:40.850706 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.850941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.851187 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.851427 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 15 00:20:40.851601 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80189) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 15 00:20:40.880335 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:40.880507 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:40.880761 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:40.881090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:40.881327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:40.881609 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:40.889089 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:40.889958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:40.917037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:40.917244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:40.917763 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:40.917991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:40.970041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:40.970445 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.018294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.018532 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.019028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.019269 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.084340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.084571 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.084695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.084799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.084881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.084977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.085065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.085222 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.085384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.085466 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.085544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.085795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.108478 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.108655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.108737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.108814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.108884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.109041 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.109181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.109263 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.109399 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.109477 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.109554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.109707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.109853 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.109939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.121131 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.121368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.133759 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.133976 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.134110 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.134203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.134336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.134420 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.134551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.134637 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.134771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.134855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.134983 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80188) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.135065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.135065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.135350 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80189) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 15 00:20:41.151737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.151924 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 00:20:41.152139 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.152288 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.152369 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 00:20:41.152447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 00:20:41.152673 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.152855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 15 00:20:41.152951 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.153138 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.153299 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.153418 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.153624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.153752 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.153850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.154134 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.164417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.164684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.164953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.165081 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.165184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.165264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.165504 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.165790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.173365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.174002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.176635 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.176914 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.177191 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.177316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.177519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.177650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.177813 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.177939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.178017 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.178107 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.178308 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.178436 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.178552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.178643 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.178838 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.178978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.179058 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.179134 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.179349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.179477 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.179649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.179911 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.205520 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.206238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.207106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.207388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.207843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.208115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.212638 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.212906 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.213185 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.213375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.213690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.213977 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.220584 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.220856 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.221316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.221621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.225367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.225646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.225922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.226146 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.226275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.226431 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.226559 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.226682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.226773 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.226974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.227104 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.227213 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.227301 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.227513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.227785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.228054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.246251 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.246524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.247125 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.247402 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.251047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.251981 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.254683 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.254973 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.255739 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.256028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.260107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.261174 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.263872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.264835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.267512 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.267811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.268086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.268364 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.268490 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.268589 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.268751 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.268846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.269067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.269376 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.269664 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.269941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.289194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.289492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.289758 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.290028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.290411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.290698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.290966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.291241 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.297862 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.299143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.299553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.299831 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.300854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.301132 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.303027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.303312 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.303591 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.303890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.304165 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.304306 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.304626 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.304921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.305214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.305514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.317384 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.317672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.317960 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.318293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.318574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.318800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.318934 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.319118 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.319290 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.319382 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.319637 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.319920 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.320191 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.320461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.336881 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.338372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.340123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.341660 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.343414 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.344954 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.345155 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.346579 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.346778 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.347042 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.347319 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.348343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.348621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.348905 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.354617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.356226 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.356353 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.357861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.359444 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.359730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.360011 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.360285 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.361083 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.361338 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.361676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.361953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.369861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.370143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.370420 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.371618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.371902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.372186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.378282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80188) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.378564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.378828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.379096 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.379363 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.379650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.379918 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.380116 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80189) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 15 00:20:41.380212 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.380341 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.380534 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.380745 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.380884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.381009 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.381132 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.381271 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.381485 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.381615 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.381741 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.381868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.381994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80188) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.382139 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.382397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.382672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.382950 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.383233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.383486 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.383750 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80189) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 15 00:20:41.419219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ec77cb69c0 pid: 80188 (default app) Jun 15 00:20:41.421233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ec77cb69c0 pid: 80189 (default app) Jun 15 00:20:41.422566 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e2eeb-075f-4303-8341-f6f0d17bf604 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:41.422867 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e2eeb-075f-4303-8341-f6f0d17bf604 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:41.423147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e2eeb-075f-4303-8341-f6f0d17bf604 None None] PATH_INFO: `/v3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:41.427411 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Wed Jun 15 00:20:41 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:20:49.207534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8987372-e70f-4636-8092-a6d7c449ee47 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:49.208126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8987372-e70f-4636-8092-a6d7c449ee47 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:49.208126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8987372-e70f-4636-8092-a6d7c449ee47 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:49.212680 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:20:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:20:49.219501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899aa7f5-8b09-42b8-b1d1-d71a72cfd8b1 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:49.219947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899aa7f5-8b09-42b8-b1d1-d71a72cfd8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:49.220078 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899aa7f5-8b09-42b8-b1d1-d71a72cfd8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:49.296263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: INFO dbcounter [None req-899aa7f5-8b09-42b8-b1d1-d71a72cfd8b1 None None] Registered counter for database keystone Jun 15 00:20:49.320362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG oslo_db.sqlalchemy.engines [None req-899aa7f5-8b09-42b8-b1d1-d71a72cfd8b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80188) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:20:49.331509 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writer thread running {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:20:49.519088 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG passlib.handlers.bcrypt [None req-899aa7f5-8b09-42b8-b1d1-d71a72cfd8b1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80188) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 15 00:20:49.519526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG passlib.handlers.bcrypt [None req-899aa7f5-8b09-42b8-b1d1-d71a72cfd8b1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80188) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 15 00:20:49.574636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-899aa7f5-8b09-42b8-b1d1-d71a72cfd8b1 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:20:49.576210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-899aa7f5-8b09-42b8-b1d1-d71a72cfd8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:20:49.708337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:20:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 15 00:20:49.909987 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8987372-e70f-4636-8092-a6d7c449ee47 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:49.987319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: INFO dbcounter [None req-d8987372-e70f-4636-8092-a6d7c449ee47 None None] Registered counter for database keystone Jun 15 00:20:50.008794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG oslo_db.sqlalchemy.engines [None req-d8987372-e70f-4636-8092-a6d7c449ee47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80189) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 15 00:20:50.016248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writer thread running {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 15 00:20:50.133842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8987372-e70f-4636-8092-a6d7c449ee47 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:50.139313 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfc74c-3d4f-4ed1-b307-40ea04b780e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:50.139980 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfc74c-3d4f-4ed1-b307-40ea04b780e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:50.140264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfc74c-3d4f-4ed1-b307-40ea04b780e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:50.140539 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfc74c-3d4f-4ed1-b307-40ea04b780e9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:50.152565 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfc74c-3d4f-4ed1-b307-40ea04b780e9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:50.207605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a1bfc74c-3d4f-4ed1-b307-40ea04b780e9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 15 00:20:50.208173 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfc74c-3d4f-4ed1-b307-40ea04b780e9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:50.218411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Jun 15 00:20:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:20:50.228330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899aa7f5-8b09-42b8-b1d1-d71a72cfd8b1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:50.254244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899aa7f5-8b09-42b8-b1d1-d71a72cfd8b1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:50.261263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53105d25-26a5-4d66-8455-c9126186152c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:50.262421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53105d25-26a5-4d66-8455-c9126186152c admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:50.262727 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53105d25-26a5-4d66-8455-c9126186152c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:50.263003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53105d25-26a5-4d66-8455-c9126186152c admin admin] PATH_INFO: `/v3/projects/ac65417652594c99a423cc960be9081e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:50.265205 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53105d25-26a5-4d66-8455-c9126186152c admin admin] RBAC: Authorizing `identity:get_project(project_id=ac65417652594c99a423cc960be9081e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:50.317393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: WARNING keystone.common.rbac_enforcer.enforcer [None req-53105d25-26a5-4d66-8455-c9126186152c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 15 00:20:50.317734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53105d25-26a5-4d66-8455-c9126186152c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:50.322524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Jun 15 00:20:50 2022] GET /identity/v3/projects/ac65417652594c99a423cc960be9081e => generated 344 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:20:52.416357 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b92041-d631-4acc-bc95-c2b48259ff1c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:52.416850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b92041-d631-4acc-bc95-c2b48259ff1c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:52.416850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b92041-d631-4acc-bc95-c2b48259ff1c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:52.420994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:20:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:20:52.426819 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47891ec7-07af-4a28-9fc5-12a9a0704764 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:52.427266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47891ec7-07af-4a28-9fc5-12a9a0704764 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:52.427387 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47891ec7-07af-4a28-9fc5-12a9a0704764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:52.447511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-47891ec7-07af-4a28-9fc5-12a9a0704764 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:20:52.449382 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-47891ec7-07af-4a28-9fc5-12a9a0704764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:20:52.457817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:20:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 15 00:20:52.480366 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b92041-d631-4acc-bc95-c2b48259ff1c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:52.493475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b92041-d631-4acc-bc95-c2b48259ff1c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:52.497912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14027a6c-1280-4f0c-af84-acd9b16b94f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:52.498568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027a6c-1280-4f0c-af84-acd9b16b94f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:52.498858 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027a6c-1280-4f0c-af84-acd9b16b94f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:52.499145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027a6c-1280-4f0c-af84-acd9b16b94f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:52.507348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14027a6c-1280-4f0c-af84-acd9b16b94f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:52.509203 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14027a6c-1280-4f0c-af84-acd9b16b94f8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:52.518296 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Jun 15 00:20:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:20:52.524096 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47891ec7-07af-4a28-9fc5-12a9a0704764 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:52.533515 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47891ec7-07af-4a28-9fc5-12a9a0704764 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:52.538013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1bd34-c9a3-4baa-8c23-7b0f50f364fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:52.538897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1bd34-c9a3-4baa-8c23-7b0f50f364fa admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:52.539181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1bd34-c9a3-4baa-8c23-7b0f50f364fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:52.539551 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1bd34-c9a3-4baa-8c23-7b0f50f364fa admin admin] PATH_INFO: `/v3/users/d38407cead4d4c429e0e7ef7b966bf82` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:52.540951 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1bd34-c9a3-4baa-8c23-7b0f50f364fa admin admin] RBAC: Authorizing `identity:get_user(user_id=d38407cead4d4c429e0e7ef7b966bf82)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:52.542811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1bd34-c9a3-4baa-8c23-7b0f50f364fa admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:52.544388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Jun 15 00:20:52 2022] GET /identity/v3/users/d38407cead4d4c429e0e7ef7b966bf82 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:20:54.728108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3e7f4-a704-4493-97e6-7a4d204e3bb4 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:54.728742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a762a-ea2a-4442-a86e-b3e4b373735e None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:54.729081 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3e7f4-a704-4493-97e6-7a4d204e3bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:54.729176 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a762a-ea2a-4442-a86e-b3e4b373735e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:54.729261 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3e7f4-a704-4493-97e6-7a4d204e3bb4 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:54.729337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a762a-ea2a-4442-a86e-b3e4b373735e None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:54.730143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:20:54.730271 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:20:54.735041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eff62-a7cb-42e4-832c-0d962a8e8f76 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:54.735198 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17361c9-394c-4581-84cb-d7c81341b6fd None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:54.735295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eff62-a7cb-42e4-832c-0d962a8e8f76 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:54.735376 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17361c9-394c-4581-84cb-d7c81341b6fd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:54.735590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00eff62-a7cb-42e4-832c-0d962a8e8f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:54.735733 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17361c9-394c-4581-84cb-d7c81341b6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:54.754553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b00eff62-a7cb-42e4-832c-0d962a8e8f76 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:20:54.755736 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b00eff62-a7cb-42e4-832c-0d962a8e8f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:20:54.776456 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG passlib.handlers.bcrypt [None req-d17361c9-394c-4581-84cb-d7c81341b6fd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80189) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 15 00:20:54.776884 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG passlib.handlers.bcrypt [None req-d17361c9-394c-4581-84cb-d7c81341b6fd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80189) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 15 00:20:54.822961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d17361c9-394c-4581-84cb-d7c81341b6fd None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:20:54.824585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d17361c9-394c-4581-84cb-d7c81341b6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:20:54.839486 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 7/12] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:20:54.861968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eff62-a7cb-42e4-832c-0d962a8e8f76 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:54.886134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:20:54.928773 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 6/13] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:20:54.950823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17361c9-394c-4581-84cb-d7c81341b6fd None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:54.966764 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00eff62-a7cb-42e4-832c-0d962a8e8f76 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:55.001886 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de34059-8958-4b39-a8ec-5c88170b1f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:55.002639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de34059-8958-4b39-a8ec-5c88170b1f32 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:55.002926 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de34059-8958-4b39-a8ec-5c88170b1f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:55.003207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de34059-8958-4b39-a8ec-5c88170b1f32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:55.015542 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de34059-8958-4b39-a8ec-5c88170b1f32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:20:55.026945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-9de34059-8958-4b39-a8ec-5c88170b1f32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:20:55.026945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:20:55.026945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:20:55.026945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:20:55.026945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:20:55.026945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:20:55.026945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:20:55.026945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:20:55.026945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:20:55.026945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:20:55.026945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:20:55.026945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:20:55.026945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:20:55.026945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:20:55.026945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:20:55.026945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:20:55.027872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:20:55.027872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:20:55.027872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:20:55.027872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:20:55.027872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:20:55.027872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:20:55.027872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:20:55.027872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:20:55.027872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:20:55.027872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:20:55.027872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:20:55.027872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:20:55.027872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:20:55.027872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:20:55.027872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:20:55.027872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:20:55.028697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:20:55.028697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:20:55.028697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:20:55.028697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:20:55.028697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:20:55.028697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:20:55.028697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:20:55.028697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:20:55.028697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:20:55.028697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:20:55.028697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:20:55.028697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:20:55.028697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 8/14] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:20:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:20:55.034172 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de34059-8958-4b39-a8ec-5c88170b1f32 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:55.055469 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17361c9-394c-4581-84cb-d7c81341b6fd None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:55.057956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:20:55.096346 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17035982-fb0b-4580-8ceb-209acc8b942e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:55.097262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17035982-fb0b-4580-8ceb-209acc8b942e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:55.097585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17035982-fb0b-4580-8ceb-209acc8b942e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:55.097865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17035982-fb0b-4580-8ceb-209acc8b942e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:55.119628 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:20:55.137747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de34059-8958-4b39-a8ec-5c88170b1f32 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:55.165399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17035982-fb0b-4580-8ceb-209acc8b942e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:55.166941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17035982-fb0b-4580-8ceb-209acc8b942e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:55.172564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92addbc4-2791-4b0a-850a-5d428d62d18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:55.173250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92addbc4-2791-4b0a-850a-5d428d62d18c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:55.173571 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92addbc4-2791-4b0a-850a-5d428d62d18c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:55.173837 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92addbc4-2791-4b0a-850a-5d428d62d18c None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:55.175004 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92addbc4-2791-4b0a-850a-5d428d62d18c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:20:55.175320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92addbc4-2791-4b0a-850a-5d428d62d18c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:55.177064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92addbc4-2791-4b0a-850a-5d428d62d18c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:55.189104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 9/15] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:20:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:20:55.194948 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92addbc4-2791-4b0a-850a-5d428d62d18c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:55.264855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 7/16] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:20:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:20:55.270555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17035982-fb0b-4580-8ceb-209acc8b942e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:55.273203 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:20:55.294249 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92addbc4-2791-4b0a-850a-5d428d62d18c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:55.329334 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bfafe-a19a-4e71-9074-1d061b7579eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:55.330293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bfafe-a19a-4e71-9074-1d061b7579eb None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:55.330577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bfafe-a19a-4e71-9074-1d061b7579eb None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:55.330857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bfafe-a19a-4e71-9074-1d061b7579eb None admin] PATH_INFO: `/v3/users/d38407cead4d4c429e0e7ef7b966bf82` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:55.332071 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bfafe-a19a-4e71-9074-1d061b7579eb None admin] RBAC: Authorizing `identity:get_user(user_id=d38407cead4d4c429e0e7ef7b966bf82)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:55.333655 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bfafe-a19a-4e71-9074-1d061b7579eb None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:55.335311 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 10/17] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:20:55 2022] GET /identity/v3/users/d38407cead4d4c429e0e7ef7b966bf82 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:20:55.340903 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bfafe-a19a-4e71-9074-1d061b7579eb None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:55.355133 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:20:55.374818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17035982-fb0b-4580-8ceb-209acc8b942e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:55.410263 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609755a5-79ae-4c40-b57e-6b8991e9e712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:55.411076 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609755a5-79ae-4c40-b57e-6b8991e9e712 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:55.411362 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609755a5-79ae-4c40-b57e-6b8991e9e712 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:55.411650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609755a5-79ae-4c40-b57e-6b8991e9e712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:55.429791 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609755a5-79ae-4c40-b57e-6b8991e9e712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:55.431276 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609755a5-79ae-4c40-b57e-6b8991e9e712 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:55.441296 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bfafe-a19a-4e71-9074-1d061b7579eb None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:55.451517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-609755a5-79ae-4c40-b57e-6b8991e9e712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:20:55.451517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:20:55.451517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:20:55.451517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:20:55.451517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:20:55.451517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:20:55.451517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:20:55.451517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:20:55.451517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:20:55.451517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:20:55.451517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:20:55.451517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:20:55.451517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:20:55.451517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:20:55.451517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:20:55.452321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:20:55.453135 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:20:55.453135 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:20:55.453135 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:20:55.453135 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:20:55.453135 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 8/18] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:20:55.458498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609755a5-79ae-4c40-b57e-6b8991e9e712 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:55.476664 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992307ff-82a4-4584-bc24-f37e7f684613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:55.477518 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992307ff-82a4-4584-bc24-f37e7f684613 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:55.477808 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992307ff-82a4-4584-bc24-f37e7f684613 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:55.478090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992307ff-82a4-4584-bc24-f37e7f684613 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:55.479393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992307ff-82a4-4584-bc24-f37e7f684613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:55.480883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992307ff-82a4-4584-bc24-f37e7f684613 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:55.482526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 11/19] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:20:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:20:55.488307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992307ff-82a4-4584-bc24-f37e7f684613 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:55.515482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:20:55.561637 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609755a5-79ae-4c40-b57e-6b8991e9e712 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:55.569843 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:20:55.590076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992307ff-82a4-4584-bc24-f37e7f684613 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:55.595223 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6937627-b198-42ec-99cf-eb4d50dcace4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:55.595899 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6937627-b198-42ec-99cf-eb4d50dcace4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:55.596185 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6937627-b198-42ec-99cf-eb4d50dcace4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:55.596466 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6937627-b198-42ec-99cf-eb4d50dcace4 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:55.597208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6937627-b198-42ec-99cf-eb4d50dcace4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:20:55.597550 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6937627-b198-42ec-99cf-eb4d50dcace4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:55.598958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6937627-b198-42ec-99cf-eb4d50dcace4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:55.617013 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 9/20] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:20:55.623770 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fe8c8-2059-4238-9314-4e3d83931010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:55.624468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fe8c8-2059-4238-9314-4e3d83931010 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:55.624755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fe8c8-2059-4238-9314-4e3d83931010 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:55.625036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fe8c8-2059-4238-9314-4e3d83931010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:55.625935 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fe8c8-2059-4238-9314-4e3d83931010 None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.domain.id=default, user.id=d38407cead4d4c429e0e7ef7b966bf82) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:20:55.626254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fe8c8-2059-4238-9314-4e3d83931010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:55.627753 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fe8c8-2059-4238-9314-4e3d83931010 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:55.636413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 12/21] 10.222.0.36 () {56 vars in 1322 bytes} [Wed Jun 15 00:20:55 2022] GET /identity/v3/role_assignments?user.id=d38407cead4d4c429e0e7ef7b966bf82&scope.domain.id=default&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:20:58.055507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dcfb1-3f49-4076-bd74-33fa1e2e6d24 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:58.056678 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dcfb1-3f49-4076-bd74-33fa1e2e6d24 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:58.057262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235dcfb1-3f49-4076-bd74-33fa1e2e6d24 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:58.058902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 10/22] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:20:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:20:58.066104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76887d-0a94-429b-b6a6-318ed8e79c68 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:58.067439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76887d-0a94-429b-b6a6-318ed8e79c68 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:58.067930 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76887d-0a94-429b-b6a6-318ed8e79c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:58.094086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-cb76887d-0a94-429b-b6a6-318ed8e79c68 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:20:58.095658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-cb76887d-0a94-429b-b6a6-318ed8e79c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:20:58.185144 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 13/23] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:20:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:20:58.219782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dcfb1-3f49-4076-bd74-33fa1e2e6d24 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:58.358420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235dcfb1-3f49-4076-bd74-33fa1e2e6d24 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:58.385372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:20:58.408796 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d0768-224f-4640-a885-71a87309e948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:58.409521 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d0768-224f-4640-a885-71a87309e948 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:58.409808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d0768-224f-4640-a885-71a87309e948 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:58.410086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d0768-224f-4640-a885-71a87309e948 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:58.410859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d0768-224f-4640-a885-71a87309e948 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:58.412286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d0768-224f-4640-a885-71a87309e948 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:58.502633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147a2eb-db83-46c1-bff1-8383da48b42a None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:58.503329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147a2eb-db83-46c1-bff1-8383da48b42a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:58.503803 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147a2eb-db83-46c1-bff1-8383da48b42a None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:58.505561 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 14/24] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:20:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:20:58.534286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b8b36-bd13-4493-98bb-2c000a529ce9 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:58.534969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b8b36-bd13-4493-98bb-2c000a529ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:58.535474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b8b36-bd13-4493-98bb-2c000a529ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:58.563751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-0f2b8b36-bd13-4493-98bb-2c000a529ce9 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:20:58.566791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0f2b8b36-bd13-4493-98bb-2c000a529ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:20:58.620487 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 11/25] 10.222.0.36 () {60 vars in 1131 bytes} [Wed Jun 15 00:20:58 2022] POST /identity/v3/roles => generated 219 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:20:58.625338 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffb3d6-09a7-44da-bc61-787ba96a148e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:58.628620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffb3d6-09a7-44da-bc61-787ba96a148e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:58.629469 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffb3d6-09a7-44da-bc61-787ba96a148e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:58.634821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 12/26] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:20:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:20:58.641370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9fb35-9566-4493-bbc3-1aafcd22b640 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:58.641370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9fb35-9566-4493-bbc3-1aafcd22b640 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:58.641370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9fb35-9566-4493-bbc3-1aafcd22b640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:58.667724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a6e9fb35-9566-4493-bbc3-1aafcd22b640 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:20:58.671282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a6e9fb35-9566-4493-bbc3-1aafcd22b640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:20:58.702307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 15/27] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:20:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:20:58.715326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c00a5e-a165-4681-8762-9fbfbb7f6770 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:58.715625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c00a5e-a165-4681-8762-9fbfbb7f6770 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:58.715916 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c00a5e-a165-4681-8762-9fbfbb7f6770 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:58.717615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 16/28] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:20:58.726876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b1d73-0b00-4c87-a4b4-60e66a56823c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:58.727162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b1d73-0b00-4c87-a4b4-60e66a56823c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:58.727453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b1d73-0b00-4c87-a4b4-60e66a56823c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:58.736493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:20:58.750891 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8b7b1d73-0b00-4c87-a4b4-60e66a56823c None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:20:58.752130 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8b7b1d73-0b00-4c87-a4b4-60e66a56823c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:20:58.802923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 13/29] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:20:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:20:58.802923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9fb35-9566-4493-bbc3-1aafcd22b640 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:58.868381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 17/30] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:20:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:20:58.869651 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b1d73-0b00-4c87-a4b4-60e66a56823c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:58.971160 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9fb35-9566-4493-bbc3-1aafcd22b640 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:58.980255 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:20:59.009882 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b1d73-0b00-4c87-a4b4-60e66a56823c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:59.014923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb02488-9f26-4303-a1f1-07bed9fefa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:59.015764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb02488-9f26-4303-a1f1-07bed9fefa2f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:59.016053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb02488-9f26-4303-a1f1-07bed9fefa2f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:59.016334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb02488-9f26-4303-a1f1-07bed9fefa2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:59.028753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb02488-9f26-4303-a1f1-07bed9fefa2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:59.031110 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb02488-9f26-4303-a1f1-07bed9fefa2f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:59.052253 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f4460-7f77-443a-a136-670d436d587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:59.053279 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f4460-7f77-443a-a136-670d436d587f None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:59.053722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f4460-7f77-443a-a136-670d436d587f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:59.053831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-fbb02488-9f26-4303-a1f1-07bed9fefa2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:20:59.053831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:20:59.053831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:20:59.053831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:20:59.053831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:20:59.053831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:20:59.053831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:20:59.053831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:20:59.053831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:20:59.053831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:20:59.053831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:20:59.053831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:20:59.053831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:20:59.053831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:20:59.053831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:20:59.054774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:20:59.056227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:20:59.056227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:20:59.056227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:20:59.056227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:20:59.056227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 14/31] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:20:59.056227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb02488-9f26-4303-a1f1-07bed9fefa2f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:59.056999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f4460-7f77-443a-a136-670d436d587f None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:59.058036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f4460-7f77-443a-a136-670d436d587f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:59.059897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f4460-7f77-443a-a136-670d436d587f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:59.068578 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:20:59.172971 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb02488-9f26-4303-a1f1-07bed9fefa2f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:59.211707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43537f2-666b-4439-a5a3-9412010a666b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:59.212566 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43537f2-666b-4439-a5a3-9412010a666b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:59.212865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43537f2-666b-4439-a5a3-9412010a666b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:59.213153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43537f2-666b-4439-a5a3-9412010a666b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:59.227550 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43537f2-666b-4439-a5a3-9412010a666b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:20:59.236912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-c43537f2-666b-4439-a5a3-9412010a666b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:20:59.236912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:20:59.236912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:20:59.236912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:20:59.236912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:20:59.236912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:20:59.236912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:20:59.236912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:20:59.236912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:20:59.236912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:20:59.236912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:20:59.236912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:20:59.236912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:20:59.236912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:20:59.236912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:20:59.236912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:20:59.237891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:20:59.237891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:20:59.237891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:20:59.237891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:20:59.237891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:20:59.237891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:20:59.237891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:20:59.237891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:20:59.237891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:20:59.237891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:20:59.237891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:20:59.237891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:20:59.237891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:20:59.237891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:20:59.237891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:20:59.237891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:20:59.238709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:20:59.238709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:20:59.238709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:20:59.238709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:20:59.238709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:20:59.238709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:20:59.238709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:20:59.238709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:20:59.238709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:20:59.238709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:20:59.238709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:20:59.238709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:20:59.238709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 15/32] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:20:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:20:59.239557 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43537f2-666b-4439-a5a3-9412010a666b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:59.261531 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:20:59.322308 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 18/33] 10.222.0.36 () {60 vars in 1131 bytes} [Wed Jun 15 00:20:58 2022] POST /identity/v3/roles => generated 225 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:20:59.323595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f4460-7f77-443a-a136-670d436d587f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:59.369938 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43537f2-666b-4439-a5a3-9412010a666b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:59.441052 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a3ce7-1a3f-4816-8f2b-ea8eea3d5816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:59.442098 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a3ce7-1a3f-4816-8f2b-ea8eea3d5816 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:59.442569 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a3ce7-1a3f-4816-8f2b-ea8eea3d5816 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:59.443051 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a3ce7-1a3f-4816-8f2b-ea8eea3d5816 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:59.443989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a3ce7-1a3f-4816-8f2b-ea8eea3d5816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:20:59.446411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a3ce7-1a3f-4816-8f2b-ea8eea3d5816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:59.451525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a3ce7-1a3f-4816-8f2b-ea8eea3d5816 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:59.457156 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f4460-7f77-443a-a136-670d436d587f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:59.486734 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 16/34] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:20:59.492438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a3ce7-1a3f-4816-8f2b-ea8eea3d5816 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:59.547192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5b430-faf2-47fc-96f8-c5d4e4bf183a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:59.549850 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5b430-faf2-47fc-96f8-c5d4e4bf183a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:59.550382 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5b430-faf2-47fc-96f8-c5d4e4bf183a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:59.551027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5b430-faf2-47fc-96f8-c5d4e4bf183a None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:59.552063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5b430-faf2-47fc-96f8-c5d4e4bf183a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:20:59.552564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5b430-faf2-47fc-96f8-c5d4e4bf183a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:59.554533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5b430-faf2-47fc-96f8-c5d4e4bf183a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:59.565374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 19/35] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:20:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:20:59.572625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5b430-faf2-47fc-96f8-c5d4e4bf183a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:59.622520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:20:59.645078 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:20:59.649064 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a3ce7-1a3f-4816-8f2b-ea8eea3d5816 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:59.683676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece371b-46d1-4391-94b7-4676c78c017e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:59.684466 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece371b-46d1-4391-94b7-4676c78c017e None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:59.684759 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece371b-46d1-4391-94b7-4676c78c017e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:59.685032 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece371b-46d1-4391-94b7-4676c78c017e None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:59.686032 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece371b-46d1-4391-94b7-4676c78c017e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:59.687499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece371b-46d1-4391-94b7-4676c78c017e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:59.689745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5b430-faf2-47fc-96f8-c5d4e4bf183a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:59.724143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c46ac-1d4a-4621-ab26-f5a9cc03422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:59.725068 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c46ac-1d4a-4621-ab26-f5a9cc03422f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:59.725391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c46ac-1d4a-4621-ab26-f5a9cc03422f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:59.725689 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c46ac-1d4a-4621-ab26-f5a9cc03422f None admin] PATH_INFO: `/v3/users/d38407cead4d4c429e0e7ef7b966bf82` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:59.727143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c46ac-1d4a-4621-ab26-f5a9cc03422f None admin] RBAC: Authorizing `identity:get_user(user_id=d38407cead4d4c429e0e7ef7b966bf82)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:59.728742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c46ac-1d4a-4621-ab26-f5a9cc03422f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:59.730752 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 20/36] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:20:59 2022] GET /identity/v3/users/d38407cead4d4c429e0e7ef7b966bf82 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:20:59.731903 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5acae-eaba-498d-bbdf-f1602778db7d None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:59.732197 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5acae-eaba-498d-bbdf-f1602778db7d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:59.732483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5acae-eaba-498d-bbdf-f1602778db7d None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:59.734010 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 21/37] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:20:59.734934 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6450375-403f-4fde-a1d5-045880f4e868 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:59.735407 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6450375-403f-4fde-a1d5-045880f4e868 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:59.735504 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6450375-403f-4fde-a1d5-045880f4e868 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:59.736944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 22/38] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:20:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:20:59.739947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6450375-403f-4fde-a1d5-045880f4e868 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:59.829786 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 17/39] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 15 00:20:59 2022] POST /identity/v3/projects => generated 301 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:20:59.830900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1457dcb-ea8f-4123-8848-3816a9480c7e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:59.831196 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1457dcb-ea8f-4123-8848-3816a9480c7e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:59.831476 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1457dcb-ea8f-4123-8848-3816a9480c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:59.849757 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d1457dcb-ea8f-4123-8848-3816a9480c7e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:20:59.851072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d1457dcb-ea8f-4123-8848-3816a9480c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:20:59.859981 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6450375-403f-4fde-a1d5-045880f4e868 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:20:59.887053 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:20:59.899554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d53d8-9259-4e6b-a318-72d828298217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:20:59.900428 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d53d8-9259-4e6b-a318-72d828298217 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:59.900718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d53d8-9259-4e6b-a318-72d828298217 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:59.901000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d53d8-9259-4e6b-a318-72d828298217 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:59.902417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d53d8-9259-4e6b-a318-72d828298217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:20:59.904446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d53d8-9259-4e6b-a318-72d828298217 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:20:59.906331 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 23/40] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:20:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:20:59.912646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a37e8-2ecf-4d27-8c6a-d1849aba08f6 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:20:59.912949 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a37e8-2ecf-4d27-8c6a-d1849aba08f6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:20:59.913236 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a37e8-2ecf-4d27-8c6a-d1849aba08f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:20:59.941404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 18/41] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:20:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:20:59.941606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-006a37e8-2ecf-4d27-8c6a-d1849aba08f6 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:20:59.941722 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1457dcb-ea8f-4123-8848-3816a9480c7e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:20:59.941814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-006a37e8-2ecf-4d27-8c6a-d1849aba08f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:00.008091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:00.020048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 24/42] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:20:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:00.020867 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a37e8-2ecf-4d27-8c6a-d1849aba08f6 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:00.057892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1457dcb-ea8f-4123-8848-3816a9480c7e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:00.091894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbfa16-4c4c-47b7-ab47-020340d070b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:00.092806 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbfa16-4c4c-47b7-ab47-020340d070b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:00.093096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbfa16-4c4c-47b7-ab47-020340d070b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:00.093405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbfa16-4c4c-47b7-ab47-020340d070b2 None admin] PATH_INFO: `/v3/domains/default/users/d38407cead4d4c429e0e7ef7b966bf82/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:00.095703 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbfa16-4c4c-47b7-ab47-020340d070b2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d38407cead4d4c429e0e7ef7b966bf82, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:00.097176 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bbfa16-4c4c-47b7-ab47-020340d070b2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:00.112518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 19/43] 10.222.0.36 () {58 vars in 1361 bytes} [Wed Jun 15 00:20:59 2022] PUT /identity/v3/domains/default/users/d38407cead4d4c429e0e7ef7b966bf82/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:00.113712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbfa16-4c4c-47b7-ab47-020340d070b2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:00.145657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a37e8-2ecf-4d27-8c6a-d1849aba08f6 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:00.178412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:00.193338 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b55ce-6c5e-4a2c-ba5a-39e234826d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:00.194083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b55ce-6c5e-4a2c-ba5a-39e234826d37 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:00.194386 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b55ce-6c5e-4a2c-ba5a-39e234826d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:00.194677 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b55ce-6c5e-4a2c-ba5a-39e234826d37 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:00.195470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b55ce-6c5e-4a2c-ba5a-39e234826d37 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:00.196995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b55ce-6c5e-4a2c-ba5a-39e234826d37 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:00.212744 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 25/44] 10.222.0.36 () {60 vars in 1131 bytes} [Wed Jun 15 00:21:00 2022] POST /identity/v3/roles => generated 223 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:21:00.241310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bbfa16-4c4c-47b7-ab47-020340d070b2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:00.266448 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:00.288508 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc47a60-aa45-43ff-b9f9-cdf32a8cac53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:00.289381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc47a60-aa45-43ff-b9f9-cdf32a8cac53 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:00.289697 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc47a60-aa45-43ff-b9f9-cdf32a8cac53 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:00.289976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc47a60-aa45-43ff-b9f9-cdf32a8cac53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:00.291349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc47a60-aa45-43ff-b9f9-cdf32a8cac53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:00.292858 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc47a60-aa45-43ff-b9f9-cdf32a8cac53 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:00.294965 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 20/45] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:00.300818 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b55ce-6c5e-4a2c-ba5a-39e234826d37 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:00.411274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b55ce-6c5e-4a2c-ba5a-39e234826d37 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:00.445908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b30b4d-55ad-47bd-ba5d-66e4d49ae3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:00.446590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b30b4d-55ad-47bd-ba5d-66e4d49ae3cd None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:00.446964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b30b4d-55ad-47bd-ba5d-66e4d49ae3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:00.447260 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b30b4d-55ad-47bd-ba5d-66e4d49ae3cd None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:00.448002 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b30b4d-55ad-47bd-ba5d-66e4d49ae3cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:00.449521 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b30b4d-55ad-47bd-ba5d-66e4d49ae3cd None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:00.485369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 26/46] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 15 00:21:00 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:21:02.245054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4747bfe-b726-4354-ac6f-fb3e8cadab7a None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:02.245621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4747bfe-b726-4354-ac6f-fb3e8cadab7a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:02.245621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4747bfe-b726-4354-ac6f-fb3e8cadab7a None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:02.247061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 21/47] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:02.252413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cdf8b-b747-46ed-a4e5-b3d68650a740 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:02.252823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cdf8b-b747-46ed-a4e5-b3d68650a740 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:02.252984 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cdf8b-b747-46ed-a4e5-b3d68650a740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:02.271914 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-391cdf8b-b747-46ed-a4e5-b3d68650a740 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:02.273131 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-391cdf8b-b747-46ed-a4e5-b3d68650a740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:02.301236 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:02.343740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 27/48] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:02.366698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4747bfe-b726-4354-ac6f-fb3e8cadab7a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:02.471702 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4747bfe-b726-4354-ac6f-fb3e8cadab7a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:02.508358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa00aa1-707a-46f3-bfaa-ac47b8cc3862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:02.509165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa00aa1-707a-46f3-bfaa-ac47b8cc3862 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:02.509517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa00aa1-707a-46f3-bfaa-ac47b8cc3862 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:02.509799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa00aa1-707a-46f3-bfaa-ac47b8cc3862 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:02.520056 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa00aa1-707a-46f3-bfaa-ac47b8cc3862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:02.527901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-bfa00aa1-707a-46f3-bfaa-ac47b8cc3862 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:02.527901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:02.527901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:02.527901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:02.527901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:02.527901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:02.527901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:02.527901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:02.527901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:02.527901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:02.527901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:02.527901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:02.527901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:02.527901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:02.527901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:02.527901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:02.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:02.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:02.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:02.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:02.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:02.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:02.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:02.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:02.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:02.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:02.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:02.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:02.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:02.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:02.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:02.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:02.529577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:02.529577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:02.529577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:02.529577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:02.529577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:02.529577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:02.529577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:02.529577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:02.529577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:02.529577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:02.529577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:02.529577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:02.529577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 22/49] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:21:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:02.536834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cdf8b-b747-46ed-a4e5-b3d68650a740 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:02.620773 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774ed88-f534-4e9c-9bb4-9eba19faa0ae None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:02.620985 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774ed88-f534-4e9c-9bb4-9eba19faa0ae None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:02.621249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774ed88-f534-4e9c-9bb4-9eba19faa0ae None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:02.622684 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 23/50] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:02.627608 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307b6be-ffb6-42a1-9b09-5eac94c07257 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:02.627882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307b6be-ffb6-42a1-9b09-5eac94c07257 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:02.628165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307b6be-ffb6-42a1-9b09-5eac94c07257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:02.645484 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c307b6be-ffb6-42a1-9b09-5eac94c07257 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:02.646760 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c307b6be-ffb6-42a1-9b09-5eac94c07257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:02.648432 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cdf8b-b747-46ed-a4e5-b3d68650a740 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:02.683374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7994a0-fc14-4376-b166-e4bbaba4ece8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:02.684052 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7994a0-fc14-4376-b166-e4bbaba4ece8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:02.684337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7994a0-fc14-4376-b166-e4bbaba4ece8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:02.684615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7994a0-fc14-4376-b166-e4bbaba4ece8 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:02.685394 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7994a0-fc14-4376-b166-e4bbaba4ece8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:02.685710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7994a0-fc14-4376-b166-e4bbaba4ece8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:02.687108 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7994a0-fc14-4376-b166-e4bbaba4ece8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:02.691026 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:02.695564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 28/51] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:02.701148 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7994a0-fc14-4376-b166-e4bbaba4ece8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:02.715491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 24/52] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:02.730168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:02.738676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307b6be-ffb6-42a1-9b09-5eac94c07257 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:02.805372 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7994a0-fc14-4376-b166-e4bbaba4ece8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:02.838510 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193447-b5fc-4fd7-be49-b4d4d25c43b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:02.839444 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193447-b5fc-4fd7-be49-b4d4d25c43b3 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:02.839734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193447-b5fc-4fd7-be49-b4d4d25c43b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:02.840015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90193447-b5fc-4fd7-be49-b4d4d25c43b3 None admin] PATH_INFO: `/v3/users/d38407cead4d4c429e0e7ef7b966bf82` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:02.840967 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307b6be-ffb6-42a1-9b09-5eac94c07257 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:02.841250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90193447-b5fc-4fd7-be49-b4d4d25c43b3 None admin] RBAC: Authorizing `identity:get_user(user_id=d38407cead4d4c429e0e7ef7b966bf82)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:02.842743 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90193447-b5fc-4fd7-be49-b4d4d25c43b3 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:02.844391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 29/53] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:02 2022] GET /identity/v3/users/d38407cead4d4c429e0e7ef7b966bf82 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:02.849875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193447-b5fc-4fd7-be49-b4d4d25c43b3 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:02.879946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f134e6-1591-4720-9662-0dc1d4ad1912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:02.881008 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f134e6-1591-4720-9662-0dc1d4ad1912 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:02.881294 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f134e6-1591-4720-9662-0dc1d4ad1912 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:02.881605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f134e6-1591-4720-9662-0dc1d4ad1912 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:02.882782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f134e6-1591-4720-9662-0dc1d4ad1912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:02.884264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f134e6-1591-4720-9662-0dc1d4ad1912 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:02.886032 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 25/54] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:02.891507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f134e6-1591-4720-9662-0dc1d4ad1912 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:02.935787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:02.945681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:02.952922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90193447-b5fc-4fd7-be49-b4d4d25c43b3 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:02.987761 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05be0e-d1f5-4846-870b-ac06c3181dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:02.988082 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f134e6-1591-4720-9662-0dc1d4ad1912 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:02.988578 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05be0e-d1f5-4846-870b-ac06c3181dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:02.988872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05be0e-d1f5-4846-870b-ac06c3181dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:02.989157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05be0e-d1f5-4846-870b-ac06c3181dc8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:02.990738 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05be0e-d1f5-4846-870b-ac06c3181dc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:02.992208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05be0e-d1f5-4846-870b-ac06c3181dc8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:02.993885 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 30/55] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:02.999895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05be0e-d1f5-4846-870b-ac06c3181dc8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:03.021038 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65423e9-4940-4026-9ebe-62372a29efb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:03.021746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65423e9-4940-4026-9ebe-62372a29efb5 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:03.022040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65423e9-4940-4026-9ebe-62372a29efb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:03.022321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65423e9-4940-4026-9ebe-62372a29efb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:03.023034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65423e9-4940-4026-9ebe-62372a29efb5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:03.024485 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65423e9-4940-4026-9ebe-62372a29efb5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:03.050297 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 26/56] 10.222.0.36 () {60 vars in 1140 bytes} [Wed Jun 15 00:21:02 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:21:03.106661 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05be0e-d1f5-4846-870b-ac06c3181dc8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:03.146199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178f796-9d75-4893-b3da-7c9ac60af158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:03.146795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178f796-9d75-4893-b3da-7c9ac60af158 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:03.147069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178f796-9d75-4893-b3da-7c9ac60af158 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:03.147346 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178f796-9d75-4893-b3da-7c9ac60af158 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:03.148214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178f796-9d75-4893-b3da-7c9ac60af158 None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.domain.id=default, user.id=d38407cead4d4c429e0e7ef7b966bf82) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:03.148526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178f796-9d75-4893-b3da-7c9ac60af158 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:03.150060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178f796-9d75-4893-b3da-7c9ac60af158 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:03.156913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 31/57] 10.222.0.36 () {56 vars in 1322 bytes} [Wed Jun 15 00:21:02 2022] GET /identity/v3/role_assignments?user.id=d38407cead4d4c429e0e7ef7b966bf82&scope.domain.id=default&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 530 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:05.164823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dd401-5725-4c86-ad27-7f664c03d6c7 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:05.165898 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dd401-5725-4c86-ad27-7f664c03d6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:05.165898 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dd401-5725-4c86-ad27-7f664c03d6c7 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:05.168130 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 27/58] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:05.174547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20df3a5-cde1-4345-99f1-d5c5249e0e36 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:05.174972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20df3a5-cde1-4345-99f1-d5c5249e0e36 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:05.175172 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20df3a5-cde1-4345-99f1-d5c5249e0e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:05.201078 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e20df3a5-cde1-4345-99f1-d5c5249e0e36 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:05.202325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e20df3a5-cde1-4345-99f1-d5c5249e0e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:05.223472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:05.273078 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 32/59] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:05.297739 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dd401-5725-4c86-ad27-7f664c03d6c7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:05.402042 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:05.407319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542dd401-5725-4c86-ad27-7f664c03d6c7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:05.444182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088a093-4d4d-4118-9044-9941e71249fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:05.444995 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088a093-4d4d-4118-9044-9941e71249fe None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:05.445286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088a093-4d4d-4118-9044-9941e71249fe None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:05.445600 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088a093-4d4d-4118-9044-9941e71249fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:05.446859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088a093-4d4d-4118-9044-9941e71249fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:05.448322 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088a093-4d4d-4118-9044-9941e71249fe None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:05.449983 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 28/60] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:05.458134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20df3a5-cde1-4345-99f1-d5c5249e0e36 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:05.559597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20df3a5-cde1-4345-99f1-d5c5249e0e36 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:05.594935 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5ed16-cc19-4b6c-ac8e-9e2fe43eb29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:05.595604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5ed16-cc19-4b6c-ac8e-9e2fe43eb29a None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:05.595891 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5ed16-cc19-4b6c-ac8e-9e2fe43eb29a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:05.596175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5ed16-cc19-4b6c-ac8e-9e2fe43eb29a None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:05.596901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5ed16-cc19-4b6c-ac8e-9e2fe43eb29a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:05.598425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5ed16-cc19-4b6c-ac8e-9e2fe43eb29a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:05.625939 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 33/61] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:21:05 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:21:08.885865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8153c0-e397-4f1d-a0c1-113afc5cd157 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:08.886942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8153c0-e397-4f1d-a0c1-113afc5cd157 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:08.887425 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8153c0-e397-4f1d-a0c1-113afc5cd157 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:08.889025 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 29/62] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:08.894472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed44c-0278-42df-b4f9-997862ea9bff None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:08.894911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed44c-0278-42df-b4f9-997862ea9bff None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:08.895100 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed44c-0278-42df-b4f9-997862ea9bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:08.918369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-093ed44c-0278-42df-b4f9-997862ea9bff None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:08.919594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-093ed44c-0278-42df-b4f9-997862ea9bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:08.927583 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:09.019385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 34/63] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:09.050719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677d6dc-9e8d-45f6-8771-c5d064766677 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:09.051330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677d6dc-9e8d-45f6-8771-c5d064766677 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:09.051801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677d6dc-9e8d-45f6-8771-c5d064766677 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:09.053649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 30/64] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:09.055816 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ed44c-0278-42df-b4f9-997862ea9bff None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:09.059080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14a1f0-bf6d-4b83-a943-b6ed7336602b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:09.059585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14a1f0-bf6d-4b83-a943-b6ed7336602b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:09.060053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14a1f0-bf6d-4b83-a943-b6ed7336602b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:09.078199 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ff14a1f0-bf6d-4b83-a943-b6ed7336602b None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:09.079686 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ff14a1f0-bf6d-4b83-a943-b6ed7336602b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:09.156162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 31/65] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:09.175146 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43b751-1211-4bfc-ae97-5c39e4b2de15 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:09.175446 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43b751-1211-4bfc-ae97-5c39e4b2de15 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:09.175739 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43b751-1211-4bfc-ae97-5c39e4b2de15 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:09.177135 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 32/66] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:21:09.180156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43b751-1211-4bfc-ae97-5c39e4b2de15 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:09.221060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ed44c-0278-42df-b4f9-997862ea9bff None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:09.264713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069a233-5df9-430f-a1b9-6db0bd0e0f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:09.265575 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069a233-5df9-430f-a1b9-6db0bd0e0f1f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:09.265865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069a233-5df9-430f-a1b9-6db0bd0e0f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:09.266147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069a233-5df9-430f-a1b9-6db0bd0e0f1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:09.282546 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069a233-5df9-430f-a1b9-6db0bd0e0f1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:09.290500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-6069a233-5df9-430f-a1b9-6db0bd0e0f1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:09.290500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:09.290500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:09.290500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:09.290500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:09.290500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:09.290500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:09.290500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:09.290500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:09.290500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:09.290500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:09.290500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:09.290500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:09.290500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:09.290500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:09.290500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:09.291377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:09.291377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:09.291377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:09.291377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:09.291377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:09.291377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:09.291377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:09.291377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:09.291377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:09.291377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:09.291377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:09.291377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:09.291377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:09.291377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:09.291377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:09.291377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:09.292592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:09.292592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:09.292592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:09.292592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:09.292592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:09.292592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:09.292592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:09.292592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:09.292592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:09.292592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:09.292592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:09.292592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:09.292592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 35/67] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:09.293469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c78e6-04b6-4c1e-b250-ad0d8198e586 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:09.293469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c78e6-04b6-4c1e-b250-ad0d8198e586 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:09.293608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c78e6-04b6-4c1e-b250-ad0d8198e586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:09.295510 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:09.299079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:09.306895 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43b751-1211-4bfc-ae97-5c39e4b2de15 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:09.314689 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-261c78e6-04b6-4c1e-b250-ad0d8198e586 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:09.315971 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-261c78e6-04b6-4c1e-b250-ad0d8198e586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:09.351074 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461dde6-90a3-46de-b6aa-604f0d20e12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:09.352209 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461dde6-90a3-46de-b6aa-604f0d20e12e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:09.352699 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461dde6-90a3-46de-b6aa-604f0d20e12e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:09.353181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461dde6-90a3-46de-b6aa-604f0d20e12e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:09.367685 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461dde6-90a3-46de-b6aa-604f0d20e12e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b461dde6-90a3-46de-b6aa-604f0d20e12e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:09.379629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:09.379629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:09.379629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:09.379629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:09.379629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:09.379629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:09.379629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:09.379629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:09.379629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:09.379629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:09.379629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:09.379629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:09.379629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:09.379629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:09.379629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:09.379629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:09.380406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:09.380406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:09.380406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:09.380406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:09.380406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:09.380406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:09.380406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:09.380406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:09.380406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:09.380406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:09.380406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:09.380406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:09.383093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 33/68] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:21:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:21:09.383772 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461dde6-90a3-46de-b6aa-604f0d20e12e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:09.399789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 36/69] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:09.401258 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c78e6-04b6-4c1e-b250-ad0d8198e586 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:09.497476 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461dde6-90a3-46de-b6aa-604f0d20e12e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:09.526330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c78e6-04b6-4c1e-b250-ad0d8198e586 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:09.531638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6776a5-dc55-42cd-b25f-9544da4b06c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:09.532310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6776a5-dc55-42cd-b25f-9544da4b06c0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:09.532597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6776a5-dc55-42cd-b25f-9544da4b06c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:09.532876 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6776a5-dc55-42cd-b25f-9544da4b06c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:09.533810 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6776a5-dc55-42cd-b25f-9544da4b06c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:09.534120 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6776a5-dc55-42cd-b25f-9544da4b06c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:09.535503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6776a5-dc55-42cd-b25f-9544da4b06c0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:09.548679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 34/70] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:09.549300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6776a5-dc55-42cd-b25f-9544da4b06c0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:09.567400 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:09.567544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:09.573965 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d29d20-c695-4b48-ba33-14214cb5d6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:09.574663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d29d20-c695-4b48-ba33-14214cb5d6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:09.574952 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d29d20-c695-4b48-ba33-14214cb5d6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:09.575236 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d29d20-c695-4b48-ba33-14214cb5d6a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:09.576170 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d29d20-c695-4b48-ba33-14214cb5d6a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:09.576641 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d29d20-c695-4b48-ba33-14214cb5d6a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:09.578410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d29d20-c695-4b48-ba33-14214cb5d6a6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:09.586841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 37/71] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:09.588105 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4dc77-4ce5-4318-9a22-7adf4eaa6324 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:09.588487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4dc77-4ce5-4318-9a22-7adf4eaa6324 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:09.588800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4dc77-4ce5-4318-9a22-7adf4eaa6324 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:09.593718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 38/72] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:09.593718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c463947-e980-4ea9-9f01-c0234255d015 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:09.593718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c463947-e980-4ea9-9f01-c0234255d015 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:09.593718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c463947-e980-4ea9-9f01-c0234255d015 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:09.593718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 39/73] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:09.593718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c463947-e980-4ea9-9f01-c0234255d015 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:09.650302 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6776a5-dc55-42cd-b25f-9544da4b06c0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:09.683691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5f34a-d494-4347-b7e0-e0215beea488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:09.684561 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5f34a-d494-4347-b7e0-e0215beea488 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:09.684847 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5f34a-d494-4347-b7e0-e0215beea488 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:09.685120 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5f34a-d494-4347-b7e0-e0215beea488 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:09.695617 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5f34a-d494-4347-b7e0-e0215beea488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:09.697887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c463947-e980-4ea9-9f01-c0234255d015 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:09.703805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b7f5f34a-d494-4347-b7e0-e0215beea488 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:09.703805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:09.703805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:09.703805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:09.703805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:09.703805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:09.703805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:09.703805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:09.703805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:09.703805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:09.703805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:09.703805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:09.703805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:09.703805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:09.703805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:09.703805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:09.704689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:09.704689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:09.704689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:09.704689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:09.704689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:09.704689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:09.704689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:09.704689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:09.704689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:09.704689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:09.704689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:09.704689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:09.704689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:09.704689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:09.704689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:09.704689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:09.705774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:09.705774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:09.705774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:09.705774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:09.705774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:09.705774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:09.705774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:09.705774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:09.705774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:09.705774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:09.705774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:09.705774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:09.705774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 35/74] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:21:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:09.705774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5f34a-d494-4347-b7e0-e0215beea488 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:09.736702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9c52f-60d3-4f41-89a6-0d3d82283b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:09.737646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9c52f-60d3-4f41-89a6-0d3d82283b0a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:09.737934 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9c52f-60d3-4f41-89a6-0d3d82283b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:09.738216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9c52f-60d3-4f41-89a6-0d3d82283b0a None admin] PATH_INFO: `/v3/users/f889fd589b2d4d67ac66dc372869f6fa` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:09.752077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9c52f-60d3-4f41-89a6-0d3d82283b0a None admin] RBAC: Authorizing `identity:get_user(user_id=f889fd589b2d4d67ac66dc372869f6fa)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:09.753534 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9c52f-60d3-4f41-89a6-0d3d82283b0a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:09.755362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 40/75] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:09 2022] GET /identity/v3/users/f889fd589b2d4d67ac66dc372869f6fa => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:09.756390 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae27cea-29c8-46bb-bb81-82b483e527eb None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:09.756682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae27cea-29c8-46bb-bb81-82b483e527eb None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:09.756964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae27cea-29c8-46bb-bb81-82b483e527eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:09.772476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1ae27cea-29c8-46bb-bb81-82b483e527eb None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:09.773772 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1ae27cea-29c8-46bb-bb81-82b483e527eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:09.784480 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:09.806216 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5f34a-d494-4347-b7e0-e0215beea488 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:09.819464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:09.841663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 41/76] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:09.841800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24db2a-dd4f-4569-8987-474ce2d689fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:09.843050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ec2ea-accf-4aa7-a31c-b4d959d59db3 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:09.843348 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ec2ea-accf-4aa7-a31c-b4d959d59db3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:09.843629 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ec2ea-accf-4aa7-a31c-b4d959d59db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:09.846318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24db2a-dd4f-4569-8987-474ce2d689fd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:09.846606 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24db2a-dd4f-4569-8987-474ce2d689fd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:09.846887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24db2a-dd4f-4569-8987-474ce2d689fd None admin] PATH_INFO: `/v3/users/d38407cead4d4c429e0e7ef7b966bf82` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:09.848130 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24db2a-dd4f-4569-8987-474ce2d689fd None admin] RBAC: Authorizing `identity:get_user(user_id=d38407cead4d4c429e0e7ef7b966bf82)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:09.849636 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24db2a-dd4f-4569-8987-474ce2d689fd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:09.853480 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 36/77] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:09 2022] GET /identity/v3/users/d38407cead4d4c429e0e7ef7b966bf82 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:09.854607 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24db2a-dd4f-4569-8987-474ce2d689fd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:09.860223 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-fe9ec2ea-accf-4aa7-a31c-b4d959d59db3 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:09.861449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fe9ec2ea-accf-4aa7-a31c-b4d959d59db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:09.927272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 42/78] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:09.928111 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ec2ea-accf-4aa7-a31c-b4d959d59db3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:09.954415 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24db2a-dd4f-4569-8987-474ce2d689fd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:09.986848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b43f02-660b-41b1-8cb0-0dc13ba4feb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:09.987530 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b43f02-660b-41b1-8cb0-0dc13ba4feb6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:09.987819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b43f02-660b-41b1-8cb0-0dc13ba4feb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:09.988105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b43f02-660b-41b1-8cb0-0dc13ba4feb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:09.988858 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b43f02-660b-41b1-8cb0-0dc13ba4feb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:09.989174 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b43f02-660b-41b1-8cb0-0dc13ba4feb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:09.990953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b43f02-660b-41b1-8cb0-0dc13ba4feb6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:09.998793 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 37/79] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:21:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:10.001003 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b43f02-660b-41b1-8cb0-0dc13ba4feb6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:10.013201 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:10.027889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ec2ea-accf-4aa7-a31c-b4d959d59db3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:10.042001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:10.064969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdc8ad-a813-4904-b078-d9fee94bbc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:10.065659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdc8ad-a813-4904-b078-d9fee94bbc42 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:10.065961 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdc8ad-a813-4904-b078-d9fee94bbc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:10.066230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdc8ad-a813-4904-b078-d9fee94bbc42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:10.107837 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b43f02-660b-41b1-8cb0-0dc13ba4feb6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:10.133231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdc8ad-a813-4904-b078-d9fee94bbc42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:10.134798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdc8ad-a813-4904-b078-d9fee94bbc42 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:10.141192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f3354-e2cd-4680-9509-2fe2724b6d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:10.141890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f3354-e2cd-4680-9509-2fe2724b6d81 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:10.142206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f3354-e2cd-4680-9509-2fe2724b6d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:10.142486 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f3354-e2cd-4680-9509-2fe2724b6d81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:10.209545 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f3354-e2cd-4680-9509-2fe2724b6d81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:10.211041 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f3354-e2cd-4680-9509-2fe2724b6d81 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:10.220712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:10.230140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 43/80] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:10.230967 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdc8ad-a813-4904-b078-d9fee94bbc42 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:10.246481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:10.312735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 38/81] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:10.314307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f3354-e2cd-4680-9509-2fe2724b6d81 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:10.328228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdc8ad-a813-4904-b078-d9fee94bbc42 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:10.362572 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666bced-1fbf-4c58-ba14-8e2bca9e71b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:10.363384 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666bced-1fbf-4c58-ba14-8e2bca9e71b1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:10.363671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666bced-1fbf-4c58-ba14-8e2bca9e71b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:10.363954 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666bced-1fbf-4c58-ba14-8e2bca9e71b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:10.365169 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666bced-1fbf-4c58-ba14-8e2bca9e71b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:10.367035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666bced-1fbf-4c58-ba14-8e2bca9e71b1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:10.368690 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 44/82] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:10.369472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666bced-1fbf-4c58-ba14-8e2bca9e71b1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:10.414209 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f3354-e2cd-4680-9509-2fe2724b6d81 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:10.423531 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:10.448485 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a10bc9-9183-4415-bf5f-c97caa56dc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:10.449302 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a10bc9-9183-4415-bf5f-c97caa56dc5a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:10.449690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a10bc9-9183-4415-bf5f-c97caa56dc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:10.449894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a10bc9-9183-4415-bf5f-c97caa56dc5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:10.451385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:10.459956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a10bc9-9183-4415-bf5f-c97caa56dc5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:10.468152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-86a10bc9-9183-4415-bf5f-c97caa56dc5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:10.468152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:10.468152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:10.468152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:10.468152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:10.468152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:10.468152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:10.468152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:10.468152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:10.468152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:10.468152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:10.468152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:10.468152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:10.468152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:10.468152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:10.468152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:10.469189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:10.469189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:10.469189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:10.469189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:10.469189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:10.469189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:10.469189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:10.469189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:10.469189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:10.469189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:10.469189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:10.469189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:10.469189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:10.469189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:10.469189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:10.469189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:10.470047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:10.470047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:10.470047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:10.470047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:10.470047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:10.470047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:10.470047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:10.470047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:10.470047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:10.470047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:10.470047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:10.470047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:10.470047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 39/83] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:10.470690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a10bc9-9183-4415-bf5f-c97caa56dc5a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:10.473204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666bced-1fbf-4c58-ba14-8e2bca9e71b1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:10.507156 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6ef0d-df1e-4ae7-baea-ae4c28c14352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:10.508052 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ef0d-df1e-4ae7-baea-ae4c28c14352 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:10.508723 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ef0d-df1e-4ae7-baea-ae4c28c14352 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:10.509004 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6ef0d-df1e-4ae7-baea-ae4c28c14352 None admin] PATH_INFO: `/v3/users/f889fd589b2d4d67ac66dc372869f6fa` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:10.510586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6ef0d-df1e-4ae7-baea-ae4c28c14352 None admin] RBAC: Authorizing `identity:get_user(user_id=f889fd589b2d4d67ac66dc372869f6fa)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:10.512057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6ef0d-df1e-4ae7-baea-ae4c28c14352 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:10.513920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 45/84] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:10 2022] GET /identity/v3/users/f889fd589b2d4d67ac66dc372869f6fa => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:10.514575 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6ef0d-df1e-4ae7-baea-ae4c28c14352 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:10.570050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a10bc9-9183-4415-bf5f-c97caa56dc5a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:10.604642 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfbc04-4e70-4e08-8ac0-bf85ffbd17ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:10.605557 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfbc04-4e70-4e08-8ac0-bf85ffbd17ee None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:10.605849 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfbc04-4e70-4e08-8ac0-bf85ffbd17ee None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:10.606131 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfbc04-4e70-4e08-8ac0-bf85ffbd17ee None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:10.607330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfbc04-4e70-4e08-8ac0-bf85ffbd17ee None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:10.608810 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfbc04-4e70-4e08-8ac0-bf85ffbd17ee None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:10.610574 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 40/85] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:10 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:10.611319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfbc04-4e70-4e08-8ac0-bf85ffbd17ee None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:10.619740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6ef0d-df1e-4ae7-baea-ae4c28c14352 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:10.645540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:10.654142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf18e7-0fa6-49b9-91a3-916abcd98560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:10.655021 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf18e7-0fa6-49b9-91a3-916abcd98560 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:10.655303 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf18e7-0fa6-49b9-91a3-916abcd98560 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:10.655576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf18e7-0fa6-49b9-91a3-916abcd98560 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:10.656771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf18e7-0fa6-49b9-91a3-916abcd98560 None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:10.658273 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf18e7-0fa6-49b9-91a3-916abcd98560 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:10.664979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 46/86] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:10 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:10.664979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf18e7-0fa6-49b9-91a3-916abcd98560 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:10.678079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:10.710217 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfbc04-4e70-4e08-8ac0-bf85ffbd17ee None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:10.745358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60132f53-28fc-4045-b9fd-fb86ccc35d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:10.746080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60132f53-28fc-4045-b9fd-fb86ccc35d81 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:10.746331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60132f53-28fc-4045-b9fd-fb86ccc35d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:10.746599 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60132f53-28fc-4045-b9fd-fb86ccc35d81 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:10.747376 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60132f53-28fc-4045-b9fd-fb86ccc35d81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:10.748838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60132f53-28fc-4045-b9fd-fb86ccc35d81 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:10.762388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf18e7-0fa6-49b9-91a3-916abcd98560 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:10.775831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 41/87] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:21:10 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:21:10.776685 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60132f53-28fc-4045-b9fd-fb86ccc35d81 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:10.798572 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a657e33-1571-4a05-8328-17f9462e7172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:10.799568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a657e33-1571-4a05-8328-17f9462e7172 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:10.799851 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a657e33-1571-4a05-8328-17f9462e7172 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:10.800139 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a657e33-1571-4a05-8328-17f9462e7172 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:10.800940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a657e33-1571-4a05-8328-17f9462e7172 None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:10.801259 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a657e33-1571-4a05-8328-17f9462e7172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:10.802768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a657e33-1571-4a05-8328-17f9462e7172 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:10.816901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 47/88] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:10.816901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a657e33-1571-4a05-8328-17f9462e7172 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:10.895819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:10.905913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:10.907469 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60132f53-28fc-4045-b9fd-fb86ccc35d81 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:10.934916 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a657e33-1571-4a05-8328-17f9462e7172 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:10.948625 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7b97c-bdc6-431a-93d6-6704ed964cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:10.949293 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7b97c-bdc6-431a-93d6-6704ed964cbd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:10.949613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7b97c-bdc6-431a-93d6-6704ed964cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:10.949903 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7b97c-bdc6-431a-93d6-6704ed964cbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:10.976361 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc034ba0-4af5-4127-a4ce-a085296a03f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:10.977040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc034ba0-4af5-4127-a4ce-a085296a03f9 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:10.977328 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc034ba0-4af5-4127-a4ce-a085296a03f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:10.977659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc034ba0-4af5-4127-a4ce-a085296a03f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:10.978566 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc034ba0-4af5-4127-a4ce-a085296a03f9 None admin] RBAC: Adding query filter params (role.id=5dd696285c0b41d3acb854981774eaae, scope.project.id=a82bf7161bd44f5e83eae52981f952ab, user.id=f889fd589b2d4d67ac66dc372869f6fa) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:10.980619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc034ba0-4af5-4127-a4ce-a085296a03f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:10.980619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc034ba0-4af5-4127-a4ce-a085296a03f9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:10.986586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 48/89] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:10 2022] GET /identity/v3/role_assignments?user.id=f889fd589b2d4d67ac66dc372869f6fa&scope.project.id=a82bf7161bd44f5e83eae52981f952ab&role.id=5dd696285c0b41d3acb854981774eaae => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:10.986852 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc034ba0-4af5-4127-a4ce-a085296a03f9 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:11.044970 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7b97c-bdc6-431a-93d6-6704ed964cbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:11.046555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7b97c-bdc6-431a-93d6-6704ed964cbd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:11.112291 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc034ba0-4af5-4127-a4ce-a085296a03f9 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:11.156463 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cd168-edd3-4c68-82ee-dec4c5a51ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:11.157067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cd168-edd3-4c68-82ee-dec4c5a51ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:11.157376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cd168-edd3-4c68-82ee-dec4c5a51ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:11.157689 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cd168-edd3-4c68-82ee-dec4c5a51ea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:11.158543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cd168-edd3-4c68-82ee-dec4c5a51ea0 None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=a82bf7161bd44f5e83eae52981f952ab, user.id=d38407cead4d4c429e0e7ef7b966bf82) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:11.158861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cd168-edd3-4c68-82ee-dec4c5a51ea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:11.160345 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cd168-edd3-4c68-82ee-dec4c5a51ea0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:11.167548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 49/90] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:10 2022] GET /identity/v3/role_assignments?user.id=d38407cead4d4c429e0e7ef7b966bf82&scope.project.id=a82bf7161bd44f5e83eae52981f952ab&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:11.168413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cd168-edd3-4c68-82ee-dec4c5a51ea0 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:11.176520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:11.181855 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:11.194079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 42/91] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:11.201317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7b97c-bdc6-431a-93d6-6704ed964cbd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:11.300101 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cd168-edd3-4c68-82ee-dec4c5a51ea0 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:11.346251 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e52ce7-a6c6-41f2-bedb-fccad5fdcd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:11.347766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e52ce7-a6c6-41f2-bedb-fccad5fdcd90 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:11.348473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e52ce7-a6c6-41f2-bedb-fccad5fdcd90 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:11.348900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e52ce7-a6c6-41f2-bedb-fccad5fdcd90 None admin] PATH_INFO: `/v3/users/f889fd589b2d4d67ac66dc372869f6fa` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:11.350978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e52ce7-a6c6-41f2-bedb-fccad5fdcd90 None admin] RBAC: Authorizing `identity:get_user(user_id=f889fd589b2d4d67ac66dc372869f6fa)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:11.352986 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e52ce7-a6c6-41f2-bedb-fccad5fdcd90 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:11.354988 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 50/92] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:11 2022] GET /identity/v3/users/f889fd589b2d4d67ac66dc372869f6fa => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:11.361765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e52ce7-a6c6-41f2-bedb-fccad5fdcd90 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:11.445295 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7b97c-bdc6-431a-93d6-6704ed964cbd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:11.478843 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:11.512474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e52ce7-a6c6-41f2-bedb-fccad5fdcd90 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:11.527092 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0154d9-1bce-4ac9-933d-48435ab135a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:11.528116 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0154d9-1bce-4ac9-933d-48435ab135a5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:11.528498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0154d9-1bce-4ac9-933d-48435ab135a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:11.528843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0154d9-1bce-4ac9-933d-48435ab135a5 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:11.533707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0154d9-1bce-4ac9-933d-48435ab135a5 None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:11.537374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0154d9-1bce-4ac9-933d-48435ab135a5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:11.537374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 43/93] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:11 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:11.544303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0154d9-1bce-4ac9-933d-48435ab135a5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:11.575140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a63d0c-e4c5-4901-8588-294827ad7890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:11.576442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a63d0c-e4c5-4901-8588-294827ad7890 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:11.576931 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a63d0c-e4c5-4901-8588-294827ad7890 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:11.577942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a63d0c-e4c5-4901-8588-294827ad7890 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:11.665631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:11.677467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a63d0c-e4c5-4901-8588-294827ad7890 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:11.679121 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a63d0c-e4c5-4901-8588-294827ad7890 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:11.725218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0154d9-1bce-4ac9-933d-48435ab135a5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:11.765851 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200320f-9fe5-435e-a355-f359aeb43c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:11.766865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200320f-9fe5-435e-a355-f359aeb43c68 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:11.767373 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200320f-9fe5-435e-a355-f359aeb43c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:11.767873 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200320f-9fe5-435e-a355-f359aeb43c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:11.769454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200320f-9fe5-435e-a355-f359aeb43c68 None admin] RBAC: Adding query filter params (role.id=1be1544572744e849ed04df01cdca3fb, scope.project.id=a82bf7161bd44f5e83eae52981f952ab, user.id=f889fd589b2d4d67ac66dc372869f6fa) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:11.769969 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200320f-9fe5-435e-a355-f359aeb43c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:11.771588 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200320f-9fe5-435e-a355-f359aeb43c68 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:11.781105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 44/94] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:11 2022] GET /identity/v3/role_assignments?user.id=f889fd589b2d4d67ac66dc372869f6fa&scope.project.id=a82bf7161bd44f5e83eae52981f952ab&role.id=1be1544572744e849ed04df01cdca3fb => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:11.842495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:11.879597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 51/95] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 00:21:11.885487 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200320f-9fe5-435e-a355-f359aeb43c68 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:12.014510 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200320f-9fe5-435e-a355-f359aeb43c68 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:12.045251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:12.058208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5def1f-a2ac-48a3-b131-a6a107509578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:12.059461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5def1f-a2ac-48a3-b131-a6a107509578 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:12.059949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5def1f-a2ac-48a3-b131-a6a107509578 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:12.060468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5def1f-a2ac-48a3-b131-a6a107509578 None admin] PATH_INFO: `/v3/projects/5824bb076cd9453c9f19e70b2601ad18` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:12.062056 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5def1f-a2ac-48a3-b131-a6a107509578 None admin] RBAC: Authorizing `identity:get_project(project_id=5824bb076cd9453c9f19e70b2601ad18)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:12.063825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5def1f-a2ac-48a3-b131-a6a107509578 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:12.065921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 45/96] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:11 2022] GET /identity/v3/projects/5824bb076cd9453c9f19e70b2601ad18 => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:12.077642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a63d0c-e4c5-4901-8588-294827ad7890 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:12.223148 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a63d0c-e4c5-4901-8588-294827ad7890 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:12.273455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc9ad9-51a8-4b53-97f1-fe7807b10341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:12.274057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc9ad9-51a8-4b53-97f1-fe7807b10341 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:12.274350 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc9ad9-51a8-4b53-97f1-fe7807b10341 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:12.274638 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc9ad9-51a8-4b53-97f1-fe7807b10341 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:12.275624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc9ad9-51a8-4b53-97f1-fe7807b10341 None admin] RBAC: Adding query filter params (role.id=5dd696285c0b41d3acb854981774eaae, scope.project.id=5824bb076cd9453c9f19e70b2601ad18, user.id=f889fd589b2d4d67ac66dc372869f6fa) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:12.275948 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc9ad9-51a8-4b53-97f1-fe7807b10341 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:12.277451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bc9ad9-51a8-4b53-97f1-fe7807b10341 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:12.289591 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 52/97] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:12 2022] GET /identity/v3/role_assignments?user.id=f889fd589b2d4d67ac66dc372869f6fa&scope.project.id=5824bb076cd9453c9f19e70b2601ad18&role.id=5dd696285c0b41d3acb854981774eaae => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:13.709081 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec06b7c-6d24-4d3f-95f4-dfa9579f63a7 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:13.710146 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec06b7c-6d24-4d3f-95f4-dfa9579f63a7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:13.710631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec06b7c-6d24-4d3f-95f4-dfa9579f63a7 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:13.712316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 46/98] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:13.731185 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4776e2-3ac3-4249-bc71-f4634f0df274 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:13.731769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4776e2-3ac3-4249-bc71-f4634f0df274 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:13.732300 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4776e2-3ac3-4249-bc71-f4634f0df274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:13.757599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8a4776e2-3ac3-4249-bc71-f4634f0df274 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:13.758845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8a4776e2-3ac3-4249-bc71-f4634f0df274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:13.799502 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:13.847567 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 53/99] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:13.890586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec06b7c-6d24-4d3f-95f4-dfa9579f63a7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:14.042022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec06b7c-6d24-4d3f-95f4-dfa9579f63a7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:14.095760 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279b3cf-757e-4acd-89c9-42ee66fa70b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:14.096676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279b3cf-757e-4acd-89c9-42ee66fa70b9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:14.097087 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279b3cf-757e-4acd-89c9-42ee66fa70b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:14.097626 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279b3cf-757e-4acd-89c9-42ee66fa70b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:14.124122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279b3cf-757e-4acd-89c9-42ee66fa70b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:14.132267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-8279b3cf-757e-4acd-89c9-42ee66fa70b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:14.132267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:14.132267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:14.132267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:14.132267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:14.132267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:14.132267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:14.132267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:14.132267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:14.132267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:14.132267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:14.132267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:14.132267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:14.132267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:14.132267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:14.132267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:14.133128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:14.133128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:14.133128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:14.133128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:14.133128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:14.133128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:14.133128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:14.133128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:14.133128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:14.133128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:14.133128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:14.133128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:14.133128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:14.133128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:14.133128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:14.133128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:14.134037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:14.134037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:14.134037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:14.134037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:14.134037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:14.134037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:14.134037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:14.134037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:14.134037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:14.134037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:14.134037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:14.134037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:14.134037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 47/100] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:14.140074 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4776e2-3ac3-4249-bc71-f4634f0df274 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:14.311282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4776e2-3ac3-4249-bc71-f4634f0df274 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:14.334884 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7be4b9-32bc-44e8-a63e-01da1798b2fc None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:14.335792 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7be4b9-32bc-44e8-a63e-01da1798b2fc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:14.336084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7be4b9-32bc-44e8-a63e-01da1798b2fc None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:14.337666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 48/101] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:21:14.343431 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b447e-a91e-48e5-9977-bb8f81c5cfac None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:14.343717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b447e-a91e-48e5-9977-bb8f81c5cfac None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:14.343998 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b447e-a91e-48e5-9977-bb8f81c5cfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:14.360603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891086-f0b7-402d-b5c8-e6636fe581d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:14.361315 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891086-f0b7-402d-b5c8-e6636fe581d7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:14.361631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891086-f0b7-402d-b5c8-e6636fe581d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:14.361920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb891086-f0b7-402d-b5c8-e6636fe581d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:14.362701 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb891086-f0b7-402d-b5c8-e6636fe581d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:14.363026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb891086-f0b7-402d-b5c8-e6636fe581d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:14.364448 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb891086-f0b7-402d-b5c8-e6636fe581d7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:14.364591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-af7b447e-a91e-48e5-9977-bb8f81c5cfac None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:14.366242 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-af7b447e-a91e-48e5-9977-bb8f81c5cfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:14.381236 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 54/102] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:14.387359 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891086-f0b7-402d-b5c8-e6636fe581d7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:14.453681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:14.458761 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:14.498529 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 49/103] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:14.501174 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6902df3-c9d5-480a-9d09-af80d204aff0 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:14.501861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6902df3-c9d5-480a-9d09-af80d204aff0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:14.503529 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6902df3-c9d5-480a-9d09-af80d204aff0 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:14.505627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 50/104] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:14.511303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bdc7b-0784-4466-a1ec-89989c02d2d3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:14.511931 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bdc7b-0784-4466-a1ec-89989c02d2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:14.512561 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bdc7b-0784-4466-a1ec-89989c02d2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:14.530051 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d34bdc7b-0784-4466-a1ec-89989c02d2d3 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:14.531593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d34bdc7b-0784-4466-a1ec-89989c02d2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:14.604732 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 51/105] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:14.605917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bdc7b-0784-4466-a1ec-89989c02d2d3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:14.617445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb891086-f0b7-402d-b5c8-e6636fe581d7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:14.685584 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d29f48-08af-4dee-baa3-5bffa436cb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:14.686899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d29f48-08af-4dee-baa3-5bffa436cb39 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:14.687616 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d29f48-08af-4dee-baa3-5bffa436cb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:14.689105 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d29f48-08af-4dee-baa3-5bffa436cb39 None admin] PATH_INFO: `/v3/users/f889fd589b2d4d67ac66dc372869f6fa` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:14.693797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d29f48-08af-4dee-baa3-5bffa436cb39 None admin] RBAC: Authorizing `identity:get_user(user_id=f889fd589b2d4d67ac66dc372869f6fa)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:14.695590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d29f48-08af-4dee-baa3-5bffa436cb39 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:14.699141 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 55/106] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:14 2022] GET /identity/v3/users/f889fd589b2d4d67ac66dc372869f6fa => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:14.700412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d29f48-08af-4dee-baa3-5bffa436cb39 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:14.784484 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bdc7b-0784-4466-a1ec-89989c02d2d3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:14.800771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:14.823703 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4c00a-9ef0-4f5b-8725-ccf773e0bf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:14.824943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4c00a-9ef0-4f5b-8725-ccf773e0bf9f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:14.825243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4c00a-9ef0-4f5b-8725-ccf773e0bf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:14.825560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4c00a-9ef0-4f5b-8725-ccf773e0bf9f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:14.837576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4c00a-9ef0-4f5b-8725-ccf773e0bf9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:14.845441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-fcc4c00a-9ef0-4f5b-8725-ccf773e0bf9f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:14.845441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:14.845441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:14.845441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:14.845441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:14.845441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:14.845441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:14.845441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:14.845441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:14.845441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:14.845441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:14.845441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:14.845441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:14.845441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:14.845441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:14.845441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:14.846372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:14.846372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:14.846372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:14.846372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:14.846372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:14.846372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:14.846372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:14.846372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:14.846372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:14.846372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:14.846372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:14.846372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:14.846372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:14.846372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:14.846372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:14.846372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:14.847495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:14.847495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:14.847495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:14.847495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:14.847495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:14.847495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:14.847495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:14.847495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:14.847495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:14.847495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:14.847495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:14.847495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:14.848288 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:14.848698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 52/107] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:14.848698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4c00a-9ef0-4f5b-8725-ccf773e0bf9f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:14.855734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d29f48-08af-4dee-baa3-5bffa436cb39 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:14.893064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c4236-c0ea-481e-8308-b44b8327b61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:14.893956 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c4236-c0ea-481e-8308-b44b8327b61e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:14.894247 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c4236-c0ea-481e-8308-b44b8327b61e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:14.894526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c4236-c0ea-481e-8308-b44b8327b61e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:14.905202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c4236-c0ea-481e-8308-b44b8327b61e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:14.912900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-2c8c4236-c0ea-481e-8308-b44b8327b61e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:14.912900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:14.912900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:14.912900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:14.912900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:14.912900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:14.912900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:14.912900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:14.912900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:14.912900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:14.912900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:14.912900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:14.912900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:14.912900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:14.912900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:14.912900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:14.914040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:14.914040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:14.914040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:14.914040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:14.914040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:14.914040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:14.914040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:14.914040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:14.914040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:14.914040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:14.914040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:14.914040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:14.914040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:14.914040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:14.914040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:14.914040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:14.914841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:14.914841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:14.914841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:14.914841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:14.914841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:14.914841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:14.914841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:14.914841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:14.914841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:14.914841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:14.914841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:14.914841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:14.914841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 56/108] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:21:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:14.915630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c1b27-dc8d-4072-b9ad-00e201a96c76 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:14.916273 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c1b27-dc8d-4072-b9ad-00e201a96c76 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:14.916273 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c1b27-dc8d-4072-b9ad-00e201a96c76 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:14.917819 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 57/109] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:14.922814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a263871-352a-4457-a57a-8948893154d3 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:14.923115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a263871-352a-4457-a57a-8948893154d3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:14.923599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a263871-352a-4457-a57a-8948893154d3 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:14.925249 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 58/110] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:14.926001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a263871-352a-4457-a57a-8948893154d3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:14.969513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4c00a-9ef0-4f5b-8725-ccf773e0bf9f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:15.005529 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f481a-c288-4583-96bf-cc5cf56644e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:15.006425 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f481a-c288-4583-96bf-cc5cf56644e3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:15.006713 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f481a-c288-4583-96bf-cc5cf56644e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:15.007273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f481a-c288-4583-96bf-cc5cf56644e3 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:15.008195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f481a-c288-4583-96bf-cc5cf56644e3 None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:15.009789 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f481a-c288-4583-96bf-cc5cf56644e3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:15.016057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 53/111] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:14 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:15.016057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f481a-c288-4583-96bf-cc5cf56644e3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:15.039507 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a263871-352a-4457-a57a-8948893154d3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:15.056471 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:15.082128 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd2f48-fe5a-4afe-8b45-a17599cafe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:15.082826 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd2f48-fe5a-4afe-8b45-a17599cafe13 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:15.083122 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd2f48-fe5a-4afe-8b45-a17599cafe13 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:15.083411 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd2f48-fe5a-4afe-8b45-a17599cafe13 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:15.084191 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd2f48-fe5a-4afe-8b45-a17599cafe13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:15.084531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd2f48-fe5a-4afe-8b45-a17599cafe13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:15.086088 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd2f48-fe5a-4afe-8b45-a17599cafe13 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:15.095587 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 59/112] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:15.098821 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6c5f1-48df-431d-ab65-6f2e912fdbb2 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:15.099226 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6c5f1-48df-431d-ab65-6f2e912fdbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:15.099673 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6c5f1-48df-431d-ab65-6f2e912fdbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:15.117444 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-78c6c5f1-48df-431d-ab65-6f2e912fdbb2 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:15.118659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-78c6c5f1-48df-431d-ab65-6f2e912fdbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:15.128962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f481a-c288-4583-96bf-cc5cf56644e3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:15.134291 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:15.163631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fa3ef-a378-49bd-a6d0-47d64ab550e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:15.164325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fa3ef-a378-49bd-a6d0-47d64ab550e7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:15.164621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fa3ef-a378-49bd-a6d0-47d64ab550e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:15.164884 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fa3ef-a378-49bd-a6d0-47d64ab550e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:15.165716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fa3ef-a378-49bd-a6d0-47d64ab550e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:15.166056 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fa3ef-a378-49bd-a6d0-47d64ab550e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:15.167480 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fa3ef-a378-49bd-a6d0-47d64ab550e7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:15.176726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 54/113] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:15.178349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdc911-7791-4725-b3a9-6235f5c5c60c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:15.178859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdc911-7791-4725-b3a9-6235f5c5c60c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:15.179434 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdc911-7791-4725-b3a9-6235f5c5c60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:15.191822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 60/114] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:15.192556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6c5f1-48df-431d-ab65-6f2e912fdbb2 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:15.205586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-26fdc911-7791-4725-b3a9-6235f5c5c60c None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:15.207145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-26fdc911-7791-4725-b3a9-6235f5c5c60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:15.280248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 55/115] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:15.281475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdc911-7791-4725-b3a9-6235f5c5c60c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:15.316819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:15.317217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6c5f1-48df-431d-ab65-6f2e912fdbb2 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:15.351071 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bf5f9-1de0-417a-a6ad-e8d9a597d012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:15.351988 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bf5f9-1de0-417a-a6ad-e8d9a597d012 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:15.352280 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bf5f9-1de0-417a-a6ad-e8d9a597d012 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:15.352562 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bf5f9-1de0-417a-a6ad-e8d9a597d012 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab/users/f889fd589b2d4d67ac66dc372869f6fa/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:15.354562 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bf5f9-1de0-417a-a6ad-e8d9a597d012 None admin] RBAC: Authorizing `identity:create_grant(project_id=a82bf7161bd44f5e83eae52981f952ab, user_id=f889fd589b2d4d67ac66dc372869f6fa, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:15.356026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bf5f9-1de0-417a-a6ad-e8d9a597d012 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:15.381475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 61/116] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:21:15 2022] PUT /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab/users/f889fd589b2d4d67ac66dc372869f6fa/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:15.381475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bf5f9-1de0-417a-a6ad-e8d9a597d012 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:15.403757 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdc911-7791-4725-b3a9-6235f5c5c60c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:15.404423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:15.457686 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d4bd9-7b77-4f6a-b23c-7d010a0e3776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:15.458718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d4bd9-7b77-4f6a-b23c-7d010a0e3776 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:15.459007 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d4bd9-7b77-4f6a-b23c-7d010a0e3776 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:15.459283 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d4bd9-7b77-4f6a-b23c-7d010a0e3776 None admin] PATH_INFO: `/v3/users/e672113ca42f487688a9f65953e86c80` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:15.482160 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d4bd9-7b77-4f6a-b23c-7d010a0e3776 None admin] RBAC: Authorizing `identity:get_user(user_id=e672113ca42f487688a9f65953e86c80)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:15.484457 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d4bd9-7b77-4f6a-b23c-7d010a0e3776 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:15.491922 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 56/117] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:15 2022] GET /identity/v3/users/e672113ca42f487688a9f65953e86c80 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:15.491922 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d4bd9-7b77-4f6a-b23c-7d010a0e3776 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:15.509592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bf5f9-1de0-417a-a6ad-e8d9a597d012 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:15.551192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601f927-45e1-4bf7-b204-e03e546a5bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:15.551691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601f927-45e1-4bf7-b204-e03e546a5bfd None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:15.552649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601f927-45e1-4bf7-b204-e03e546a5bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:15.552649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601f927-45e1-4bf7-b204-e03e546a5bfd None admin] PATH_INFO: `/v3/users/d38407cead4d4c429e0e7ef7b966bf82` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:15.553681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601f927-45e1-4bf7-b204-e03e546a5bfd None admin] RBAC: Authorizing `identity:get_user(user_id=d38407cead4d4c429e0e7ef7b966bf82)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:15.555113 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601f927-45e1-4bf7-b204-e03e546a5bfd None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:15.556847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 62/118] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:15 2022] GET /identity/v3/users/d38407cead4d4c429e0e7ef7b966bf82 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:15.557755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601f927-45e1-4bf7-b204-e03e546a5bfd None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:15.601990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:15.612904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d4bd9-7b77-4f6a-b23c-7d010a0e3776 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:15.640066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:15.654888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d302c1f-4e85-4cb9-9dba-8235e6b8d42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:15.655810 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d302c1f-4e85-4cb9-9dba-8235e6b8d42d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:15.656093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d302c1f-4e85-4cb9-9dba-8235e6b8d42d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:15.656368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d302c1f-4e85-4cb9-9dba-8235e6b8d42d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:15.664654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601f927-45e1-4bf7-b204-e03e546a5bfd None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:15.668434 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d302c1f-4e85-4cb9-9dba-8235e6b8d42d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:15.677317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5d302c1f-4e85-4cb9-9dba-8235e6b8d42d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:15.677317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:15.677317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:15.677317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:15.677317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:15.677317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:15.677317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:15.677317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:15.677317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:15.677317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:15.677317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:15.677317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:15.677317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:15.677317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:15.677317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:15.677317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:15.678230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:15.678230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:15.678230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:15.678230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:15.678230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:15.678230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:15.678230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:15.678230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:15.678230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:15.678230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:15.678230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:15.678230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:15.678230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:15.678230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:15.678230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:15.678230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:15.684491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:15.684491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:15.684491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:15.684491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:15.684491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:15.684491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:15.684491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:15.684491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:15.684491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:15.684491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:15.684491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:15.684491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:15.684491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 57/119] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:21:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:15.684491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbad397-2c86-4f2d-af5e-b59c1f546415 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:15.685194 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbad397-2c86-4f2d-af5e-b59c1f546415 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:15.685194 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbad397-2c86-4f2d-af5e-b59c1f546415 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:15.685194 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 58/120] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:15.685194 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbad397-2c86-4f2d-af5e-b59c1f546415 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:15.708762 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5e5a8-8be7-4800-a5e5-3b166a4ecdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:15.709717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5e5a8-8be7-4800-a5e5-3b166a4ecdf2 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:15.710006 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5e5a8-8be7-4800-a5e5-3b166a4ecdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:15.710324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5e5a8-8be7-4800-a5e5-3b166a4ecdf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:15.711529 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5e5a8-8be7-4800-a5e5-3b166a4ecdf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:15.713073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5e5a8-8be7-4800-a5e5-3b166a4ecdf2 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:15.714835 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 63/121] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:15.720147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5e5a8-8be7-4800-a5e5-3b166a4ecdf2 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:15.789443 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbad397-2c86-4f2d-af5e-b59c1f546415 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:15.824970 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6a98c-d935-45ae-bec3-e624aae39ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:15.825667 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6a98c-d935-45ae-bec3-e624aae39ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:15.825963 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6a98c-d935-45ae-bec3-e624aae39ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:15.826250 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6a98c-d935-45ae-bec3-e624aae39ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:15.826598 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5e5a8-8be7-4800-a5e5-3b166a4ecdf2 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:15.847253 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:15.864824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72978b-1222-4410-8437-cbe1438e81bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:15.866178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72978b-1222-4410-8437-cbe1438e81bc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:15.866531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72978b-1222-4410-8437-cbe1438e81bc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:15.866874 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72978b-1222-4410-8437-cbe1438e81bc None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:15.868128 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72978b-1222-4410-8437-cbe1438e81bc None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:15.869862 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72978b-1222-4410-8437-cbe1438e81bc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:15.871817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 64/122] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:15 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:15.877094 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72978b-1222-4410-8437-cbe1438e81bc None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:15.893608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:15.900919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6a98c-d935-45ae-bec3-e624aae39ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:15.902481 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6a98c-d935-45ae-bec3-e624aae39ff6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:15.980341 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72978b-1222-4410-8437-cbe1438e81bc None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:16.009826 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 59/123] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:16.009826 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd3f1-cd70-4de0-a9fd-3d1ff210f207 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:16.009826 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd3f1-cd70-4de0-a9fd-3d1ff210f207 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:16.009826 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd3f1-cd70-4de0-a9fd-3d1ff210f207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:16.019358 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdc66b-2d3e-4726-aefa-c9b19d402e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:16.020056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdc66b-2d3e-4726-aefa-c9b19d402e40 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:16.020349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdc66b-2d3e-4726-aefa-c9b19d402e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:16.020632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdc66b-2d3e-4726-aefa-c9b19d402e40 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:16.021435 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdc66b-2d3e-4726-aefa-c9b19d402e40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:16.021756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdc66b-2d3e-4726-aefa-c9b19d402e40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:16.023216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdc66b-2d3e-4726-aefa-c9b19d402e40 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:16.023921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-188dd3f1-cd70-4de0-a9fd-3d1ff210f207 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:16.025212 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-188dd3f1-cd70-4de0-a9fd-3d1ff210f207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:16.036121 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 65/124] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:21:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:16.036121 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdc66b-2d3e-4726-aefa-c9b19d402e40 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:16.081630 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:16.105165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 60/125] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:16.113541 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dd3f1-cd70-4de0-a9fd-3d1ff210f207 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:16.135336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:16.159585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdc66b-2d3e-4726-aefa-c9b19d402e40 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:16.196045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ca410-f7b7-42a0-8312-bde9686ed42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:16.196772 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ca410-f7b7-42a0-8312-bde9686ed42c None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:16.197090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ca410-f7b7-42a0-8312-bde9686ed42c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:16.197364 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ca410-f7b7-42a0-8312-bde9686ed42c None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:16.198087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ca410-f7b7-42a0-8312-bde9686ed42c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:16.199582 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ca410-f7b7-42a0-8312-bde9686ed42c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:16.221591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dd3f1-cd70-4de0-a9fd-3d1ff210f207 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:16.225640 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 66/126] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 15 00:21:16 2022] POST /identity/v3/projects => generated 302 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:21:16.226610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ca410-f7b7-42a0-8312-bde9686ed42c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:16.260440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff386d-cd69-44c0-bbff-be398bd57171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:16.261613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff386d-cd69-44c0-bbff-be398bd57171 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:16.261776 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff386d-cd69-44c0-bbff-be398bd57171 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:16.262079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff386d-cd69-44c0-bbff-be398bd57171 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab/users/d38407cead4d4c429e0e7ef7b966bf82/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:16.264330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff386d-cd69-44c0-bbff-be398bd57171 None admin] RBAC: Authorizing `identity:create_grant(project_id=a82bf7161bd44f5e83eae52981f952ab, user_id=d38407cead4d4c429e0e7ef7b966bf82, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:16.266045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff386d-cd69-44c0-bbff-be398bd57171 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:16.287930 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 61/127] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:21:16 2022] PUT /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab/users/d38407cead4d4c429e0e7ef7b966bf82/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:16.288906 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff386d-cd69-44c0-bbff-be398bd57171 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:16.341435 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:16.383080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ca410-f7b7-42a0-8312-bde9686ed42c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:16.420751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:16.431358 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e3f3b-9e37-4233-9878-28e26d21a8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:16.432615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e3f3b-9e37-4233-9878-28e26d21a8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:16.434248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e3f3b-9e37-4233-9878-28e26d21a8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:16.434699 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e3f3b-9e37-4233-9878-28e26d21a8b3 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:16.437160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e3f3b-9e37-4233-9878-28e26d21a8b3 None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:16.440455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e3f3b-9e37-4233-9878-28e26d21a8b3 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:16.443996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 67/128] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:16 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:16.450407 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e3f3b-9e37-4233-9878-28e26d21a8b3 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:16.494137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff386d-cd69-44c0-bbff-be398bd57171 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:16.559503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4ed02-cee0-483a-95cf-b6ec40669995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:16.560561 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4ed02-cee0-483a-95cf-b6ec40669995 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:16.560740 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4ed02-cee0-483a-95cf-b6ec40669995 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:16.560979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4ed02-cee0-483a-95cf-b6ec40669995 None admin] PATH_INFO: `/v3/users/f889fd589b2d4d67ac66dc372869f6fa` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:16.562261 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4ed02-cee0-483a-95cf-b6ec40669995 None admin] RBAC: Authorizing `identity:get_user(user_id=f889fd589b2d4d67ac66dc372869f6fa)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:16.563754 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4ed02-cee0-483a-95cf-b6ec40669995 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:16.565747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 62/129] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:16 2022] GET /identity/v3/users/f889fd589b2d4d67ac66dc372869f6fa => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:16.566418 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4ed02-cee0-483a-95cf-b6ec40669995 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:16.607043 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e3f3b-9e37-4233-9878-28e26d21a8b3 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:16.659082 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f99e62-d2c8-4930-88a8-3af661a2e5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:16.660811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f99e62-d2c8-4930-88a8-3af661a2e5ee None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:16.661460 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f99e62-d2c8-4930-88a8-3af661a2e5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:16.662978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f99e62-d2c8-4930-88a8-3af661a2e5ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:16.685415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f99e62-d2c8-4930-88a8-3af661a2e5ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:16.697092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a5f99e62-d2c8-4930-88a8-3af661a2e5ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:16.697092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:16.697092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:16.697092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:16.697092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:16.697092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:16.697092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:16.697092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:16.697092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:16.697092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:16.697092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:16.697092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:16.697092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:16.697092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:16.697092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:16.697092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:16.698003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:16.698003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:16.698003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:16.698003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:16.698003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:16.698003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:16.698003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:16.698003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:16.698003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:16.698003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:16.698003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:16.698003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:16.698003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:16.698003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:16.698003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:16.698003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:16.698780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:16.698780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:16.698780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:16.698780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:16.698780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:16.698780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:16.698780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:16.698780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:16.698780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:16.698780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:16.698780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:16.698780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:16.703925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 68/130] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:16.705123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f99e62-d2c8-4930-88a8-3af661a2e5ee None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:16.732532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4ed02-cee0-483a-95cf-b6ec40669995 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:16.751196 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:16.782152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:16.787264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a24e8-adee-46f4-92ce-c3ca08437b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:16.787944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a24e8-adee-46f4-92ce-c3ca08437b28 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:16.788236 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a24e8-adee-46f4-92ce-c3ca08437b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:16.788514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a24e8-adee-46f4-92ce-c3ca08437b28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:16.789376 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a24e8-adee-46f4-92ce-c3ca08437b28 None admin] RBAC: Adding query filter params (role.id=52f18795c489403f89e3036b0cdd3dd8, scope.project.id=a82bf7161bd44f5e83eae52981f952ab, user.id=e672113ca42f487688a9f65953e86c80) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:16.789694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a24e8-adee-46f4-92ce-c3ca08437b28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:16.791175 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a24e8-adee-46f4-92ce-c3ca08437b28 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:16.808816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 63/131] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:16 2022] GET /identity/v3/role_assignments?user.id=e672113ca42f487688a9f65953e86c80&scope.project.id=a82bf7161bd44f5e83eae52981f952ab&role.id=52f18795c489403f89e3036b0cdd3dd8 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:16.809001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a24e8-adee-46f4-92ce-c3ca08437b28 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:16.886481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f99e62-d2c8-4930-88a8-3af661a2e5ee None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:16.960951 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1cc5e-c510-430d-8e87-5b710431cb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:16.961915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1cc5e-c510-430d-8e87-5b710431cb73 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:16.962225 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1cc5e-c510-430d-8e87-5b710431cb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:16.962511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1cc5e-c510-430d-8e87-5b710431cb73 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:16.963852 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1cc5e-c510-430d-8e87-5b710431cb73 None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:16.965397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1cc5e-c510-430d-8e87-5b710431cb73 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:16.977397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 69/132] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:16 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:16.977397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1cc5e-c510-430d-8e87-5b710431cb73 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:17.032595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a24e8-adee-46f4-92ce-c3ca08437b28 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:17.111686 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914092df-e22d-461b-b37f-b3f0b03f7f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:17.112439 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914092df-e22d-461b-b37f-b3f0b03f7f51 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:17.112732 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914092df-e22d-461b-b37f-b3f0b03f7f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:17.113020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914092df-e22d-461b-b37f-b3f0b03f7f51 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:17.113823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914092df-e22d-461b-b37f-b3f0b03f7f51 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:17.114136 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914092df-e22d-461b-b37f-b3f0b03f7f51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:17.115917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914092df-e22d-461b-b37f-b3f0b03f7f51 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:17.130715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 64/133] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:17.141873 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914092df-e22d-461b-b37f-b3f0b03f7f51 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:17.173052 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1cc5e-c510-430d-8e87-5b710431cb73 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:17.205737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:17.214392 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0e6fd-db47-4322-82c3-c8f33c751d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:17.215267 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0e6fd-db47-4322-82c3-c8f33c751d08 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:17.215568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0e6fd-db47-4322-82c3-c8f33c751d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:17.216051 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:17.216655 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0e6fd-db47-4322-82c3-c8f33c751d08 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab/users/f889fd589b2d4d67ac66dc372869f6fa/roles/1be1544572744e849ed04df01cdca3fb` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:17.221713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0e6fd-db47-4322-82c3-c8f33c751d08 None admin] RBAC: Authorizing `identity:create_grant(project_id=a82bf7161bd44f5e83eae52981f952ab, user_id=f889fd589b2d4d67ac66dc372869f6fa, role_id=1be1544572744e849ed04df01cdca3fb)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:17.223247 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0e6fd-db47-4322-82c3-c8f33c751d08 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:17.239429 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 70/134] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:21:16 2022] PUT /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab/users/f889fd589b2d4d67ac66dc372869f6fa/roles/1be1544572744e849ed04df01cdca3fb => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:17.334156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914092df-e22d-461b-b37f-b3f0b03f7f51 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:17.386726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d487b-e693-42e3-8ecc-da658f1553a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:17.387655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d487b-e693-42e3-8ecc-da658f1553a5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:17.387944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d487b-e693-42e3-8ecc-da658f1553a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:17.388226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d487b-e693-42e3-8ecc-da658f1553a5 None admin] PATH_INFO: `/v3/users/f889fd589b2d4d67ac66dc372869f6fa` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:17.389505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d487b-e693-42e3-8ecc-da658f1553a5 None admin] RBAC: Authorizing `identity:get_user(user_id=f889fd589b2d4d67ac66dc372869f6fa)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:17.390982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d487b-e693-42e3-8ecc-da658f1553a5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:17.392680 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 65/135] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:17 2022] GET /identity/v3/users/f889fd589b2d4d67ac66dc372869f6fa => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:17.398418 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0e6fd-db47-4322-82c3-c8f33c751d08 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:17.535909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0e6fd-db47-4322-82c3-c8f33c751d08 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:17.579884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392859ac-c353-45df-8743-4c6fadcfccb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:17.581077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392859ac-c353-45df-8743-4c6fadcfccb1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:17.581397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392859ac-c353-45df-8743-4c6fadcfccb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:17.581732 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392859ac-c353-45df-8743-4c6fadcfccb1 None admin] PATH_INFO: `/v3/projects/5824bb076cd9453c9f19e70b2601ad18` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:17.582951 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392859ac-c353-45df-8743-4c6fadcfccb1 None admin] RBAC: Authorizing `identity:get_project(project_id=5824bb076cd9453c9f19e70b2601ad18)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:17.584428 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392859ac-c353-45df-8743-4c6fadcfccb1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:17.586375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 71/136] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:17 2022] GET /identity/v3/projects/5824bb076cd9453c9f19e70b2601ad18 => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:17.594552 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d487b-e693-42e3-8ecc-da658f1553a5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:17.708410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d487b-e693-42e3-8ecc-da658f1553a5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:17.710631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:17.747970 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61b08e-d03c-42e2-93fa-836895e33a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:17.749220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61b08e-d03c-42e2-93fa-836895e33a04 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:17.749719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61b08e-d03c-42e2-93fa-836895e33a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:17.750170 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61b08e-d03c-42e2-93fa-836895e33a04 None admin] PATH_INFO: `/v3/projects/5824bb076cd9453c9f19e70b2601ad18/users/f889fd589b2d4d67ac66dc372869f6fa/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:17.752354 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61b08e-d03c-42e2-93fa-836895e33a04 None admin] RBAC: Authorizing `identity:create_grant(project_id=5824bb076cd9453c9f19e70b2601ad18, user_id=f889fd589b2d4d67ac66dc372869f6fa, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:17.754051 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61b08e-d03c-42e2-93fa-836895e33a04 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:17.770017 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 66/137] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:21:17 2022] PUT /identity/v3/projects/5824bb076cd9453c9f19e70b2601ad18/users/f889fd589b2d4d67ac66dc372869f6fa/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:17.787217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f2ac6-8248-4f24-9e1f-c65093110a78 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:17.787833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f2ac6-8248-4f24-9e1f-c65093110a78 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:17.788297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f2ac6-8248-4f24-9e1f-c65093110a78 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:17.790516 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 72/138] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:17.797000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b91737-39c6-418a-95d4-6a3cb0581c2d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:17.798009 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b91737-39c6-418a-95d4-6a3cb0581c2d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:17.798539 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b91737-39c6-418a-95d4-6a3cb0581c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:17.822781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-36b91737-39c6-418a-95d4-6a3cb0581c2d None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:17.824513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-36b91737-39c6-418a-95d4-6a3cb0581c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:17.908671 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 67/139] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:17.932790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f2ac6-8248-4f24-9e1f-c65093110a78 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:18.001749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:18.045231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f2ac6-8248-4f24-9e1f-c65093110a78 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:18.081646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d636c-07b6-4f5e-896f-27aee76228d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:18.082627 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d636c-07b6-4f5e-896f-27aee76228d1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:18.082982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d636c-07b6-4f5e-896f-27aee76228d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:18.083325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d636c-07b6-4f5e-896f-27aee76228d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:18.096384 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d636c-07b6-4f5e-896f-27aee76228d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:18.104545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c58d636c-07b6-4f5e-896f-27aee76228d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:18.104545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:18.104545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:18.104545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:18.104545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:18.104545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:18.104545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:18.104545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:18.104545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:18.104545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:18.104545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:18.104545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:18.104545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:18.104545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:18.104545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:18.104545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:18.105609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:18.105609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:18.105609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:18.105609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:18.105609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:18.105609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:18.105609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:18.105609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:18.105609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:18.105609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:18.105609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:18.105609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:18.105609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:18.105609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:18.105609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:18.105609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:18.106588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:18.106588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:18.106588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:18.106588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:18.106588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:18.106588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:18.106588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:18.106588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:18.106588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:18.106588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:18.106588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:18.106588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:18.108007 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 73/140] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:18.114227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b91737-39c6-418a-95d4-6a3cb0581c2d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:18.213378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:18.222320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b91737-39c6-418a-95d4-6a3cb0581c2d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:18.261508 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a7655-5c88-49b0-b5f8-1bd09b8cac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:18.262205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a7655-5c88-49b0-b5f8-1bd09b8cac63 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:18.262612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a7655-5c88-49b0-b5f8-1bd09b8cac63 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:18.262898 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a7655-5c88-49b0-b5f8-1bd09b8cac63 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:18.263717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a7655-5c88-49b0-b5f8-1bd09b8cac63 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:18.264041 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a7655-5c88-49b0-b5f8-1bd09b8cac63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:18.265486 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a7655-5c88-49b0-b5f8-1bd09b8cac63 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:18.274987 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 68/141] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:18.280583 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d636c-07b6-4f5e-896f-27aee76228d1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:18.421633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d636c-07b6-4f5e-896f-27aee76228d1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:18.439115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:18.465199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e296d-db9f-4567-a117-d70f522d8c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:18.466140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e296d-db9f-4567-a117-d70f522d8c59 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:18.466425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e296d-db9f-4567-a117-d70f522d8c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:18.466702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e296d-db9f-4567-a117-d70f522d8c59 None admin] PATH_INFO: `/v3/users/f889fd589b2d4d67ac66dc372869f6fa` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:18.467922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e296d-db9f-4567-a117-d70f522d8c59 None admin] RBAC: Authorizing `identity:get_user(user_id=f889fd589b2d4d67ac66dc372869f6fa)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:18.469408 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e296d-db9f-4567-a117-d70f522d8c59 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:18.471071 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 74/142] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:18 2022] GET /identity/v3/users/f889fd589b2d4d67ac66dc372869f6fa => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:18.476807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a7655-5c88-49b0-b5f8-1bd09b8cac63 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:18.583530 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a7655-5c88-49b0-b5f8-1bd09b8cac63 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:18.618661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44dda5-b49b-4747-afe9-2e1f3d3a6bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:18.619332 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44dda5-b49b-4747-afe9-2e1f3d3a6bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:18.619623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44dda5-b49b-4747-afe9-2e1f3d3a6bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:18.619909 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44dda5-b49b-4747-afe9-2e1f3d3a6bf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:18.644877 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:18.693943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44dda5-b49b-4747-afe9-2e1f3d3a6bf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:18.695410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44dda5-b49b-4747-afe9-2e1f3d3a6bf7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:18.797126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 69/143] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:18.803070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e296d-db9f-4567-a117-d70f522d8c59 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:18.909391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e296d-db9f-4567-a117-d70f522d8c59 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:18.949238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a4534-e8a9-4bc0-92ce-755db6e42436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:18.950085 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a4534-e8a9-4bc0-92ce-755db6e42436 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:18.950376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a4534-e8a9-4bc0-92ce-755db6e42436 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:18.950657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a4534-e8a9-4bc0-92ce-755db6e42436 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:18.951885 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a4534-e8a9-4bc0-92ce-755db6e42436 None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:18.953503 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a4534-e8a9-4bc0-92ce-755db6e42436 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:18.955252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 75/144] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:18 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:18.961459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44dda5-b49b-4747-afe9-2e1f3d3a6bf7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:19.025741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:19.071572 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44dda5-b49b-4747-afe9-2e1f3d3a6bf7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:19.106682 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9e034-860f-4aaf-80e2-f552708945d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:19.107359 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9e034-860f-4aaf-80e2-f552708945d6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:19.107651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9e034-860f-4aaf-80e2-f552708945d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:19.107936 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9e034-860f-4aaf-80e2-f552708945d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:19.108848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9e034-860f-4aaf-80e2-f552708945d6 None admin] RBAC: Adding query filter params (role.id=5dd696285c0b41d3acb854981774eaae, scope.project.id=a82bf7161bd44f5e83eae52981f952ab, user.id=f889fd589b2d4d67ac66dc372869f6fa) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:19.109170 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9e034-860f-4aaf-80e2-f552708945d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:19.110692 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9e034-860f-4aaf-80e2-f552708945d6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:19.117061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 70/145] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:18 2022] GET /identity/v3/role_assignments?user.id=f889fd589b2d4d67ac66dc372869f6fa&scope.project.id=a82bf7161bd44f5e83eae52981f952ab&role.id=5dd696285c0b41d3acb854981774eaae => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:19.331195 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5a5a2-ceaf-492b-afb5-d098ee2d501f None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:19.331682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5a5a2-ceaf-492b-afb5-d098ee2d501f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:19.332143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5a5a2-ceaf-492b-afb5-d098ee2d501f None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:19.333716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 76/146] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:19.351993 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4a1cd-30e9-4d37-896e-4e71df5a26de None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:19.352403 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4a1cd-30e9-4d37-896e-4e71df5a26de None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:19.352544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4a1cd-30e9-4d37-896e-4e71df5a26de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:19.377719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-dfd4a1cd-30e9-4d37-896e-4e71df5a26de None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:19.378992 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dfd4a1cd-30e9-4d37-896e-4e71df5a26de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:19.441304 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32377280-5608-44d8-974b-bf8c9cb276fc None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:19.441665 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32377280-5608-44d8-974b-bf8c9cb276fc None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:19.441896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32377280-5608-44d8-974b-bf8c9cb276fc None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:19.443425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 77/147] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:21:19.448706 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3b715-1770-441d-958e-175e1ba4a1c7 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:19.449219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3b715-1770-441d-958e-175e1ba4a1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:19.449731 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3b715-1770-441d-958e-175e1ba4a1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:19.460185 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 71/148] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:19.468920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2ce3b715-1770-441d-958e-175e1ba4a1c7 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:19.470275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2ce3b715-1770-441d-958e-175e1ba4a1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:19.488779 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4a1cd-30e9-4d37-896e-4e71df5a26de None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:19.526210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:19.561521 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:19.581052 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 78/149] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:19.618771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3b715-1770-441d-958e-175e1ba4a1c7 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:19.621362 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4a1cd-30e9-4d37-896e-4e71df5a26de None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:19.660561 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7aa58-3ece-4a15-a3f7-d118de9afae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:19.661677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7aa58-3ece-4a15-a3f7-d118de9afae5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:19.662409 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7aa58-3ece-4a15-a3f7-d118de9afae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:19.662833 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7aa58-3ece-4a15-a3f7-d118de9afae5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:19.675827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7aa58-3ece-4a15-a3f7-d118de9afae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:19.684961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-41a7aa58-3ece-4a15-a3f7-d118de9afae5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:19.684961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:19.684961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:19.684961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:19.684961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:19.684961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:19.684961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:19.684961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:19.684961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:19.684961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:19.684961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:19.684961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:19.684961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:19.684961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:19.684961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:19.684961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:19.686061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:19.686061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:19.686061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:19.686061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:19.686061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:19.686061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:19.686061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:19.686061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:19.686061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:19.686061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:19.686061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:19.686061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:19.686061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:19.686061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:19.686061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:19.686061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:19.687040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:19.687040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:19.687040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:19.687040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:19.687040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:19.687040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:19.687040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:19.687040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:19.687040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:19.687040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:19.687040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:19.687040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:19.689623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 72/150] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:21:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:21:19.696181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7aa58-3ece-4a15-a3f7-d118de9afae5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:19.813245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7aa58-3ece-4a15-a3f7-d118de9afae5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:19.824384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:19.853568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3306e21-1f20-49cb-9147-455850789d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:19.854512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3306e21-1f20-49cb-9147-455850789d32 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:19.855095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3306e21-1f20-49cb-9147-455850789d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:19.855839 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3306e21-1f20-49cb-9147-455850789d32 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:19.856975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3306e21-1f20-49cb-9147-455850789d32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:19.857603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3306e21-1f20-49cb-9147-455850789d32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:19.859321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3306e21-1f20-49cb-9147-455850789d32 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:19.864640 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3b715-1770-441d-958e-175e1ba4a1c7 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:19.869441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 73/151] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:19.877748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3306e21-1f20-49cb-9147-455850789d32 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:19.970658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2e529-cc84-4ea7-ae55-bd61cc5f8ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:19.971502 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2e529-cc84-4ea7-ae55-bd61cc5f8ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:19.971789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2e529-cc84-4ea7-ae55-bd61cc5f8ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:19.972075 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2e529-cc84-4ea7-ae55-bd61cc5f8ab6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:19.973277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2e529-cc84-4ea7-ae55-bd61cc5f8ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:19.974805 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2e529-cc84-4ea7-ae55-bd61cc5f8ab6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:19.976486 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 79/152] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:19.982342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2e529-cc84-4ea7-ae55-bd61cc5f8ab6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:20.018249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3306e21-1f20-49cb-9147-455850789d32 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:20.063694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf8221-2535-4be7-ada0-4df616abc70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:20.065304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf8221-2535-4be7-ada0-4df616abc70e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:20.067491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf8221-2535-4be7-ada0-4df616abc70e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:20.069149 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf8221-2535-4be7-ada0-4df616abc70e None admin] PATH_INFO: `/v3/users/d38407cead4d4c429e0e7ef7b966bf82` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:20.071061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf8221-2535-4be7-ada0-4df616abc70e None admin] RBAC: Authorizing `identity:get_user(user_id=d38407cead4d4c429e0e7ef7b966bf82)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:20.075931 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf8221-2535-4be7-ada0-4df616abc70e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:20.078806 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 74/153] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:19 2022] GET /identity/v3/users/d38407cead4d4c429e0e7ef7b966bf82 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:20.098422 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:20.099809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf8221-2535-4be7-ada0-4df616abc70e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:20.157301 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:20.163236 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2e529-cc84-4ea7-ae55-bd61cc5f8ab6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:20.201066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d5e2f-1193-4b17-b165-2373765b9802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:20.201789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d5e2f-1193-4b17-b165-2373765b9802 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:20.202069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d5e2f-1193-4b17-b165-2373765b9802 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:20.202339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d5e2f-1193-4b17-b165-2373765b9802 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:20.203064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d5e2f-1193-4b17-b165-2373765b9802 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:20.204619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d5e2f-1193-4b17-b165-2373765b9802 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:20.230343 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 80/154] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:21:19 2022] POST /identity/v3/users => generated 283 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:21:20.231744 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf8221-2535-4be7-ada0-4df616abc70e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:20.231925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42537ff6-6818-430f-993a-4df346c312fc None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:20.232300 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42537ff6-6818-430f-993a-4df346c312fc None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:20.232626 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42537ff6-6818-430f-993a-4df346c312fc None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:20.239223 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 81/155] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:20.241263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019004f-bb8d-4ad5-ba3f-bc179a124ea1 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:20.241585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019004f-bb8d-4ad5-ba3f-bc179a124ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:20.241866 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019004f-bb8d-4ad5-ba3f-bc179a124ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:20.260596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2019004f-bb8d-4ad5-ba3f-bc179a124ea1 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:20.262059 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2019004f-bb8d-4ad5-ba3f-bc179a124ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:20.271226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c2b06-5365-4a39-9fbf-9056bc876ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:20.271924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c2b06-5365-4a39-9fbf-9056bc876ffa None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:20.272322 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c2b06-5365-4a39-9fbf-9056bc876ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:20.272606 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c2b06-5365-4a39-9fbf-9056bc876ffa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:20.339210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 82/156] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:20.350401 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c2b06-5365-4a39-9fbf-9056bc876ffa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:20.352035 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c2b06-5365-4a39-9fbf-9056bc876ffa None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:20.361031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019004f-bb8d-4ad5-ba3f-bc179a124ea1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:20.393438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:20.396578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:20.488485 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 75/157] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:20.489006 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019004f-bb8d-4ad5-ba3f-bc179a124ea1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:20.495049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c2b06-5365-4a39-9fbf-9056bc876ffa None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:20.524947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337aca2-5d6f-48e6-9896-c3a9286b319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:20.527583 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337aca2-5d6f-48e6-9896-c3a9286b319b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:20.527870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337aca2-5d6f-48e6-9896-c3a9286b319b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:20.529084 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337aca2-5d6f-48e6-9896-c3a9286b319b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:20.544958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337aca2-5d6f-48e6-9896-c3a9286b319b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:20.554211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-e337aca2-5d6f-48e6-9896-c3a9286b319b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:20.554211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:20.554211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:20.554211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:20.554211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:20.554211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:20.554211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:20.554211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:20.554211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:20.554211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:20.554211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:20.554211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:20.554211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:20.554211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:20.554211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:20.554211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:20.555232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:20.555232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:20.555232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:20.555232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:20.555232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:20.555232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:20.555232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:20.555232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:20.555232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:20.555232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:20.555232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:20.555232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:20.555232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:20.555232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:20.555232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:20.555232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:20.556123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:20.556123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:20.556123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:20.556123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:20.556123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:20.556123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:20.556123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:20.556123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:20.556123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:20.556123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:20.556123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:20.556123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:20.556123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 83/158] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:20.561936 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337aca2-5d6f-48e6-9896-c3a9286b319b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:20.631516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c2b06-5365-4a39-9fbf-9056bc876ffa None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:20.663682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:20.673108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00467df7-be0f-4aba-8f20-1bc820101133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:20.673697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337aca2-5d6f-48e6-9896-c3a9286b319b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:20.674074 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00467df7-be0f-4aba-8f20-1bc820101133 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:20.674361 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00467df7-be0f-4aba-8f20-1bc820101133 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:20.674641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00467df7-be0f-4aba-8f20-1bc820101133 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:20.675869 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00467df7-be0f-4aba-8f20-1bc820101133 None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:20.677335 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00467df7-be0f-4aba-8f20-1bc820101133 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:20.679255 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 76/159] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:20 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:20.680294 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe198c82-69b1-4243-a349-3394973c443e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:20.680581 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe198c82-69b1-4243-a349-3394973c443e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:20.680879 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe198c82-69b1-4243-a349-3394973c443e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:20.682539 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 77/160] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:20.690393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3869f9-0f3a-40c0-9cdc-ad42b4a26910 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:20.690393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3869f9-0f3a-40c0-9cdc-ad42b4a26910 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:20.690393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3869f9-0f3a-40c0-9cdc-ad42b4a26910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:20.702088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:20.709328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3c3869f9-0f3a-40c0-9cdc-ad42b4a26910 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:20.711328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3c3869f9-0f3a-40c0-9cdc-ad42b4a26910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:20.726722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58bd21-5f17-46d9-ba64-1b3fc671bf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:20.727641 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58bd21-5f17-46d9-ba64-1b3fc671bf1c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:20.728123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58bd21-5f17-46d9-ba64-1b3fc671bf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:20.728505 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58bd21-5f17-46d9-ba64-1b3fc671bf1c None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:20.729397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58bd21-5f17-46d9-ba64-1b3fc671bf1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:20.729770 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58bd21-5f17-46d9-ba64-1b3fc671bf1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:20.731190 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58bd21-5f17-46d9-ba64-1b3fc671bf1c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:20.741950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 84/161] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:20.742690 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58bd21-5f17-46d9-ba64-1b3fc671bf1c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:20.801103 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 78/162] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:20.803778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3869f9-0f3a-40c0-9cdc-ad42b4a26910 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:20.880124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58bd21-5f17-46d9-ba64-1b3fc671bf1c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:20.915070 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3869f9-0f3a-40c0-9cdc-ad42b4a26910 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:20.925396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc33428-d099-4acf-b199-fd087a1e625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:20.926720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc33428-d099-4acf-b199-fd087a1e625f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:20.927110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc33428-d099-4acf-b199-fd087a1e625f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:20.927489 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc33428-d099-4acf-b199-fd087a1e625f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:20.928870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc33428-d099-4acf-b199-fd087a1e625f None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=a82bf7161bd44f5e83eae52981f952ab, user.id=d38407cead4d4c429e0e7ef7b966bf82) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:20.929299 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc33428-d099-4acf-b199-fd087a1e625f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:20.931507 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc33428-d099-4acf-b199-fd087a1e625f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:20.939458 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 85/163] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:20 2022] GET /identity/v3/role_assignments?user.id=d38407cead4d4c429e0e7ef7b966bf82&scope.project.id=a82bf7161bd44f5e83eae52981f952ab&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:20.940336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc33428-d099-4acf-b199-fd087a1e625f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:20.967431 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66c510-346b-47b7-a743-7cd0119b5773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:20.968760 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66c510-346b-47b7-a743-7cd0119b5773 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:20.969242 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66c510-346b-47b7-a743-7cd0119b5773 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:20.970360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66c510-346b-47b7-a743-7cd0119b5773 None admin] PATH_INFO: `/v3/users/e672113ca42f487688a9f65953e86c80` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:20.972251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66c510-346b-47b7-a743-7cd0119b5773 None admin] RBAC: Authorizing `identity:get_user(user_id=e672113ca42f487688a9f65953e86c80)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:20.974887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66c510-346b-47b7-a743-7cd0119b5773 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:20.977914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 79/164] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:20 2022] GET /identity/v3/users/e672113ca42f487688a9f65953e86c80 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:20.978473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:20.984355 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66c510-346b-47b7-a743-7cd0119b5773 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:20.989997 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:21.098811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc33428-d099-4acf-b199-fd087a1e625f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:21.151213 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5104f-7d7d-4d9f-a80e-0d25a1eb413f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:21.152106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5104f-7d7d-4d9f-a80e-0d25a1eb413f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:21.152393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5104f-7d7d-4d9f-a80e-0d25a1eb413f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:21.152670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5104f-7d7d-4d9f-a80e-0d25a1eb413f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:21.158961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66c510-346b-47b7-a743-7cd0119b5773 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:21.167258 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5104f-7d7d-4d9f-a80e-0d25a1eb413f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:21.176492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-47f5104f-7d7d-4d9f-a80e-0d25a1eb413f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:21.176492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:21.176492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:21.176492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:21.176492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:21.176492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:21.176492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:21.176492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:21.176492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:21.176492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:21.176492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:21.176492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:21.176492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:21.176492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:21.176492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:21.176492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:21.177479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:21.177479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:21.177479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:21.177479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:21.177479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:21.177479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:21.177479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:21.177479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:21.177479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:21.177479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:21.177479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:21.177479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:21.177479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:21.177479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:21.177479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:21.177479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:21.178282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:21.178282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:21.178282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:21.178282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:21.178282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:21.178282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:21.178282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:21.178282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:21.178282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:21.178282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:21.178282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:21.178282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:21.179929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 86/165] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:21:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:21.185765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5104f-7d7d-4d9f-a80e-0d25a1eb413f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:21.218383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed81ccc-4c98-4cdc-bbf0-224969cd8857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:21.219836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed81ccc-4c98-4cdc-bbf0-224969cd8857 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:21.220153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed81ccc-4c98-4cdc-bbf0-224969cd8857 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:21.220533 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed81ccc-4c98-4cdc-bbf0-224969cd8857 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:21.221968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed81ccc-4c98-4cdc-bbf0-224969cd8857 None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:21.223682 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed81ccc-4c98-4cdc-bbf0-224969cd8857 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:21.226329 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 80/166] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:20 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:21.233689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed81ccc-4c98-4cdc-bbf0-224969cd8857 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:21.288130 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:21.311666 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5104f-7d7d-4d9f-a80e-0d25a1eb413f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:21.324566 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:21.365136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8b84a-860c-401f-a81a-7e2e31405065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:21.366341 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8b84a-860c-401f-a81a-7e2e31405065 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:21.366625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8b84a-860c-401f-a81a-7e2e31405065 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:21.366898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8b84a-860c-401f-a81a-7e2e31405065 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:21.367699 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8b84a-860c-401f-a81a-7e2e31405065 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:21.368013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8b84a-860c-401f-a81a-7e2e31405065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:21.369788 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8b84a-860c-401f-a81a-7e2e31405065 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:21.372755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed81ccc-4c98-4cdc-bbf0-224969cd8857 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:21.379237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 87/167] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:21:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:21.385227 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8b84a-860c-401f-a81a-7e2e31405065 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:21.416914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8945bb4-647c-4d65-a2de-7f75fe9ef77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:21.417896 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8945bb4-647c-4d65-a2de-7f75fe9ef77e None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:21.418181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8945bb4-647c-4d65-a2de-7f75fe9ef77e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:21.418459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8945bb4-647c-4d65-a2de-7f75fe9ef77e None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab/users/e672113ca42f487688a9f65953e86c80/roles/52f18795c489403f89e3036b0cdd3dd8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:21.421846 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8945bb4-647c-4d65-a2de-7f75fe9ef77e None admin] RBAC: Authorizing `identity:create_grant(project_id=a82bf7161bd44f5e83eae52981f952ab, user_id=e672113ca42f487688a9f65953e86c80, role_id=52f18795c489403f89e3036b0cdd3dd8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:21.423878 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8945bb4-647c-4d65-a2de-7f75fe9ef77e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:21.446217 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 81/168] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:21:21 2022] PUT /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab/users/e672113ca42f487688a9f65953e86c80/roles/52f18795c489403f89e3036b0cdd3dd8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:21:21.539340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8b84a-860c-401f-a81a-7e2e31405065 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:21.561140 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4fad1-daad-40d7-96cb-3feb79ec4a62 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:21.561476 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4fad1-daad-40d7-96cb-3feb79ec4a62 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:21.561740 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4fad1-daad-40d7-96cb-3feb79ec4a62 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:21.563300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 82/169] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:21:21.574378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa073e-07c3-4d26-a3ae-4415531ad6d7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:21.574723 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa073e-07c3-4d26-a3ae-4415531ad6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:21.574935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa073e-07c3-4d26-a3ae-4415531ad6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:21.604745 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c3fa073e-07c3-4d26-a3ae-4415531ad6d7 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:21.606008 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c3fa073e-07c3-4d26-a3ae-4415531ad6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:21.614833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4938f-4e2f-4bac-bbb6-3a935a639d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:21.616169 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4938f-4e2f-4bac-bbb6-3a935a639d8d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:21.616454 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4938f-4e2f-4bac-bbb6-3a935a639d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:21.616834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4938f-4e2f-4bac-bbb6-3a935a639d8d None admin] PATH_INFO: `/v3/users/f889fd589b2d4d67ac66dc372869f6fa` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:21.622310 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4938f-4e2f-4bac-bbb6-3a935a639d8d None admin] RBAC: Authorizing `identity:get_user(user_id=f889fd589b2d4d67ac66dc372869f6fa)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:21.623977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4938f-4e2f-4bac-bbb6-3a935a639d8d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:21.625828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 88/170] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:21 2022] GET /identity/v3/users/f889fd589b2d4d67ac66dc372869f6fa => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:21.631558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4938f-4e2f-4bac-bbb6-3a935a639d8d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:21.651692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:21.709201 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 83/171] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:21.764199 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa073e-07c3-4d26-a3ae-4415531ad6d7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:21.855995 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:21.883470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa073e-07c3-4d26-a3ae-4415531ad6d7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:21.894747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4938f-4e2f-4bac-bbb6-3a935a639d8d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:21.922140 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501db2cc-609b-40d2-ac5e-c31f1b54d459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:21.923530 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501db2cc-609b-40d2-ac5e-c31f1b54d459 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:21.923892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501db2cc-609b-40d2-ac5e-c31f1b54d459 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:21.924401 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501db2cc-609b-40d2-ac5e-c31f1b54d459 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:21.936763 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501db2cc-609b-40d2-ac5e-c31f1b54d459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:21.945659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-501db2cc-609b-40d2-ac5e-c31f1b54d459 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:21.945659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:21.945659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:21.945659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:21.945659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:21.945659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:21.945659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:21.945659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:21.945659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:21.945659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:21.945659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:21.945659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:21.945659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:21.945659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:21.945659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:21.945659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:21.946576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:21.946576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:21.946576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:21.946576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:21.946576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:21.946576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:21.946576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:21.946576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:21.946576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:21.946576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:21.946576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:21.946576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:21.946576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:21.946576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:21.946576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:21.946576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:21.947378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:21.947378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:21.947378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:21.947378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:21.947378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:21.947378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:21.947378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:21.947378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:21.947378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:21.947378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:21.947378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:21.947378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:21.947378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 84/172] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:21.955902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501db2cc-609b-40d2-ac5e-c31f1b54d459 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:21.975593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fae3e-9051-4301-9675-fe4049c8013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:21.976314 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fae3e-9051-4301-9675-fe4049c8013a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:21.976601 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fae3e-9051-4301-9675-fe4049c8013a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:21.976881 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fae3e-9051-4301-9675-fe4049c8013a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:22.107858 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fae3e-9051-4301-9675-fe4049c8013a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:22.110753 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9fae3e-9051-4301-9675-fe4049c8013a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:22.124239 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501db2cc-609b-40d2-ac5e-c31f1b54d459 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:22.135567 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:22.171067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:22.194227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf8c1c-8a9b-47b1-87a9-cc3fb6bb9692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:22.194918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf8c1c-8a9b-47b1-87a9-cc3fb6bb9692 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:22.195201 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf8c1c-8a9b-47b1-87a9-cc3fb6bb9692 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:22.195476 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf8c1c-8a9b-47b1-87a9-cc3fb6bb9692 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:22.196340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf8c1c-8a9b-47b1-87a9-cc3fb6bb9692 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:22.196767 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf8c1c-8a9b-47b1-87a9-cc3fb6bb9692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:22.198199 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf8c1c-8a9b-47b1-87a9-cc3fb6bb9692 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:22.213205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 85/173] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:22.222166 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf8c1c-8a9b-47b1-87a9-cc3fb6bb9692 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:22.244790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 89/174] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 00:21:22.250694 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fae3e-9051-4301-9675-fe4049c8013a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:22.350774 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fae3e-9051-4301-9675-fe4049c8013a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:22.361579 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:22.392056 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf8c1c-8a9b-47b1-87a9-cc3fb6bb9692 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:22.396217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c64bd-9272-4db3-8581-44136401bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:22.397133 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c64bd-9272-4db3-8581-44136401bb7f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:22.397440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c64bd-9272-4db3-8581-44136401bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:22.397719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c64bd-9272-4db3-8581-44136401bb7f None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:22.398976 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c64bd-9272-4db3-8581-44136401bb7f None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:22.400487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c64bd-9272-4db3-8581-44136401bb7f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:22.405366 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 90/175] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:22 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:22.408057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c64bd-9272-4db3-8581-44136401bb7f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:22.448769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480f426-46d1-45b2-895f-dcf0b36836d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:22.450220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480f426-46d1-45b2-895f-dcf0b36836d1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:22.450991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480f426-46d1-45b2-895f-dcf0b36836d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:22.451942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480f426-46d1-45b2-895f-dcf0b36836d1 None admin] PATH_INFO: `/v3/users/f889fd589b2d4d67ac66dc372869f6fa` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:22.455511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480f426-46d1-45b2-895f-dcf0b36836d1 None admin] RBAC: Authorizing `identity:get_user(user_id=f889fd589b2d4d67ac66dc372869f6fa)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:22.458879 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480f426-46d1-45b2-895f-dcf0b36836d1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:22.462922 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 86/176] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:22 2022] GET /identity/v3/users/f889fd589b2d4d67ac66dc372869f6fa => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:22.483136 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480f426-46d1-45b2-895f-dcf0b36836d1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:22.517388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c64bd-9272-4db3-8581-44136401bb7f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:22.552797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc4697-c8ee-4042-91bf-e60a742b1dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:22.553543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc4697-c8ee-4042-91bf-e60a742b1dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:22.553832 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc4697-c8ee-4042-91bf-e60a742b1dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:22.554111 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc4697-c8ee-4042-91bf-e60a742b1dc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:22.554961 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc4697-c8ee-4042-91bf-e60a742b1dc8 None admin] RBAC: Adding query filter params (role.id=1be1544572744e849ed04df01cdca3fb, scope.project.id=a82bf7161bd44f5e83eae52981f952ab, user.id=f889fd589b2d4d67ac66dc372869f6fa) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:22.555279 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc4697-c8ee-4042-91bf-e60a742b1dc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:22.556802 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc4697-c8ee-4042-91bf-e60a742b1dc8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:22.565368 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 91/177] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:22 2022] GET /identity/v3/role_assignments?user.id=f889fd589b2d4d67ac66dc372869f6fa&scope.project.id=a82bf7161bd44f5e83eae52981f952ab&role.id=1be1544572744e849ed04df01cdca3fb => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:22.594328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:22.675732 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480f426-46d1-45b2-895f-dcf0b36836d1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:22.718973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3a426-7967-4132-8d9c-f6b1b0ebff53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:22.719648 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3a426-7967-4132-8d9c-f6b1b0ebff53 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:22.719927 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3a426-7967-4132-8d9c-f6b1b0ebff53 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:22.720197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3a426-7967-4132-8d9c-f6b1b0ebff53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:22.805024 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3a426-7967-4132-8d9c-f6b1b0ebff53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:22.806606 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3a426-7967-4132-8d9c-f6b1b0ebff53 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:22.868932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:22.941921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 87/178] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 00:21:22.947697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc4697-c8ee-4042-91bf-e60a742b1dc8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:23.010167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:23.085088 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc4697-c8ee-4042-91bf-e60a742b1dc8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:23.120916 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57379115-0464-47fa-a289-ac9e8d09eb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:23.122565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57379115-0464-47fa-a289-ac9e8d09eb53 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:23.123018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57379115-0464-47fa-a289-ac9e8d09eb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:23.123458 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57379115-0464-47fa-a289-ac9e8d09eb53 None admin] PATH_INFO: `/v3/projects/5824bb076cd9453c9f19e70b2601ad18` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:23.124868 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57379115-0464-47fa-a289-ac9e8d09eb53 None admin] RBAC: Authorizing `identity:get_project(project_id=5824bb076cd9453c9f19e70b2601ad18)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:23.126527 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57379115-0464-47fa-a289-ac9e8d09eb53 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:23.128720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 92/179] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:22 2022] GET /identity/v3/projects/5824bb076cd9453c9f19e70b2601ad18 => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:23.137844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3a426-7967-4132-8d9c-f6b1b0ebff53 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:23.252021 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3a426-7967-4132-8d9c-f6b1b0ebff53 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:23.292952 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0f550-3399-4786-aabc-e58db608e1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:23.293951 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0f550-3399-4786-aabc-e58db608e1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:23.294415 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0f550-3399-4786-aabc-e58db608e1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:23.294865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0f550-3399-4786-aabc-e58db608e1b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:23.295887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0f550-3399-4786-aabc-e58db608e1b6 None admin] RBAC: Adding query filter params (role.id=5dd696285c0b41d3acb854981774eaae, scope.project.id=5824bb076cd9453c9f19e70b2601ad18, user.id=f889fd589b2d4d67ac66dc372869f6fa) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:23.296404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0f550-3399-4786-aabc-e58db608e1b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:23.298054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0f550-3399-4786-aabc-e58db608e1b6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:23.304697 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 88/180] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:23 2022] GET /identity/v3/role_assignments?user.id=f889fd589b2d4d67ac66dc372869f6fa&scope.project.id=5824bb076cd9453c9f19e70b2601ad18&role.id=5dd696285c0b41d3acb854981774eaae => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:23.625283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3eeba4-6bcb-4ecb-8c7f-990f9090f1d3 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:23.625875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3eeba4-6bcb-4ecb-8c7f-990f9090f1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:23.626363 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3eeba4-6bcb-4ecb-8c7f-990f9090f1d3 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:23.628241 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 93/181] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:23.634381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b818-c8c8-49f8-aceb-78b1a202c2f4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:23.634925 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b818-c8c8-49f8-aceb-78b1a202c2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:23.635382 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881b818-c8c8-49f8-aceb-78b1a202c2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:23.654185 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7881b818-c8c8-49f8-aceb-78b1a202c2f4 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:23.655637 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7881b818-c8c8-49f8-aceb-78b1a202c2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:23.667699 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:23.734705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 89/182] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:23.758248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3eeba4-6bcb-4ecb-8c7f-990f9090f1d3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:23.765377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cc556-c095-4805-b266-e0093240c06e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:23.765694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cc556-c095-4805-b266-e0093240c06e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:23.765956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cc556-c095-4805-b266-e0093240c06e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:23.767606 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 90/183] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:21:23.774204 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7fae0-b5c3-4ca0-9497-3de459e4d121 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:23.774521 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7fae0-b5c3-4ca0-9497-3de459e4d121 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:23.774806 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7fae0-b5c3-4ca0-9497-3de459e4d121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:23.796908 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-bfc7fae0-b5c3-4ca0-9497-3de459e4d121 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:23.798351 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bfc7fae0-b5c3-4ca0-9497-3de459e4d121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:23.878654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3eeba4-6bcb-4ecb-8c7f-990f9090f1d3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:23.881873 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 91/184] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:23.892452 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:23.910816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7fae0-b5c3-4ca0-9497-3de459e4d121 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:23.926375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56094e14-63d9-4779-a4c4-c19db3c5ca07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:23.927206 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56094e14-63d9-4779-a4c4-c19db3c5ca07 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:23.927489 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56094e14-63d9-4779-a4c4-c19db3c5ca07 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:23.927766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56094e14-63d9-4779-a4c4-c19db3c5ca07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:23.944895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56094e14-63d9-4779-a4c4-c19db3c5ca07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:23.956135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-56094e14-63d9-4779-a4c4-c19db3c5ca07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:23.956135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:23.956135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:23.956135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:23.956135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:23.956135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:23.956135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:23.956135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:23.956135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:23.956135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:23.956135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:23.956135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:23.956135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:23.956135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:23.956135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:23.956135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:23.957061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:23.957061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:23.957061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:23.957061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:23.957061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:23.957061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:23.957061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:23.957061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:23.957061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:23.957061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:23.957061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:23.957061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:23.957061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:23.957061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:23.957061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:23.957061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:23.957889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:23.957889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:23.957889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:23.957889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:23.957889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:23.957889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:23.957889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:23.957889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:23.957889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:23.957889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:23.957889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:23.957889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:23.960298 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 94/185] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:21:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:23.968752 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56094e14-63d9-4779-a4c4-c19db3c5ca07 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:24.020186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:24.046021 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7fae0-b5c3-4ca0-9497-3de459e4d121 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:24.091756 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2289d89-3638-450a-a8a8-bf16a1f7be6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:24.092603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2289d89-3638-450a-a8a8-bf16a1f7be6e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:24.092888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2289d89-3638-450a-a8a8-bf16a1f7be6e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:24.093166 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2289d89-3638-450a-a8a8-bf16a1f7be6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:24.100747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56094e14-63d9-4779-a4c4-c19db3c5ca07 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:24.106121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2289d89-3638-450a-a8a8-bf16a1f7be6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:24.116182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-c2289d89-3638-450a-a8a8-bf16a1f7be6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:24.116182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:24.116182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:24.116182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:24.116182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:24.116182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:24.116182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:24.116182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:24.116182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:24.116182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:24.116182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:24.116182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:24.116182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:24.116182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:24.116182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:24.116182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:24.117853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:24.117853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:24.117853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:24.117853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:24.117853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:24.117853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:24.117853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:24.117853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:24.117853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:24.117853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:24.117853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:24.117853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:24.117853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:24.117853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:24.117853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:24.117853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:24.119463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:24.119463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:24.119463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:24.119463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:24.119463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:24.119463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:24.119463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:24.119463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:24.119463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:24.119463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:24.119463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:24.119463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:24.119463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 92/186] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:21:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:24.127730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2289d89-3638-450a-a8a8-bf16a1f7be6e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:24.147394 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bcd5f-6153-47a2-808a-8567ac660395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:24.148241 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bcd5f-6153-47a2-808a-8567ac660395 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:24.148505 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bcd5f-6153-47a2-808a-8567ac660395 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:24.149192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bcd5f-6153-47a2-808a-8567ac660395 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:24.150235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bcd5f-6153-47a2-808a-8567ac660395 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:24.150649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bcd5f-6153-47a2-808a-8567ac660395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:24.152890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bcd5f-6153-47a2-808a-8567ac660395 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:24.166401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 95/187] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:24.172699 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bcd5f-6153-47a2-808a-8567ac660395 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:24.208709 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:24.250611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2289d89-3638-450a-a8a8-bf16a1f7be6e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:24.280438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bcd5f-6153-47a2-808a-8567ac660395 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:24.288007 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9dfe3-904e-42dc-a39c-69ce61cf03b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:24.289093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9dfe3-904e-42dc-a39c-69ce61cf03b5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:24.289621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9dfe3-904e-42dc-a39c-69ce61cf03b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:24.290079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9dfe3-904e-42dc-a39c-69ce61cf03b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:24.291307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9dfe3-904e-42dc-a39c-69ce61cf03b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:24.292016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9dfe3-904e-42dc-a39c-69ce61cf03b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:24.293888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9dfe3-904e-42dc-a39c-69ce61cf03b5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:24.297748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:24.306317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 93/188] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:21:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:24.313440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9dfe3-904e-42dc-a39c-69ce61cf03b5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:24.321071 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ff4a4-6a95-4727-b730-bb039c573011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:24.322096 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ff4a4-6a95-4727-b730-bb039c573011 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:24.322445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ff4a4-6a95-4727-b730-bb039c573011 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:24.322783 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ff4a4-6a95-4727-b730-bb039c573011 None admin] PATH_INFO: `/v3/users/ee416b30e08e4d1f9592d88ed0e4f51d` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:24.337515 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ff4a4-6a95-4727-b730-bb039c573011 None admin] RBAC: Authorizing `identity:get_user(user_id=ee416b30e08e4d1f9592d88ed0e4f51d)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:24.339125 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ff4a4-6a95-4727-b730-bb039c573011 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:24.340927 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 96/189] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:24 2022] GET /identity/v3/users/ee416b30e08e4d1f9592d88ed0e4f51d => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:24.346295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ff4a4-6a95-4727-b730-bb039c573011 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:24.424643 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9dfe3-904e-42dc-a39c-69ce61cf03b5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:24.440164 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:24.454025 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ff4a4-6a95-4727-b730-bb039c573011 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:24.464737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb838d9-c2af-4a9d-98d1-59b936efcfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:24.465785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb838d9-c2af-4a9d-98d1-59b936efcfef None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:24.466068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb838d9-c2af-4a9d-98d1-59b936efcfef None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:24.466382 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb838d9-c2af-4a9d-98d1-59b936efcfef None admin] PATH_INFO: `/v3/users/ee416b30e08e4d1f9592d88ed0e4f51d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:24.468285 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb838d9-c2af-4a9d-98d1-59b936efcfef None admin] RBAC: Authorizing `identity:get_user(user_id=ee416b30e08e4d1f9592d88ed0e4f51d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:24.470324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb838d9-c2af-4a9d-98d1-59b936efcfef None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:24.472001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 94/190] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:24 2022] GET /identity/v3/users/ee416b30e08e4d1f9592d88ed0e4f51d => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:24.478293 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c79550-56e0-4b34-a173-024f2009c28b None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:24.478549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c79550-56e0-4b34-a173-024f2009c28b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:24.479000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c79550-56e0-4b34-a173-024f2009c28b None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:24.481397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 95/191] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:24.482022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c79550-56e0-4b34-a173-024f2009c28b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:24.495879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd4fb6-9d7e-4d6b-ac79-77965a5e9328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:24.496550 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd4fb6-9d7e-4d6b-ac79-77965a5e9328 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:24.496837 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd4fb6-9d7e-4d6b-ac79-77965a5e9328 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:24.497112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd4fb6-9d7e-4d6b-ac79-77965a5e9328 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:24.558381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:24.581091 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd4fb6-9d7e-4d6b-ac79-77965a5e9328 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:24.582646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd4fb6-9d7e-4d6b-ac79-77965a5e9328 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:24.596115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c79550-56e0-4b34-a173-024f2009c28b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:24.630230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63666f9-32e0-431a-9cd0-777fab989819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:24.630892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63666f9-32e0-431a-9cd0-777fab989819 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:24.631183 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63666f9-32e0-431a-9cd0-777fab989819 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:24.631468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63666f9-32e0-431a-9cd0-777fab989819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:24.668953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:24.682813 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 97/192] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 00:21:24.684018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369f924-553b-46ee-803b-c48c7bc4a344 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:24.684303 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369f924-553b-46ee-803b-c48c7bc4a344 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:24.684584 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369f924-553b-46ee-803b-c48c7bc4a344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:24.700598 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5369f924-553b-46ee-803b-c48c7bc4a344 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:24.701617 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63666f9-32e0-431a-9cd0-777fab989819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:24.701854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5369f924-553b-46ee-803b-c48c7bc4a344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:24.703102 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63666f9-32e0-431a-9cd0-777fab989819 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:24.768756 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:24.770377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 98/193] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:24.771922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88535afc-7d81-45a4-83b5-49949c8d004b None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:24.772208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88535afc-7d81-45a4-83b5-49949c8d004b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:24.772481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88535afc-7d81-45a4-83b5-49949c8d004b None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:24.773944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 99/194] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:24.774470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88535afc-7d81-45a4-83b5-49949c8d004b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:24.820002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 96/195] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:24.820002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68f85b-1b93-4f88-81d9-a3405d1d6c53 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:24.820002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68f85b-1b93-4f88-81d9-a3405d1d6c53 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:24.820002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68f85b-1b93-4f88-81d9-a3405d1d6c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:24.833243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2f68f85b-1b93-4f88-81d9-a3405d1d6c53 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:24.834482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2f68f85b-1b93-4f88-81d9-a3405d1d6c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:24.876661 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88535afc-7d81-45a4-83b5-49949c8d004b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:24.893897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:24.901373 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 97/196] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:24.906229 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68f85b-1b93-4f88-81d9-a3405d1d6c53 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:24.911488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e2c1c-3596-4c8c-a466-1dc0d80056af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:24.912365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e2c1c-3596-4c8c-a466-1dc0d80056af None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:24.912647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e2c1c-3596-4c8c-a466-1dc0d80056af None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:24.912923 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e2c1c-3596-4c8c-a466-1dc0d80056af None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:24.914132 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e2c1c-3596-4c8c-a466-1dc0d80056af None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:24.915629 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e2c1c-3596-4c8c-a466-1dc0d80056af None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:24.917326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 100/197] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:24 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:24.918099 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e2c1c-3596-4c8c-a466-1dc0d80056af None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:25.015954 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:25.018384 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e2c1c-3596-4c8c-a466-1dc0d80056af None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:25.022679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68f85b-1b93-4f88-81d9-a3405d1d6c53 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:25.053367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36e0c1-24b5-4e6e-b75c-510028e5473a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:25.054255 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36e0c1-24b5-4e6e-b75c-510028e5473a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:25.054541 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36e0c1-24b5-4e6e-b75c-510028e5473a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:25.054822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36e0c1-24b5-4e6e-b75c-510028e5473a None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:25.056097 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36e0c1-24b5-4e6e-b75c-510028e5473a None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:25.056513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0ac86-9f0c-4a8c-ac3f-35b7a747a0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:25.057326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ac86-9f0c-4a8c-ac3f-35b7a747a0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:25.057621 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36e0c1-24b5-4e6e-b75c-510028e5473a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:25.057718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ac86-9f0c-4a8c-ac3f-35b7a747a0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:25.057901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0ac86-9f0c-4a8c-ac3f-35b7a747a0e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:25.059075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0ac86-9f0c-4a8c-ac3f-35b7a747a0e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:25.059337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 101/198] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:24 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:25.064576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36e0c1-24b5-4e6e-b75c-510028e5473a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:25.064674 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0ac86-9f0c-4a8c-ac3f-35b7a747a0e6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:25.064674 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 98/199] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:25.064674 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0ac86-9f0c-4a8c-ac3f-35b7a747a0e6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:25.117968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:25.164608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36e0c1-24b5-4e6e-b75c-510028e5473a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:25.165999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0ac86-9f0c-4a8c-ac3f-35b7a747a0e6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:25.198373 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262884d-85f0-4777-9cfc-161fd9f827de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:25.198531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084b78b-d876-498f-aa11-3a0e85f7b880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:25.199072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084b78b-d876-498f-aa11-3a0e85f7b880 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:25.199173 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262884d-85f0-4777-9cfc-161fd9f827de None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:25.199355 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084b78b-d876-498f-aa11-3a0e85f7b880 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:25.199452 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262884d-85f0-4777-9cfc-161fd9f827de None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:25.199632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084b78b-d876-498f-aa11-3a0e85f7b880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:25.199731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262884d-85f0-4777-9cfc-161fd9f827de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:25.200475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084b78b-d876-498f-aa11-3a0e85f7b880 None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=b007b4f89cb74f898cbd2e8eb9919989, user.id=ee416b30e08e4d1f9592d88ed0e4f51d) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:25.200789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084b78b-d876-498f-aa11-3a0e85f7b880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:25.202339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084b78b-d876-498f-aa11-3a0e85f7b880 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:25.208071 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 102/200] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:25 2022] GET /identity/v3/role_assignments?user.id=ee416b30e08e4d1f9592d88ed0e4f51d&scope.project.id=b007b4f89cb74f898cbd2e8eb9919989&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:25.208840 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084b78b-d876-498f-aa11-3a0e85f7b880 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:25.209910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262884d-85f0-4777-9cfc-161fd9f827de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:25.218273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-0262884d-85f0-4777-9cfc-161fd9f827de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:25.218273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:25.218273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:25.218273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:25.218273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:25.218273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:25.218273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:25.218273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:25.218273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:25.218273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:25.218273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:25.218273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:25.218273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:25.218273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:25.218273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:25.218273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:25.219244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:25.219244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:25.219244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:25.219244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:25.219244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:25.219244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:25.219244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:25.219244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:25.219244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:25.219244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:25.219244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:25.219244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:25.219244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:25.219244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:25.219244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:25.219244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:25.220044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:25.220044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:25.220044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:25.220044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:25.220044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:25.220044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:25.220044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:25.220044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:25.220044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:25.220044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:25.220044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:25.220044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:25.220044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 99/201] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:25.220709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262884d-85f0-4777-9cfc-161fd9f827de None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:25.257752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:25.330800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084b78b-d876-498f-aa11-3a0e85f7b880 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:25.340865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262884d-85f0-4777-9cfc-161fd9f827de None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:25.352908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:25.373502 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d733cb5-0f00-44cc-8b22-a95a32721b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:25.374195 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733cb5-0f00-44cc-8b22-a95a32721b83 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:25.374455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733cb5-0f00-44cc-8b22-a95a32721b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:25.374455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733cb5-0f00-44cc-8b22-a95a32721b83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:25.375604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d733cb5-0f00-44cc-8b22-a95a32721b83 None admin] RBAC: Adding query filter params (role.id=1be1544572744e849ed04df01cdca3fb, scope.project.id=b007b4f89cb74f898cbd2e8eb9919989, user.id=ee416b30e08e4d1f9592d88ed0e4f51d) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:25.375908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d733cb5-0f00-44cc-8b22-a95a32721b83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:25.377390 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d733cb5-0f00-44cc-8b22-a95a32721b83 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:25.379965 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab847d-5985-4338-a38c-4afbd5b85cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:25.380815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab847d-5985-4338-a38c-4afbd5b85cb6 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:25.381270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab847d-5985-4338-a38c-4afbd5b85cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:25.381588 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab847d-5985-4338-a38c-4afbd5b85cb6 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:25.382316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab847d-5985-4338-a38c-4afbd5b85cb6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:25.383769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab847d-5985-4338-a38c-4afbd5b85cb6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:25.385003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 103/202] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:25 2022] GET /identity/v3/role_assignments?user.id=ee416b30e08e4d1f9592d88ed0e4f51d&scope.project.id=b007b4f89cb74f898cbd2e8eb9919989&role.id=1be1544572744e849ed04df01cdca3fb => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:25.385644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d733cb5-0f00-44cc-8b22-a95a32721b83 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:25.425467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 100/203] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:21:25 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:21:25.511922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d733cb5-0f00-44cc-8b22-a95a32721b83 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:25.554029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b820f22-d46d-428c-879f-0c5e96274428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:25.554994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b820f22-d46d-428c-879f-0c5e96274428 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:25.555416 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b820f22-d46d-428c-879f-0c5e96274428 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:25.555953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b820f22-d46d-428c-879f-0c5e96274428 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:25.556897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b820f22-d46d-428c-879f-0c5e96274428 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:25.557388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b820f22-d46d-428c-879f-0c5e96274428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:25.559039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b820f22-d46d-428c-879f-0c5e96274428 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:25.570309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 104/204] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:25.578570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab847d-5985-4338-a38c-4afbd5b85cb6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:25.674162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:25.696153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab847d-5985-4338-a38c-4afbd5b85cb6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:25.731562 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62705d8e-39b1-45ad-9eb3-d81d81848d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:25.732476 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62705d8e-39b1-45ad-9eb3-d81d81848d2a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:25.732764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62705d8e-39b1-45ad-9eb3-d81d81848d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:25.733135 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62705d8e-39b1-45ad-9eb3-d81d81848d2a None admin] PATH_INFO: `/v3/users/e672113ca42f487688a9f65953e86c80` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:25.734395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62705d8e-39b1-45ad-9eb3-d81d81848d2a None admin] RBAC: Authorizing `identity:get_user(user_id=e672113ca42f487688a9f65953e86c80)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:25.735881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62705d8e-39b1-45ad-9eb3-d81d81848d2a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:25.737876 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 101/205] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:25 2022] GET /identity/v3/users/e672113ca42f487688a9f65953e86c80 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:25.743606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b820f22-d46d-428c-879f-0c5e96274428 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:25.796344 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:25.855896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b820f22-d46d-428c-879f-0c5e96274428 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:25.892754 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9eb03d-dcea-4bc9-974c-df397899bfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:25.893452 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eb03d-dcea-4bc9-974c-df397899bfb8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:25.893738 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eb03d-dcea-4bc9-974c-df397899bfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:25.894016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9eb03d-dcea-4bc9-974c-df397899bfb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:25.994482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9eb03d-dcea-4bc9-974c-df397899bfb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:25.996175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9eb03d-dcea-4bc9-974c-df397899bfb8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:26.054856 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:26.138865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 105/206] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 00:21:26.144882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62705d8e-39b1-45ad-9eb3-d81d81848d2a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:26.295355 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62705d8e-39b1-45ad-9eb3-d81d81848d2a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:26.342993 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e0091-2649-42ae-9122-4ce37c0d793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:26.343888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e0091-2649-42ae-9122-4ce37c0d793d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:26.344181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e0091-2649-42ae-9122-4ce37c0d793d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:26.344460 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e0091-2649-42ae-9122-4ce37c0d793d None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:26.345708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e0091-2649-42ae-9122-4ce37c0d793d None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:26.347179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e0091-2649-42ae-9122-4ce37c0d793d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:26.349222 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 102/207] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:26 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:26.355128 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9eb03d-dcea-4bc9-974c-df397899bfb8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:26.485474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9eb03d-dcea-4bc9-974c-df397899bfb8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:26.531228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13d0fb-2138-46a3-969b-8bf234c3343a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:26.531894 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13d0fb-2138-46a3-969b-8bf234c3343a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:26.532182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13d0fb-2138-46a3-969b-8bf234c3343a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:26.532460 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13d0fb-2138-46a3-969b-8bf234c3343a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:26.533304 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13d0fb-2138-46a3-969b-8bf234c3343a None admin] RBAC: Adding query filter params (role.id=52f18795c489403f89e3036b0cdd3dd8, scope.project.id=a82bf7161bd44f5e83eae52981f952ab, user.id=e672113ca42f487688a9f65953e86c80) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:26.533660 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13d0fb-2138-46a3-969b-8bf234c3343a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:26.535106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13d0fb-2138-46a3-969b-8bf234c3343a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:26.541448 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 106/208] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:26 2022] GET /identity/v3/role_assignments?user.id=e672113ca42f487688a9f65953e86c80&scope.project.id=a82bf7161bd44f5e83eae52981f952ab&role.id=52f18795c489403f89e3036b0cdd3dd8 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:27.440837 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f557e-561f-43c9-b4f8-fa78b57d1c00 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:27.441331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f557e-561f-43c9-b4f8-fa78b57d1c00 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:27.441331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f557e-561f-43c9-b4f8-fa78b57d1c00 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:27.442724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 103/209] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:27.448218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf9d36-12db-44db-8464-9a8a36b41322 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:27.448664 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf9d36-12db-44db-8464-9a8a36b41322 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:27.448833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf9d36-12db-44db-8464-9a8a36b41322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:27.466574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-f9bf9d36-12db-44db-8464-9a8a36b41322 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:27.467763 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f9bf9d36-12db-44db-8464-9a8a36b41322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:27.469845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:27.535838 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 107/210] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:27.558281 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f557e-561f-43c9-b4f8-fa78b57d1c00 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:27.578898 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:27.647464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcb555-03ec-4b10-882f-a829ad203856 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:27.647791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcb555-03ec-4b10-882f-a829ad203856 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:27.648031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcb555-03ec-4b10-882f-a829ad203856 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:27.649649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 108/211] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:27.654572 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb1f1c-8cba-40fa-a3e3-0fabcb5e15f2 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:27.654892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb1f1c-8cba-40fa-a3e3-0fabcb5e15f2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:27.655145 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb1f1c-8cba-40fa-a3e3-0fabcb5e15f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:27.670451 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f557e-561f-43c9-b4f8-fa78b57d1c00 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:27.672962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1bcb1f1c-8cba-40fa-a3e3-0fabcb5e15f2 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:27.674182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1bcb1f1c-8cba-40fa-a3e3-0fabcb5e15f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:27.711717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56258894-9339-4614-847a-7ceb883b5dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:27.712564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56258894-9339-4614-847a-7ceb883b5dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:27.712848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56258894-9339-4614-847a-7ceb883b5dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:27.713128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56258894-9339-4614-847a-7ceb883b5dc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:27.724743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56258894-9339-4614-847a-7ceb883b5dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:27.732111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-56258894-9339-4614-847a-7ceb883b5dc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:27.732111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:27.732111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:27.732111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:27.732111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:27.732111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:27.732111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:27.732111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:27.732111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:27.732111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:27.732111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:27.732111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:27.732111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:27.732111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:27.732111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:27.732111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:27.733020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:27.733020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:27.733020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:27.733020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:27.733020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:27.733020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:27.733020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:27.733020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:27.733020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:27.733020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:27.733020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:27.733020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:27.733020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:27.733020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:27.733020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:27.733020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:27.737913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:27.737913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:27.737913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:27.737913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:27.737913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:27.737913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:27.737913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:27.737913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:27.737913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:27.737913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:27.737913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:27.737913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:27.737913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 104/212] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:21:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:27.739972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56258894-9339-4614-847a-7ceb883b5dc6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:27.766600 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 109/213] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:27.794018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb1f1c-8cba-40fa-a3e3-0fabcb5e15f2 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:27.842589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:27.868581 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56258894-9339-4614-847a-7ceb883b5dc6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:27.875830 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:27.905834 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b908895-ceaa-4f45-8f50-3dd8ccd710dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:27.906764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b908895-ceaa-4f45-8f50-3dd8ccd710dc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:27.907230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b908895-ceaa-4f45-8f50-3dd8ccd710dc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:27.907681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b908895-ceaa-4f45-8f50-3dd8ccd710dc None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:27.908741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b908895-ceaa-4f45-8f50-3dd8ccd710dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:27.909288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b908895-ceaa-4f45-8f50-3dd8ccd710dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:27.910880 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b908895-ceaa-4f45-8f50-3dd8ccd710dc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:27.919064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb1f1c-8cba-40fa-a3e3-0fabcb5e15f2 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:27.920982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 105/214] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:27.928730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b908895-ceaa-4f45-8f50-3dd8ccd710dc None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:27.964569 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976a8be-565e-4ae6-9c19-a11523ed2d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:27.965361 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976a8be-565e-4ae6-9c19-a11523ed2d3d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:27.965654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976a8be-565e-4ae6-9c19-a11523ed2d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:27.965935 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976a8be-565e-4ae6-9c19-a11523ed2d3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:27.980133 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976a8be-565e-4ae6-9c19-a11523ed2d3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:27.991653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c976a8be-565e-4ae6-9c19-a11523ed2d3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:27.991653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:27.991653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:27.991653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:27.991653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:27.991653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:27.991653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:27.991653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:27.991653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:27.991653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:27.991653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:27.991653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:27.991653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:27.991653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:27.991653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:27.991653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:27.992619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:27.992619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:27.992619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:27.992619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:27.992619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:27.992619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:27.992619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:27.992619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:27.992619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:27.992619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:27.992619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:27.992619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:27.992619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:27.992619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:27.992619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:27.992619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:27.993953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:27.993953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:27.993953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:27.993953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:27.993953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:27.993953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:27.993953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:27.993953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:27.993953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:27.993953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:27.993953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:27.993953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:27.997453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 110/215] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:21:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:21:28.000322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976a8be-565e-4ae6-9c19-a11523ed2d3d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:28.055858 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b908895-ceaa-4f45-8f50-3dd8ccd710dc None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:28.095719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfc14a-a2ae-4ade-b183-e29aa1a8c2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:28.096618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc14a-a2ae-4ade-b183-e29aa1a8c2ec None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:28.096897 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc14a-a2ae-4ade-b183-e29aa1a8c2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:28.097187 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc14a-a2ae-4ade-b183-e29aa1a8c2ec None admin] PATH_INFO: `/v3/users/ee416b30e08e4d1f9592d88ed0e4f51d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:28.098417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfc14a-a2ae-4ade-b183-e29aa1a8c2ec None admin] RBAC: Authorizing `identity:get_user(user_id=ee416b30e08e4d1f9592d88ed0e4f51d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:28.099879 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfc14a-a2ae-4ade-b183-e29aa1a8c2ec None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:28.106294 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 106/216] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:27 2022] GET /identity/v3/users/ee416b30e08e4d1f9592d88ed0e4f51d => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:28.107582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72029649-461b-4906-80a3-bf98e54607b6 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:28.107875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72029649-461b-4906-80a3-bf98e54607b6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:28.108157 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72029649-461b-4906-80a3-bf98e54607b6 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:28.109445 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 107/217] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:28.110138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72029649-461b-4906-80a3-bf98e54607b6 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:28.120467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:28.120839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976a8be-565e-4ae6-9c19-a11523ed2d3d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:28.148635 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:28.157476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7704373-6c8d-4279-9236-a940c401b80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:28.158302 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7704373-6c8d-4279-9236-a940c401b80c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:28.158592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7704373-6c8d-4279-9236-a940c401b80c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:28.158940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7704373-6c8d-4279-9236-a940c401b80c None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:28.159718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7704373-6c8d-4279-9236-a940c401b80c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:28.160030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7704373-6c8d-4279-9236-a940c401b80c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:28.161450 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7704373-6c8d-4279-9236-a940c401b80c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:28.170289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 111/218] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:21:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:28.175909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0fabb-d788-4ea1-9a44-9c61a0dcf429 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:28.176198 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0fabb-d788-4ea1-9a44-9c61a0dcf429 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:28.176477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0fabb-d788-4ea1-9a44-9c61a0dcf429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:28.194473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5dc0fabb-d788-4ea1-9a44-9c61a0dcf429 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:28.195660 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5dc0fabb-d788-4ea1-9a44-9c61a0dcf429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:28.223031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72029649-461b-4906-80a3-bf98e54607b6 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:28.260888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa6768-c541-4d76-b86c-31c45195fb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:28.261823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa6768-c541-4d76-b86c-31c45195fb7f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:28.262112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa6768-c541-4d76-b86c-31c45195fb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:28.262398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa6768-c541-4d76-b86c-31c45195fb7f None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:28.263637 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa6768-c541-4d76-b86c-31c45195fb7f None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:28.269894 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 112/219] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:28.269894 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0fabb-d788-4ea1-9a44-9c61a0dcf429 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:28.270184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa6768-c541-4d76-b86c-31c45195fb7f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:28.270184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 108/220] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:28 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:28.277383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa6768-c541-4d76-b86c-31c45195fb7f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:28.355067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:28.379180 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0fabb-d788-4ea1-9a44-9c61a0dcf429 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:28.381247 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa6768-c541-4d76-b86c-31c45195fb7f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:28.398977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:28.412611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecbd7d-1f8d-4dbb-a660-e895920f5af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:28.413560 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecbd7d-1f8d-4dbb-a660-e895920f5af7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:28.413846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecbd7d-1f8d-4dbb-a660-e895920f5af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:28.414164 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecbd7d-1f8d-4dbb-a660-e895920f5af7 None admin] PATH_INFO: `/v3/users/ee416b30e08e4d1f9592d88ed0e4f51d` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:28.414644 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ffe2a2-0ef2-4f9f-a9a5-3a410329b99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:28.415399 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecbd7d-1f8d-4dbb-a660-e895920f5af7 None admin] RBAC: Authorizing `identity:get_user(user_id=ee416b30e08e4d1f9592d88ed0e4f51d)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:28.415605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffe2a2-0ef2-4f9f-a9a5-3a410329b99f None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:28.415890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffe2a2-0ef2-4f9f-a9a5-3a410329b99f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:28.416172 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ffe2a2-0ef2-4f9f-a9a5-3a410329b99f None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989/users/ee416b30e08e4d1f9592d88ed0e4f51d/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:28.416890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecbd7d-1f8d-4dbb-a660-e895920f5af7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:28.418111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffe2a2-0ef2-4f9f-a9a5-3a410329b99f None admin] RBAC: Authorizing `identity:create_grant(project_id=b007b4f89cb74f898cbd2e8eb9919989, user_id=ee416b30e08e4d1f9592d88ed0e4f51d, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:28.418579 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 113/221] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:28 2022] GET /identity/v3/users/ee416b30e08e4d1f9592d88ed0e4f51d => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:28.419345 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecbd7d-1f8d-4dbb-a660-e895920f5af7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:28.423425 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ffe2a2-0ef2-4f9f-a9a5-3a410329b99f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:28.437314 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 109/222] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:21:28 2022] PUT /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989/users/ee416b30e08e4d1f9592d88ed0e4f51d/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:21:28.442896 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29f7f-7806-48d3-b719-9dade1f51fca None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:28.443523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29f7f-7806-48d3-b719-9dade1f51fca None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:28.443523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29f7f-7806-48d3-b719-9dade1f51fca None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:28.445049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 110/223] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:28.449859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b29f7f-7806-48d3-b719-9dade1f51fca None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:28.543035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecbd7d-1f8d-4dbb-a660-e895920f5af7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:28.576057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b29f7f-7806-48d3-b719-9dade1f51fca None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:28.592276 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e4c35-0f7f-43be-9c2d-fc8b34b288b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:28.593587 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e4c35-0f7f-43be-9c2d-fc8b34b288b2 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:28.593876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e4c35-0f7f-43be-9c2d-fc8b34b288b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:28.594316 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e4c35-0f7f-43be-9c2d-fc8b34b288b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:28.610888 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e4c35-0f7f-43be-9c2d-fc8b34b288b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:28.616592 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e1c2f-c0ad-4070-84a0-c017d5c5e03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:28.617509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e1c2f-c0ad-4070-84a0-c017d5c5e03d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:28.617783 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e1c2f-c0ad-4070-84a0-c017d5c5e03d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:28.618058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e1c2f-c0ad-4070-84a0-c017d5c5e03d None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:28.619323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e1c2f-c0ad-4070-84a0-c017d5c5e03d None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:28.619476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-5a4e4c35-0f7f-43be-9c2d-fc8b34b288b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:28.619476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:28.619476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:28.619476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:28.619476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:28.619476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:28.619476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:28.619476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:28.619476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:28.619476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:28.619476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:28.619476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:28.619476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:28.619476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:28.619476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:28.619476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:28.620322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:28.620322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:28.620322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:28.620322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:28.620322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:28.620322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:28.620322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:28.620322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:28.620322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:28.620322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:28.620322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:28.620322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:28.620322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:28.620322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:28.620322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:28.620322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:28.621127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:28.621127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:28.621127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:28.621127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:28.621127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:28.621127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:28.621127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:28.621127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:28.621127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:28.621127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:28.621127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:28.621127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:28.621781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e1c2f-c0ad-4070-84a0-c017d5c5e03d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:28.621848 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 114/224] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:28.622450 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0fa71-5c45-4f33-bdc2-bd84c3dc8619 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:28.622450 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0fa71-5c45-4f33-bdc2-bd84c3dc8619 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:28.622615 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 111/225] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:28 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:28.622973 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0fa71-5c45-4f33-bdc2-bd84c3dc8619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:28.626964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e1c2f-c0ad-4070-84a0-c017d5c5e03d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:28.630612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:28.640654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-03f0fa71-5c45-4f33-bdc2-bd84c3dc8619 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:28.641901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-03f0fa71-5c45-4f33-bdc2-bd84c3dc8619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:28.688509 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:28.717490 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 115/226] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:28.718345 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0fa71-5c45-4f33-bdc2-bd84c3dc8619 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:28.745224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e1c2f-c0ad-4070-84a0-c017d5c5e03d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:28.783449 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ad96e-767a-4fd6-af95-99325f1e7aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:28.784128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ad96e-767a-4fd6-af95-99325f1e7aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:28.784409 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ad96e-767a-4fd6-af95-99325f1e7aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:28.784821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ad96e-767a-4fd6-af95-99325f1e7aa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:28.785615 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ad96e-767a-4fd6-af95-99325f1e7aa9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:28.785928 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ad96e-767a-4fd6-af95-99325f1e7aa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:28.787310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ad96e-767a-4fd6-af95-99325f1e7aa9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:28.795979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 112/227] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:28.796535 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ad96e-767a-4fd6-af95-99325f1e7aa9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:28.820625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0fa71-5c45-4f33-bdc2-bd84c3dc8619 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:28.858835 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15a85a-4107-43a0-b3c1-2518e1b5edfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:28.859797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15a85a-4107-43a0-b3c1-2518e1b5edfa None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:28.860252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15a85a-4107-43a0-b3c1-2518e1b5edfa None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:28.860360 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15a85a-4107-43a0-b3c1-2518e1b5edfa None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989/users/ee416b30e08e4d1f9592d88ed0e4f51d/roles/1be1544572744e849ed04df01cdca3fb` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:28.860840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:28.863207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15a85a-4107-43a0-b3c1-2518e1b5edfa None admin] RBAC: Authorizing `identity:create_grant(project_id=b007b4f89cb74f898cbd2e8eb9919989, user_id=ee416b30e08e4d1f9592d88ed0e4f51d, role_id=1be1544572744e849ed04df01cdca3fb)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:28.864793 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e15a85a-4107-43a0-b3c1-2518e1b5edfa None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:28.889390 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 116/228] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:21:28 2022] PUT /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989/users/ee416b30e08e4d1f9592d88ed0e4f51d/roles/1be1544572744e849ed04df01cdca3fb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:28.889390 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15a85a-4107-43a0-b3c1-2518e1b5edfa None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:28.913245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ad96e-767a-4fd6-af95-99325f1e7aa9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:28.942735 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:28.954638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6200635-cc74-4a27-9dfc-919b4aacbe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:28.955523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6200635-cc74-4a27-9dfc-919b4aacbe76 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:28.955812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6200635-cc74-4a27-9dfc-919b4aacbe76 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:28.956132 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6200635-cc74-4a27-9dfc-919b4aacbe76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:28.957426 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6200635-cc74-4a27-9dfc-919b4aacbe76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:28.958988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6200635-cc74-4a27-9dfc-919b4aacbe76 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:28.961119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 113/229] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:28.967258 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6200635-cc74-4a27-9dfc-919b4aacbe76 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:29.025883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15a85a-4107-43a0-b3c1-2518e1b5edfa None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:29.083226 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d881b8-6186-4343-8d4a-6fd19f770b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:29.084750 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d881b8-6186-4343-8d4a-6fd19f770b81 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:29.085496 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d881b8-6186-4343-8d4a-6fd19f770b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:29.086365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d881b8-6186-4343-8d4a-6fd19f770b81 None admin] PATH_INFO: `/v3/users/49c986155b2343d5b20cb68f24342a1a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:29.092420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6200635-cc74-4a27-9dfc-919b4aacbe76 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:29.102929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d881b8-6186-4343-8d4a-6fd19f770b81 None admin] RBAC: Authorizing `identity:get_user(user_id=49c986155b2343d5b20cb68f24342a1a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:29.104698 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d881b8-6186-4343-8d4a-6fd19f770b81 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:29.106775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 117/230] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:28 2022] GET /identity/v3/users/49c986155b2343d5b20cb68f24342a1a => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:29.112491 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d881b8-6186-4343-8d4a-6fd19f770b81 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:29.141571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0396a0e-1782-4923-93ca-2eb119c48044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:29.142577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396a0e-1782-4923-93ca-2eb119c48044 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:29.142862 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396a0e-1782-4923-93ca-2eb119c48044 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:29.143189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396a0e-1782-4923-93ca-2eb119c48044 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:29.144561 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0396a0e-1782-4923-93ca-2eb119c48044 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:29.146548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0396a0e-1782-4923-93ca-2eb119c48044 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:29.157745 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:29.177458 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 114/231] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:21:28 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:21:29.235081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:29.242282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d881b8-6186-4343-8d4a-6fd19f770b81 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:29.282258 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121dcec-badb-421f-a62f-932eb3b9071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:29.282942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121dcec-badb-421f-a62f-932eb3b9071e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:29.283224 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121dcec-badb-421f-a62f-932eb3b9071e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:29.283498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121dcec-badb-421f-a62f-932eb3b9071e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:29.357113 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121dcec-badb-421f-a62f-932eb3b9071e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:29.358624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121dcec-badb-421f-a62f-932eb3b9071e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:29.469841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:29.477825 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 118/232] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:29.483539 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0396a0e-1782-4923-93ca-2eb119c48044 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:29.619833 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0396a0e-1782-4923-93ca-2eb119c48044 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:29.665488 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce95f6-0446-4836-8435-ede4a16fecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:29.666767 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce95f6-0446-4836-8435-ede4a16fecab None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:29.667275 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce95f6-0446-4836-8435-ede4a16fecab None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:29.667749 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce95f6-0446-4836-8435-ede4a16fecab None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:29.669156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce95f6-0446-4836-8435-ede4a16fecab None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:29.670869 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce95f6-0446-4836-8435-ede4a16fecab None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:29.672817 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 115/233] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:29 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:29.679101 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121dcec-badb-421f-a62f-932eb3b9071e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:29.785295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121dcec-badb-421f-a62f-932eb3b9071e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:29.824476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a035ab-efa5-4718-9c8b-a859c68de74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:29.825155 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a035ab-efa5-4718-9c8b-a859c68de74e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:29.825467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a035ab-efa5-4718-9c8b-a859c68de74e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:29.825745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a035ab-efa5-4718-9c8b-a859c68de74e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:29.826588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a035ab-efa5-4718-9c8b-a859c68de74e None admin] RBAC: Adding query filter params (role.id=5dd696285c0b41d3acb854981774eaae, scope.project.id=b007b4f89cb74f898cbd2e8eb9919989, user.id=49c986155b2343d5b20cb68f24342a1a) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:29.826901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a035ab-efa5-4718-9c8b-a859c68de74e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:29.828360 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a035ab-efa5-4718-9c8b-a859c68de74e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:29.837667 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 119/234] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:29 2022] GET /identity/v3/role_assignments?user.id=49c986155b2343d5b20cb68f24342a1a&scope.project.id=b007b4f89cb74f898cbd2e8eb9919989&role.id=5dd696285c0b41d3acb854981774eaae => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:30.870030 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548e627-ba08-4e06-a96b-f813d5bc4a8c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:30.871069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548e627-ba08-4e06-a96b-f813d5bc4a8c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:30.871559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548e627-ba08-4e06-a96b-f813d5bc4a8c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:30.873493 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 116/235] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:30.878704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4b9b0-f577-4019-9ec1-2e3360c235f0 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:30.879522 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4b9b0-f577-4019-9ec1-2e3360c235f0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:30.880002 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4b9b0-f577-4019-9ec1-2e3360c235f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:30.901691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-08c4b9b0-f577-4019-9ec1-2e3360c235f0 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:30.903221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-08c4b9b0-f577-4019-9ec1-2e3360c235f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:30.971285 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:30.991425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 120/236] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:31.026058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548e627-ba08-4e06-a96b-f813d5bc4a8c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:31.102822 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:31.166034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548e627-ba08-4e06-a96b-f813d5bc4a8c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:31.208159 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baac122-dbd4-42d0-b1e0-51fb7275b7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:31.208979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baac122-dbd4-42d0-b1e0-51fb7275b7ff None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:31.209265 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baac122-dbd4-42d0-b1e0-51fb7275b7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:31.209568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baac122-dbd4-42d0-b1e0-51fb7275b7ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:31.230192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baac122-dbd4-42d0-b1e0-51fb7275b7ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:31.237988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-1baac122-dbd4-42d0-b1e0-51fb7275b7ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:31.237988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:31.237988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:31.237988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:31.237988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:31.237988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:31.237988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:31.237988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:31.237988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:31.237988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:31.237988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:31.237988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:31.237988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:31.237988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:31.237988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:31.237988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:31.238857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:31.238857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:31.238857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:31.238857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:31.238857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:31.238857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:31.238857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:31.238857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:31.238857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:31.238857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:31.238857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:31.238857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:31.238857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:31.238857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:31.238857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:31.238857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:31.239661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:31.239661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:31.239661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:31.239661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:31.239661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:31.239661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:31.239661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:31.239661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:31.239661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:31.239661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:31.239661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:31.239661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:31.239661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 117/237] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:21:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:31.245417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4b9b0-f577-4019-9ec1-2e3360c235f0 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:31.382417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4b9b0-f577-4019-9ec1-2e3360c235f0 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:31.432592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93ddb1-edcf-467e-b96d-6105f84cc04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:31.433216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93ddb1-edcf-467e-b96d-6105f84cc04f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:31.433546 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93ddb1-edcf-467e-b96d-6105f84cc04f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:31.433833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93ddb1-edcf-467e-b96d-6105f84cc04f None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:31.434613 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93ddb1-edcf-467e-b96d-6105f84cc04f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:31.434927 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93ddb1-edcf-467e-b96d-6105f84cc04f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:31.436332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93ddb1-edcf-467e-b96d-6105f84cc04f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:31.449290 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 121/238] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:31.454712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baac122-dbd4-42d0-b1e0-51fb7275b7ff None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:31.596157 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baac122-dbd4-42d0-b1e0-51fb7275b7ff None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:31.616479 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:31.645550 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60e780-4c62-4f5c-a8ff-aa931665bf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:31.646460 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60e780-4c62-4f5c-a8ff-aa931665bf18 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:31.646745 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60e780-4c62-4f5c-a8ff-aa931665bf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:31.647023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60e780-4c62-4f5c-a8ff-aa931665bf18 None admin] PATH_INFO: `/v3/users/ee416b30e08e4d1f9592d88ed0e4f51d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:31.648254 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60e780-4c62-4f5c-a8ff-aa931665bf18 None admin] RBAC: Authorizing `identity:get_user(user_id=ee416b30e08e4d1f9592d88ed0e4f51d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:31.649868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60e780-4c62-4f5c-a8ff-aa931665bf18 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:31.651539 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 118/239] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:31 2022] GET /identity/v3/users/ee416b30e08e4d1f9592d88ed0e4f51d => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:31.657098 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93ddb1-edcf-467e-b96d-6105f84cc04f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:31.697249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123a4fd-7ae6-41dd-90dd-5703e1229909 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:31.697488 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123a4fd-7ae6-41dd-90dd-5703e1229909 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:31.697766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123a4fd-7ae6-41dd-90dd-5703e1229909 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:31.699473 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 119/240] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:31.715057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafc09b-d8ab-4006-92e6-ab2885499378 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:31.716725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafc09b-d8ab-4006-92e6-ab2885499378 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:31.717953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafc09b-d8ab-4006-92e6-ab2885499378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:31.742596 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7cafc09b-d8ab-4006-92e6-ab2885499378 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:31.744106 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7cafc09b-d8ab-4006-92e6-ab2885499378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:31.749475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:31.809993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93ddb1-edcf-467e-b96d-6105f84cc04f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:31.821323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 120/241] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:31.826582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e6f52-2e3b-4cb5-95d4-d19b32e37bfc None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:31.827570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e6f52-2e3b-4cb5-95d4-d19b32e37bfc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:31.828127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e6f52-2e3b-4cb5-95d4-d19b32e37bfc None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:31.829438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 121/242] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:31.838693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734ff2d-8953-4f2c-a000-7f8c2e0a5a80 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:31.838908 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734ff2d-8953-4f2c-a000-7f8c2e0a5a80 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:31.839186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734ff2d-8953-4f2c-a000-7f8c2e0a5a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:31.862034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8734ff2d-8953-4f2c-a000-7f8c2e0a5a80 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:31.863250 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8734ff2d-8953-4f2c-a000-7f8c2e0a5a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:31.864326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f0d45-d3d1-490c-9882-88cb97f132a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:31.865305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f0d45-d3d1-490c-9882-88cb97f132a7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:31.866272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f0d45-d3d1-490c-9882-88cb97f132a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:31.866764 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f0d45-d3d1-490c-9882-88cb97f132a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:31.945041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f0d45-d3d1-490c-9882-88cb97f132a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:31.946879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f0d45-d3d1-490c-9882-88cb97f132a7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:31.952619 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 122/243] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:31.952619 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734ff2d-8953-4f2c-a000-7f8c2e0a5a80 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:32.001386 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:32.008550 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:32.057399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734ff2d-8953-4f2c-a000-7f8c2e0a5a80 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:32.059441 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 122/244] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:32.060645 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bf54d-b506-4d80-9a60-b0a30999e5b1 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:32.060942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bf54d-b506-4d80-9a60-b0a30999e5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:32.061220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bf54d-b506-4d80-9a60-b0a30999e5b1 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:32.066739 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 123/245] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:32.066739 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bf54d-b506-4d80-9a60-b0a30999e5b1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:32.106360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffeb8d-202a-47ab-be39-500424997a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:32.107204 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffeb8d-202a-47ab-be39-500424997a6f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:32.107495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffeb8d-202a-47ab-be39-500424997a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:32.107773 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffeb8d-202a-47ab-be39-500424997a6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:32.122780 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffeb8d-202a-47ab-be39-500424997a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:32.132251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-74ffeb8d-202a-47ab-be39-500424997a6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:32.132251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:32.132251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:32.132251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:32.132251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:32.132251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:32.132251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:32.132251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:32.132251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:32.132251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:32.132251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:32.132251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:32.132251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:32.132251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:32.132251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:32.132251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:32.133280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:32.133280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:32.133280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:32.133280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:32.133280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:32.133280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:32.133280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:32.133280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:32.133280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:32.133280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:32.133280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:32.133280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:32.133280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:32.133280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:32.133280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:32.133280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:32.134221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:32.134221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:32.134221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:32.134221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:32.134221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:32.134221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:32.134221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:32.134221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:32.134221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:32.134221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:32.134221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:32.134221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:32.134221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 123/246] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:21:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:32.134870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffeb8d-202a-47ab-be39-500424997a6f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:32.178244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bf54d-b506-4d80-9a60-b0a30999e5b1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:32.216416 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ef5aa-6c1b-486f-825d-68bf664445b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:32.217265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ef5aa-6c1b-486f-825d-68bf664445b6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:32.217618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ef5aa-6c1b-486f-825d-68bf664445b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:32.217896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ef5aa-6c1b-486f-825d-68bf664445b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:32.219520 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ef5aa-6c1b-486f-825d-68bf664445b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:32.221495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ef5aa-6c1b-486f-825d-68bf664445b6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:32.223151 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 124/247] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:32.224300 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb3ba3-4956-477c-ba3d-a7573937635a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:32.224587 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb3ba3-4956-477c-ba3d-a7573937635a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:32.224864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb3ba3-4956-477c-ba3d-a7573937635a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:32.243363 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-99cb3ba3-4956-477c-ba3d-a7573937635a None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:32.244678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-99cb3ba3-4956-477c-ba3d-a7573937635a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:32.259031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffeb8d-202a-47ab-be39-500424997a6f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:32.260378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:32.262274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:32.295227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181648fd-9c96-43bb-8f0d-2c2b621b3ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:32.296109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181648fd-9c96-43bb-8f0d-2c2b621b3ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:32.296395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181648fd-9c96-43bb-8f0d-2c2b621b3ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:32.296672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181648fd-9c96-43bb-8f0d-2c2b621b3ab2 None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:32.297887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181648fd-9c96-43bb-8f0d-2c2b621b3ab2 None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:32.299374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181648fd-9c96-43bb-8f0d-2c2b621b3ab2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:32.301098 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 124/248] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:32 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:32.301879 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181648fd-9c96-43bb-8f0d-2c2b621b3ab2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:32.333365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 125/249] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:32.333365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb3ba3-4956-477c-ba3d-a7573937635a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:32.421674 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181648fd-9c96-43bb-8f0d-2c2b621b3ab2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:32.432798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb3ba3-4956-477c-ba3d-a7573937635a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:32.461159 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e64f5-45cc-441d-911f-eca564f63032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:32.462160 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e64f5-45cc-441d-911f-eca564f63032 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:32.462600 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e64f5-45cc-441d-911f-eca564f63032 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:32.462869 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e64f5-45cc-441d-911f-eca564f63032 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:32.463618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e64f5-45cc-441d-911f-eca564f63032 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:32.464017 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e64f5-45cc-441d-911f-eca564f63032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:32.465707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e64f5-45cc-441d-911f-eca564f63032 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:32.466898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599a155-7ebc-4138-91da-cab494d90b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:32.467574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599a155-7ebc-4138-91da-cab494d90b6a None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:32.467859 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599a155-7ebc-4138-91da-cab494d90b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:32.468110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599a155-7ebc-4138-91da-cab494d90b6a None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:32.468850 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599a155-7ebc-4138-91da-cab494d90b6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:32.470405 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599a155-7ebc-4138-91da-cab494d90b6a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:32.476073 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 125/250] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:21:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:32.477278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e64f5-45cc-441d-911f-eca564f63032 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:32.505404 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 126/251] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:21:32 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:21:32.505404 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599a155-7ebc-4138-91da-cab494d90b6a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:32.515979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:32.534713 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:32.616167 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e64f5-45cc-441d-911f-eca564f63032 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:32.629151 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599a155-7ebc-4138-91da-cab494d90b6a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:32.656155 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258d070-5acb-4daf-967f-559c55057169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:32.656838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258d070-5acb-4daf-967f-559c55057169 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:32.657119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258d070-5acb-4daf-967f-559c55057169 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:32.657427 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258d070-5acb-4daf-967f-559c55057169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:32.658299 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258d070-5acb-4daf-967f-559c55057169 None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=b007b4f89cb74f898cbd2e8eb9919989, user.id=ee416b30e08e4d1f9592d88ed0e4f51d) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:32.658620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258d070-5acb-4daf-967f-559c55057169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:32.660088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258d070-5acb-4daf-967f-559c55057169 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:32.666926 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d24e1-90cc-4bd8-a9d0-642691e11a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:32.667109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 126/252] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:32 2022] GET /identity/v3/role_assignments?user.id=ee416b30e08e4d1f9592d88ed0e4f51d&scope.project.id=b007b4f89cb74f898cbd2e8eb9919989&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:32.667308 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258d070-5acb-4daf-967f-559c55057169 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:32.667401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d24e1-90cc-4bd8-a9d0-642691e11a04 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:32.667656 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d24e1-90cc-4bd8-a9d0-642691e11a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:32.667990 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d24e1-90cc-4bd8-a9d0-642691e11a04 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:32.681160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d24e1-90cc-4bd8-a9d0-642691e11a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:32.691691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-b38d24e1-90cc-4bd8-a9d0-642691e11a04 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:32.691691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:32.691691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:32.691691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:32.691691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:32.691691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:32.691691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:32.691691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:32.691691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:32.691691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:32.691691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:32.691691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:32.691691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:32.691691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:32.691691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:32.691691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:32.692749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:32.692749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:32.692749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:32.692749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:32.692749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:32.692749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:32.692749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:32.692749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:32.692749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:32.692749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:32.692749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:32.692749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:32.692749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:32.692749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:32.692749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:32.692749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:32.693962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:32.693962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:32.693962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:32.693962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:32.693962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:32.693962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:32.693962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:32.693962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:32.693962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:32.693962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:32.693962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:32.693962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:32.695187 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 127/253] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:32.696866 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2b210-3cff-4ad1-8c46-288a779409e1 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:32.697143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2b210-3cff-4ad1-8c46-288a779409e1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:32.697465 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2b210-3cff-4ad1-8c46-288a779409e1 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:32.699155 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 128/254] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:32.701276 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2b210-3cff-4ad1-8c46-288a779409e1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:32.798148 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:32.804180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258d070-5acb-4daf-967f-559c55057169 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:32.808860 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:32.851797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3937142-ba7d-4833-ac39-b6cda0ac93aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:32.853162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3937142-ba7d-4833-ac39-b6cda0ac93aa None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:32.853482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3937142-ba7d-4833-ac39-b6cda0ac93aa None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:32.853769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3937142-ba7d-4833-ac39-b6cda0ac93aa None admin] PATH_INFO: `/v3/users/ee416b30e08e4d1f9592d88ed0e4f51d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:32.856082 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3937142-ba7d-4833-ac39-b6cda0ac93aa None admin] RBAC: Authorizing `identity:get_user(user_id=ee416b30e08e4d1f9592d88ed0e4f51d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:32.858542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3937142-ba7d-4833-ac39-b6cda0ac93aa None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:32.860781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 127/255] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:32 2022] GET /identity/v3/users/ee416b30e08e4d1f9592d88ed0e4f51d => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:32.862321 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2b210-3cff-4ad1-8c46-288a779409e1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:32.862693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529e459-4bea-4a88-b8f1-735df68ad59e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:32.863197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529e459-4bea-4a88-b8f1-735df68ad59e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:32.863994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529e459-4bea-4a88-b8f1-735df68ad59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:32.887757 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e529e459-4bea-4a88-b8f1-735df68ad59e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:32.889396 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e529e459-4bea-4a88-b8f1-735df68ad59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:32.910730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba24de5-66fe-4a2f-a4f7-80dc7e2f7f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:32.911559 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba24de5-66fe-4a2f-a4f7-80dc7e2f7f29 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:32.911849 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba24de5-66fe-4a2f-a4f7-80dc7e2f7f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:32.912134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba24de5-66fe-4a2f-a4f7-80dc7e2f7f29 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:32.913229 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba24de5-66fe-4a2f-a4f7-80dc7e2f7f29 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:32.913639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba24de5-66fe-4a2f-a4f7-80dc7e2f7f29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:32.915108 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba24de5-66fe-4a2f-a4f7-80dc7e2f7f29 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:32.929634 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 129/256] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:32.930701 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba24de5-66fe-4a2f-a4f7-80dc7e2f7f29 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:32.982138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 128/257] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:32.983169 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529e459-4bea-4a88-b8f1-735df68ad59e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:33.067318 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba24de5-66fe-4a2f-a4f7-80dc7e2f7f29 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:33.096992 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:33.105604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf4e59-a58d-4c17-a655-0294f3fa6833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:33.106407 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf4e59-a58d-4c17-a655-0294f3fa6833 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:33.106689 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf4e59-a58d-4c17-a655-0294f3fa6833 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:33.106968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf4e59-a58d-4c17-a655-0294f3fa6833 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:33.126116 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:33.134834 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529e459-4bea-4a88-b8f1-735df68ad59e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:33.180728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf4e59-a58d-4c17-a655-0294f3fa6833 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:33.182309 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f463b-7870-4bf2-90c6-1269e4943a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:33.182473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf4e59-a58d-4c17-a655-0294f3fa6833 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:33.183498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f463b-7870-4bf2-90c6-1269e4943a1f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:33.183934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f463b-7870-4bf2-90c6-1269e4943a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:33.184637 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f463b-7870-4bf2-90c6-1269e4943a1f None admin] PATH_INFO: `/v3/users/501cd7a1d405425ea88163a040620285` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:33.206297 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f463b-7870-4bf2-90c6-1269e4943a1f None admin] RBAC: Authorizing `identity:get_user(user_id=501cd7a1d405425ea88163a040620285)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:33.208795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f463b-7870-4bf2-90c6-1269e4943a1f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:33.211488 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 129/258] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:32 2022] GET /identity/v3/users/501cd7a1d405425ea88163a040620285 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:33.216296 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f463b-7870-4bf2-90c6-1269e4943a1f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:33.292843 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 130/259] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:33.293577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf4e59-a58d-4c17-a655-0294f3fa6833 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:33.322073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:33.344378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f463b-7870-4bf2-90c6-1269e4943a1f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:33.389467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a232c6f-4ac5-4ec9-9b3d-de4f8f158e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:33.390655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a232c6f-4ac5-4ec9-9b3d-de4f8f158e21 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:33.391133 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a232c6f-4ac5-4ec9-9b3d-de4f8f158e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:33.392453 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a232c6f-4ac5-4ec9-9b3d-de4f8f158e21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:33.409116 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a232c6f-4ac5-4ec9-9b3d-de4f8f158e21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:33.417250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf4e59-a58d-4c17-a655-0294f3fa6833 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:33.418348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-9a232c6f-4ac5-4ec9-9b3d-de4f8f158e21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:33.418348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:33.418348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:33.418348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:33.418348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:33.418348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:33.418348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:33.418348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:33.418348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:33.418348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:33.418348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:33.418348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:33.418348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:33.418348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:33.418348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:33.418348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:33.419235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:33.419235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:33.419235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:33.419235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:33.419235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:33.419235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:33.419235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:33.419235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:33.419235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:33.419235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:33.419235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:33.419235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:33.419235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:33.419235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:33.419235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:33.419235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:33.420045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:33.420045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:33.420045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:33.420045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:33.420045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:33.420045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:33.420045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:33.420045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:33.420045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:33.420045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:33.420045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:33.420045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:33.420045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 130/260] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:33.420716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a232c6f-4ac5-4ec9-9b3d-de4f8f158e21 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:33.442057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:33.461326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4932e-2650-443f-ab38-c53b0a9096bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:33.462360 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4932e-2650-443f-ab38-c53b0a9096bc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:33.462856 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4932e-2650-443f-ab38-c53b0a9096bc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:33.463348 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4932e-2650-443f-ab38-c53b0a9096bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:33.531891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a232c6f-4ac5-4ec9-9b3d-de4f8f158e21 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:33.536116 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4932e-2650-443f-ab38-c53b0a9096bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:33.538073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4932e-2650-443f-ab38-c53b0a9096bc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:33.566683 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:33.566877 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f8c6e-2a05-4670-a678-8505e5e41d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:33.568095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f8c6e-2a05-4670-a678-8505e5e41d5d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:33.568392 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f8c6e-2a05-4670-a678-8505e5e41d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:33.568662 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f8c6e-2a05-4670-a678-8505e5e41d5d None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:33.570046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f8c6e-2a05-4670-a678-8505e5e41d5d None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:33.571733 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4f8c6e-2a05-4670-a678-8505e5e41d5d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:33.573465 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 131/261] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:33 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:33.574291 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f8c6e-2a05-4670-a678-8505e5e41d5d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:33.644898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 131/262] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:33.646117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4932e-2650-443f-ab38-c53b0a9096bc None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:33.663459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:33.683115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f8c6e-2a05-4670-a678-8505e5e41d5d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:33.717145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565128b-b2c7-425b-904f-302488bdfe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:33.717774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565128b-b2c7-425b-904f-302488bdfe23 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:33.718059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565128b-b2c7-425b-904f-302488bdfe23 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:33.718337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565128b-b2c7-425b-904f-302488bdfe23 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:33.719088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565128b-b2c7-425b-904f-302488bdfe23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:33.719399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565128b-b2c7-425b-904f-302488bdfe23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:33.721422 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565128b-b2c7-425b-904f-302488bdfe23 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:33.729330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 132/263] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:33.729330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565128b-b2c7-425b-904f-302488bdfe23 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:33.756644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4932e-2650-443f-ab38-c53b0a9096bc None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:33.784239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:33.793101 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d494b38-abf0-40b0-9f8e-affacc7a660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:33.794063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d494b38-abf0-40b0-9f8e-affacc7a660e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:33.794545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d494b38-abf0-40b0-9f8e-affacc7a660e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:33.795038 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d494b38-abf0-40b0-9f8e-affacc7a660e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:33.796069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d494b38-abf0-40b0-9f8e-affacc7a660e None admin] RBAC: Adding query filter params (role.id=1be1544572744e849ed04df01cdca3fb, scope.project.id=b007b4f89cb74f898cbd2e8eb9919989, user.id=ee416b30e08e4d1f9592d88ed0e4f51d) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:33.796580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d494b38-abf0-40b0-9f8e-affacc7a660e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:33.798267 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d494b38-abf0-40b0-9f8e-affacc7a660e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:33.804807 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 132/264] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:33 2022] GET /identity/v3/role_assignments?user.id=ee416b30e08e4d1f9592d88ed0e4f51d&scope.project.id=b007b4f89cb74f898cbd2e8eb9919989&role.id=1be1544572744e849ed04df01cdca3fb => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:33.805972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d494b38-abf0-40b0-9f8e-affacc7a660e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:33.866137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565128b-b2c7-425b-904f-302488bdfe23 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:33.903499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbe56d-7422-49e2-a922-1d18ec062f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:33.904377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbe56d-7422-49e2-a922-1d18ec062f24 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:33.904657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbe56d-7422-49e2-a922-1d18ec062f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:33.904931 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbe56d-7422-49e2-a922-1d18ec062f24 None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:33.906152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbe56d-7422-49e2-a922-1d18ec062f24 None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:33.907611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbe56d-7422-49e2-a922-1d18ec062f24 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:33.909325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 133/265] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:33 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:33.918522 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbe56d-7422-49e2-a922-1d18ec062f24 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:33.922770 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d494b38-abf0-40b0-9f8e-affacc7a660e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:33.944840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:33.966707 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef288d20-2dd6-4fff-bd8a-308829c411c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:33.968027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef288d20-2dd6-4fff-bd8a-308829c411c1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:33.968507 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef288d20-2dd6-4fff-bd8a-308829c411c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:33.968990 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef288d20-2dd6-4fff-bd8a-308829c411c1 None admin] PATH_INFO: `/v3/users/49c986155b2343d5b20cb68f24342a1a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:33.971601 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef288d20-2dd6-4fff-bd8a-308829c411c1 None admin] RBAC: Authorizing `identity:get_user(user_id=49c986155b2343d5b20cb68f24342a1a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:33.973323 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef288d20-2dd6-4fff-bd8a-308829c411c1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:33.975644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 133/266] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:33 2022] GET /identity/v3/users/49c986155b2343d5b20cb68f24342a1a => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:33.982999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef288d20-2dd6-4fff-bd8a-308829c411c1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:34.081884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:34.101454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbe56d-7422-49e2-a922-1d18ec062f24 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:34.127456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef288d20-2dd6-4fff-bd8a-308829c411c1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:34.139782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5defa4-7b03-4694-97bb-d15345d7d40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:34.140449 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5defa4-7b03-4694-97bb-d15345d7d40c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:34.140731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5defa4-7b03-4694-97bb-d15345d7d40c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:34.141008 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5defa4-7b03-4694-97bb-d15345d7d40c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:34.141936 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5defa4-7b03-4694-97bb-d15345d7d40c None admin] RBAC: Adding query filter params (role.id=52f18795c489403f89e3036b0cdd3dd8, scope.project.id=b007b4f89cb74f898cbd2e8eb9919989, user.id=501cd7a1d405425ea88163a040620285) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:34.142252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5defa4-7b03-4694-97bb-d15345d7d40c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:34.143697 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5defa4-7b03-4694-97bb-d15345d7d40c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:34.149750 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 134/267] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:33 2022] GET /identity/v3/role_assignments?user.id=501cd7a1d405425ea88163a040620285&scope.project.id=b007b4f89cb74f898cbd2e8eb9919989&role.id=52f18795c489403f89e3036b0cdd3dd8 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:34.184521 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde11dcf-97b3-4836-99b6-9d5db0c32b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:34.185899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde11dcf-97b3-4836-99b6-9d5db0c32b10 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:34.186417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde11dcf-97b3-4836-99b6-9d5db0c32b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:34.186951 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde11dcf-97b3-4836-99b6-9d5db0c32b10 None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:34.188492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde11dcf-97b3-4836-99b6-9d5db0c32b10 None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:34.190263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde11dcf-97b3-4836-99b6-9d5db0c32b10 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:34.192324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 134/268] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:33 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:34.198528 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5defa4-7b03-4694-97bb-d15345d7d40c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:34.292840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:34.321515 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5defa4-7b03-4694-97bb-d15345d7d40c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:34.362248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82e1d5-eb62-4676-bf23-d75196dae152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:34.363547 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82e1d5-eb62-4676-bf23-d75196dae152 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:34.364024 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82e1d5-eb62-4676-bf23-d75196dae152 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:34.364489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82e1d5-eb62-4676-bf23-d75196dae152 None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989/users/49c986155b2343d5b20cb68f24342a1a/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:34.367207 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82e1d5-eb62-4676-bf23-d75196dae152 None admin] RBAC: Authorizing `identity:create_grant(project_id=b007b4f89cb74f898cbd2e8eb9919989, user_id=49c986155b2343d5b20cb68f24342a1a, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:34.368896 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82e1d5-eb62-4676-bf23-d75196dae152 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:34.387178 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 135/269] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:21:34 2022] PUT /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989/users/49c986155b2343d5b20cb68f24342a1a/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:35.013369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a62df0-7f34-425d-b6df-bbbca306d788 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.013781 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a62df0-7f34-425d-b6df-bbbca306d788 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.013954 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a62df0-7f34-425d-b6df-bbbca306d788 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.015481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 135/270] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:35.020768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ca87b-787b-4036-8b41-aab13b4d79a9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.021067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ca87b-787b-4036-8b41-aab13b4d79a9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.021377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ca87b-787b-4036-8b41-aab13b4d79a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.034158 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f0889-283c-4c55-8f64-aa91662a4380 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.034442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f0889-283c-4c55-8f64-aa91662a4380 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.034720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f0889-283c-4c55-8f64-aa91662a4380 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.036241 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 136/271] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:21:35.041266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60082c3c-b924-4394-a086-646aa0601209 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.041581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60082c3c-b924-4394-a086-646aa0601209 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.041862 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60082c3c-b924-4394-a086-646aa0601209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.056990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c09ca87b-787b-4036-8b41-aab13b4d79a9 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:35.058918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c09ca87b-787b-4036-8b41-aab13b4d79a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:35.059537 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-60082c3c-b924-4394-a086-646aa0601209 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:35.060696 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-60082c3c-b924-4394-a086-646aa0601209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:35.137546 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 136/272] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:35.151153 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 137/273] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:35.160044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ca87b-787b-4036-8b41-aab13b4d79a9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:35.177041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60082c3c-b924-4394-a086-646aa0601209 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:35.227857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:35.254844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:35.280411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ca87b-787b-4036-8b41-aab13b4d79a9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:35.303423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60082c3c-b924-4394-a086-646aa0601209 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:35.327902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf462d9-480a-4a45-bb98-426d2d1dd76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:35.328715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf462d9-480a-4a45-bb98-426d2d1dd76d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.329079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf462d9-480a-4a45-bb98-426d2d1dd76d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.329267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf462d9-480a-4a45-bb98-426d2d1dd76d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.340127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf462d9-480a-4a45-bb98-426d2d1dd76d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:35.342893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4dafa-4241-4e40-8109-1614a833ac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:35.343901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4dafa-4241-4e40-8109-1614a833ac7c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.344328 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4dafa-4241-4e40-8109-1614a833ac7c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.344745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4dafa-4241-4e40-8109-1614a833ac7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.346076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4dafa-4241-4e40-8109-1614a833ac7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:35.347684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4dafa-4241-4e40-8109-1614a833ac7c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:35.348119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-bbf462d9-480a-4a45-bb98-426d2d1dd76d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:35.348119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:35.348119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:35.348119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:35.348119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:35.348119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:35.348119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:35.348119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:35.348119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:35.348119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:35.348119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:35.348119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:35.348119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:35.348119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:35.348119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:35.348119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:35.349184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:35.349184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:35.349184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:35.349184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:35.349184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:35.349184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:35.349184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:35.349184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:35.349184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:35.349184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:35.349184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:35.349184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:35.349184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:35.349184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:35.349184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:35.349184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:35.350190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:35.350190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:35.350190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:35.350190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:35.350190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:35.350190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:35.350190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:35.350190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:35.350190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:35.350190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:35.350190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:35.350190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:35.352273 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 138/275] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:35.356778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 137/275] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:35.357822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4dafa-4241-4e40-8109-1614a833ac7c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:35.357956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf462d9-480a-4a45-bb98-426d2d1dd76d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:35.474379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4dafa-4241-4e40-8109-1614a833ac7c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:35.479518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf462d9-480a-4a45-bb98-426d2d1dd76d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:35.504569 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:35.517886 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:35.518285 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596240f-02ea-478d-8a4e-b8c8d80bdd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:35.519371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596240f-02ea-478d-8a4e-b8c8d80bdd12 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.520164 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596240f-02ea-478d-8a4e-b8c8d80bdd12 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.520774 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596240f-02ea-478d-8a4e-b8c8d80bdd12 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.521907 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596240f-02ea-478d-8a4e-b8c8d80bdd12 None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:35.522397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596240f-02ea-478d-8a4e-b8c8d80bdd12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:35.524583 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596240f-02ea-478d-8a4e-b8c8d80bdd12 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:35.528884 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd665af-a53f-48e8-aca4-150b3592754f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:35.529602 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd665af-a53f-48e8-aca4-150b3592754f None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.529893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd665af-a53f-48e8-aca4-150b3592754f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.530174 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd665af-a53f-48e8-aca4-150b3592754f None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.531011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd665af-a53f-48e8-aca4-150b3592754f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:35.532629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd665af-a53f-48e8-aca4-150b3592754f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:35.536353 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 139/276] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:35.541816 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596240f-02ea-478d-8a4e-b8c8d80bdd12 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:35.565385 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 138/277] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:21:35 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:21:35.663323 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596240f-02ea-478d-8a4e-b8c8d80bdd12 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:35.699689 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca2716-8c2e-4088-a7dd-e17db0b65647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:35.700606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca2716-8c2e-4088-a7dd-e17db0b65647 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.700891 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca2716-8c2e-4088-a7dd-e17db0b65647 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.701171 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca2716-8c2e-4088-a7dd-e17db0b65647 None admin] PATH_INFO: `/v3/users/ace922b534554fabbfc475fb0b6d3a58` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.717252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca2716-8c2e-4088-a7dd-e17db0b65647 None admin] RBAC: Authorizing `identity:get_user(user_id=ace922b534554fabbfc475fb0b6d3a58)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:35.718804 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca2716-8c2e-4088-a7dd-e17db0b65647 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:35.721155 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 140/278] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:35 2022] GET /identity/v3/users/ace922b534554fabbfc475fb0b6d3a58 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:35.727275 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd665af-a53f-48e8-aca4-150b3592754f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:35.838873 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd665af-a53f-48e8-aca4-150b3592754f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:35.875672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef748c2-fd61-4f1f-b0b6-5ea864e490a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:35.876351 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef748c2-fd61-4f1f-b0b6-5ea864e490a6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:35.876641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef748c2-fd61-4f1f-b0b6-5ea864e490a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:35.876933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef748c2-fd61-4f1f-b0b6-5ea864e490a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:35.877807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef748c2-fd61-4f1f-b0b6-5ea864e490a6 None admin] RBAC: Adding query filter params (role.id=5dd696285c0b41d3acb854981774eaae, user.id=ace922b534554fabbfc475fb0b6d3a58, scope.system=all) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:35.878128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef748c2-fd61-4f1f-b0b6-5ea864e490a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:35.879593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef748c2-fd61-4f1f-b0b6-5ea864e490a6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:35.885946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 139/279] 10.222.0.36 () {56 vars in 1308 bytes} [Wed Jun 15 00:21:35 2022] GET /identity/v3/role_assignments?user.id=ace922b534554fabbfc475fb0b6d3a58&scope.system=all&role.id=5dd696285c0b41d3acb854981774eaae => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:36.486901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbfd9b-4b67-4dbb-8b5d-9075c15261de None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:36.487463 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbfd9b-4b67-4dbb-8b5d-9075c15261de None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:36.487463 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbfd9b-4b67-4dbb-8b5d-9075c15261de None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:36.489090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 141/280] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:36.495330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e3462-5b6d-4446-92d5-335e35713542 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:36.496165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e3462-5b6d-4446-92d5-335e35713542 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:36.496676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e3462-5b6d-4446-92d5-335e35713542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:36.513911 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-542e3462-5b6d-4446-92d5-335e35713542 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:36.515404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-542e3462-5b6d-4446-92d5-335e35713542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:36.574840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:36.607021 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 140/281] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:36.641730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbfd9b-4b67-4dbb-8b5d-9075c15261de None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:36.705750 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:36.708073 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799b83f-6189-413c-838d-b8ab2348d8a7 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:36.708365 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799b83f-6189-413c-838d-b8ab2348d8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:36.708662 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799b83f-6189-413c-838d-b8ab2348d8a7 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:36.710226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 141/282] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:36.715499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5f407-fa6f-4e2c-bdd1-569beb9cccc3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:36.715788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5f407-fa6f-4e2c-bdd1-569beb9cccc3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:36.716072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5f407-fa6f-4e2c-bdd1-569beb9cccc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:36.734387 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6ed5f407-fa6f-4e2c-bdd1-569beb9cccc3 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:36.735585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6ed5f407-fa6f-4e2c-bdd1-569beb9cccc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:36.804819 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbfd9b-4b67-4dbb-8b5d-9075c15261de None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:36.845435 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6e4c6-ece3-4ad3-8936-42f1ee82772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:36.846712 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e4c6-ece3-4ad3-8936-42f1ee82772b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:36.847153 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e4c6-ece3-4ad3-8936-42f1ee82772b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:36.847498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e4c6-ece3-4ad3-8936-42f1ee82772b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:36.866246 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6e4c6-ece3-4ad3-8936-42f1ee82772b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:36.866527 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 142/283] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:36.874379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-91b6e4c6-ece3-4ad3-8936-42f1ee82772b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:36.874379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:36.874379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:36.874379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:36.874379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:36.874379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:36.874379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:36.874379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:36.874379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:36.874379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:36.874379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:36.874379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:36.874379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:36.874379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:36.874379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:36.874379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:36.875262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:36.875262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:36.875262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:36.875262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:36.875262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:36.875262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:36.875262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:36.875262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:36.875262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:36.875262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:36.875262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:36.875262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:36.875262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:36.875262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:36.875262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:36.875262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:36.876063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:36.876063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:36.876063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:36.876063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:36.876063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:36.876063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:36.876063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:36.876063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:36.876063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:36.876063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:36.876063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:36.876063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:36.883041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 142/284] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:36.889266 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5f407-fa6f-4e2c-bdd1-569beb9cccc3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:36.902178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6e4c6-ece3-4ad3-8936-42f1ee82772b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:37.017196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6e4c6-ece3-4ad3-8936-42f1ee82772b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:37.026186 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:37.057545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00e5d3-fed5-43f3-aaab-ae0b3a4049b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:37.058295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00e5d3-fed5-43f3-aaab-ae0b3a4049b6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:37.058587 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00e5d3-fed5-43f3-aaab-ae0b3a4049b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:37.058874 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00e5d3-fed5-43f3-aaab-ae0b3a4049b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:37.078863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00e5d3-fed5-43f3-aaab-ae0b3a4049b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:37.088221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-6c00e5d3-fed5-43f3-aaab-ae0b3a4049b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:37.088221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:37.088221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:37.088221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:37.088221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:37.088221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:37.088221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:37.088221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:37.088221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:37.088221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:37.088221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:37.088221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:37.088221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:37.088221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:37.088221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:37.088221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:37.089168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:37.089168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:37.089168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:37.089168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:37.089168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:37.089168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:37.089168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:37.089168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:37.089168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:37.089168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:37.089168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:37.089168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:37.089168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:37.089168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:37.089168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:37.089168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:37.090014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:37.090014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:37.090014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:37.090014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:37.090014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:37.090014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:37.090014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:37.090014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:37.090014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:37.090014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:37.090014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:37.090014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:37.093585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 143/285] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:21:37.095775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00e5d3-fed5-43f3-aaab-ae0b3a4049b6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:37.144889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5f407-fa6f-4e2c-bdd1-569beb9cccc3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:37.160874 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:37.192233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432ea8f-4e48-411a-bb86-b7f935c536dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:37.192927 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ea8f-4e48-411a-bb86-b7f935c536dd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:37.193215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ea8f-4e48-411a-bb86-b7f935c536dd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:37.193532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432ea8f-4e48-411a-bb86-b7f935c536dd None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:37.194292 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432ea8f-4e48-411a-bb86-b7f935c536dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:37.194603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432ea8f-4e48-411a-bb86-b7f935c536dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:37.196023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432ea8f-4e48-411a-bb86-b7f935c536dd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:37.205028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 143/286] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:37.210930 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432ea8f-4e48-411a-bb86-b7f935c536dd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:37.274510 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00e5d3-fed5-43f3-aaab-ae0b3a4049b6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:37.324630 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432ea8f-4e48-411a-bb86-b7f935c536dd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:37.334591 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91b95d-5ca5-4d55-86d0-c507d49291cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:37.335295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91b95d-5ca5-4d55-86d0-c507d49291cc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:37.335586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91b95d-5ca5-4d55-86d0-c507d49291cc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:37.335871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91b95d-5ca5-4d55-86d0-c507d49291cc None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:37.336699 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91b95d-5ca5-4d55-86d0-c507d49291cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:37.337018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91b95d-5ca5-4d55-86d0-c507d49291cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:37.338447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91b95d-5ca5-4d55-86d0-c507d49291cc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:37.360866 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68859bb8-d4bb-4d7b-b3bd-dcb4ad6dd944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:37.361750 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 144/287] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:37.365925 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68859bb8-d4bb-4d7b-b3bd-dcb4ad6dd944 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:37.366226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68859bb8-d4bb-4d7b-b3bd-dcb4ad6dd944 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:37.366513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68859bb8-d4bb-4d7b-b3bd-dcb4ad6dd944 None admin] PATH_INFO: `/v3/users/501cd7a1d405425ea88163a040620285` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:37.367750 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68859bb8-d4bb-4d7b-b3bd-dcb4ad6dd944 None admin] RBAC: Authorizing `identity:get_user(user_id=501cd7a1d405425ea88163a040620285)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:37.369296 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68859bb8-d4bb-4d7b-b3bd-dcb4ad6dd944 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:37.373509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 144/288] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:37 2022] GET /identity/v3/users/501cd7a1d405425ea88163a040620285 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:37.377877 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68859bb8-d4bb-4d7b-b3bd-dcb4ad6dd944 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:37.377986 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91b95d-5ca5-4d55-86d0-c507d49291cc None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:37.415003 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:37.431147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:37.485407 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68859bb8-d4bb-4d7b-b3bd-dcb4ad6dd944 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:37.534713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91b95d-5ca5-4d55-86d0-c507d49291cc None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:37.555645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6b917-25c4-4562-8f97-f2e8feec8f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:37.556547 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6b917-25c4-4562-8f97-f2e8feec8f79 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:37.556826 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6b917-25c4-4562-8f97-f2e8feec8f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:37.557098 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6b917-25c4-4562-8f97-f2e8feec8f79 None admin] PATH_INFO: `/v3/users/49c986155b2343d5b20cb68f24342a1a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:37.558489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6b917-25c4-4562-8f97-f2e8feec8f79 None admin] RBAC: Authorizing `identity:get_user(user_id=49c986155b2343d5b20cb68f24342a1a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:37.559958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6b917-25c4-4562-8f97-f2e8feec8f79 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:37.561635 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 145/289] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:37 2022] GET /identity/v3/users/49c986155b2343d5b20cb68f24342a1a => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:37.570267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6b917-25c4-4562-8f97-f2e8feec8f79 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:37.613281 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7ec97-083d-4560-9ee5-74dfcf3b7326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:37.614125 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7ec97-083d-4560-9ee5-74dfcf3b7326 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:37.614404 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7ec97-083d-4560-9ee5-74dfcf3b7326 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:37.614676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7ec97-083d-4560-9ee5-74dfcf3b7326 None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:37.617474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7ec97-083d-4560-9ee5-74dfcf3b7326 None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:37.619000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7ec97-083d-4560-9ee5-74dfcf3b7326 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:37.620932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 145/290] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:37 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:37.627393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7ec97-083d-4560-9ee5-74dfcf3b7326 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:37.750132 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:37.756492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7ec97-083d-4560-9ee5-74dfcf3b7326 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:37.785182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6b917-25c4-4562-8f97-f2e8feec8f79 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:37.791917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:37.833676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e998a-f957-4306-8dda-9d7713459510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:37.835069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e998a-f957-4306-8dda-9d7713459510 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:37.835540 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e998a-f957-4306-8dda-9d7713459510 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:37.836013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e998a-f957-4306-8dda-9d7713459510 None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989/users/501cd7a1d405425ea88163a040620285/roles/52f18795c489403f89e3036b0cdd3dd8` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:37.839579 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e998a-f957-4306-8dda-9d7713459510 None admin] RBAC: Authorizing `identity:create_grant(project_id=b007b4f89cb74f898cbd2e8eb9919989, user_id=501cd7a1d405425ea88163a040620285, role_id=52f18795c489403f89e3036b0cdd3dd8)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:37.844650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e998a-f957-4306-8dda-9d7713459510 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:37.846097 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f37700-b837-4ebd-9841-fcefe6cdeb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:37.846995 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f37700-b837-4ebd-9841-fcefe6cdeb3e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:37.849986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f37700-b837-4ebd-9841-fcefe6cdeb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:37.850977 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f37700-b837-4ebd-9841-fcefe6cdeb3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:37.873075 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 146/291] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:21:37 2022] PUT /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989/users/501cd7a1d405425ea88163a040620285/roles/52f18795c489403f89e3036b0cdd3dd8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:37.947288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f37700-b837-4ebd-9841-fcefe6cdeb3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:37.948819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f37700-b837-4ebd-9841-fcefe6cdeb3e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:38.097325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 146/292] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:38.103421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e998a-f957-4306-8dda-9d7713459510 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:38.221402 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b1cc3-6533-4e2a-a0c9-8a7d83ace5b7 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.221717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b1cc3-6533-4e2a-a0c9-8a7d83ace5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.221974 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b1cc3-6533-4e2a-a0c9-8a7d83ace5b7 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.223368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 147/293] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:21:38.232028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b8346-ae30-48d0-b97f-e7a45339f458 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.232314 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b8346-ae30-48d0-b97f-e7a45339f458 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.232595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b8346-ae30-48d0-b97f-e7a45339f458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.245011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:38.255736 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e998a-f957-4306-8dda-9d7713459510 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:38.255914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f65b8346-ae30-48d0-b97f-e7a45339f458 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:38.257046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f65b8346-ae30-48d0-b97f-e7a45339f458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:38.298548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0272b95-197d-47e4-8bff-231646a4772c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:38.300440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272b95-197d-47e4-8bff-231646a4772c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.301044 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272b95-197d-47e4-8bff-231646a4772c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.301634 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272b95-197d-47e4-8bff-231646a4772c None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.302994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0272b95-197d-47e4-8bff-231646a4772c None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:38.304736 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0272b95-197d-47e4-8bff-231646a4772c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:38.308162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 147/294] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:38 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:38.309603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96736941-cfbb-44b2-b500-ef2034648cf3 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.310073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96736941-cfbb-44b2-b500-ef2034648cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.310504 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96736941-cfbb-44b2-b500-ef2034648cf3 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.312114 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 148/295] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:38.321274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfc532-3ddb-47e2-a06a-50e599780976 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.321274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfc532-3ddb-47e2-a06a-50e599780976 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.321274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfc532-3ddb-47e2-a06a-50e599780976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.336367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ccdfc532-3ddb-47e2-a06a-50e599780976 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:38.337738 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ccdfc532-3ddb-47e2-a06a-50e599780976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:38.344885 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 148/296] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:38.345585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b8346-ae30-48d0-b97f-e7a45339f458 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:38.364770 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:38.429955 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 149/297] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:38.431049 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfc532-3ddb-47e2-a06a-50e599780976 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:38.460868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b8346-ae30-48d0-b97f-e7a45339f458 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:38.497597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80bc41-be5e-4abb-94a9-420ffc4a645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:38.498189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80bc41-be5e-4abb-94a9-420ffc4a645e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.498477 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80bc41-be5e-4abb-94a9-420ffc4a645e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.498754 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80bc41-be5e-4abb-94a9-420ffc4a645e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.499601 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80bc41-be5e-4abb-94a9-420ffc4a645e None admin] RBAC: Adding query filter params (role.id=5dd696285c0b41d3acb854981774eaae, scope.project.id=b007b4f89cb74f898cbd2e8eb9919989, user.id=49c986155b2343d5b20cb68f24342a1a) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:38.499917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80bc41-be5e-4abb-94a9-420ffc4a645e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:38.501383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80bc41-be5e-4abb-94a9-420ffc4a645e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:38.504376 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:38.513377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 149/298] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:38 2022] GET /identity/v3/role_assignments?user.id=49c986155b2343d5b20cb68f24342a1a&scope.project.id=b007b4f89cb74f898cbd2e8eb9919989&role.id=5dd696285c0b41d3acb854981774eaae => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:38.513377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80bc41-be5e-4abb-94a9-420ffc4a645e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:38.618217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfc532-3ddb-47e2-a06a-50e599780976 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:38.640183 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80bc41-be5e-4abb-94a9-420ffc4a645e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:38.657549 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac73c0-e0d1-4c07-8496-46428746a497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:38.658643 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac73c0-e0d1-4c07-8496-46428746a497 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.659084 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac73c0-e0d1-4c07-8496-46428746a497 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.659595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac73c0-e0d1-4c07-8496-46428746a497 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.661090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac73c0-e0d1-4c07-8496-46428746a497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:38.662894 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac73c0-e0d1-4c07-8496-46428746a497 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:38.669506 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 150/299] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:38.671565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19f7a6-aca5-4708-8c3c-448cda60c1eb None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.672162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19f7a6-aca5-4708-8c3c-448cda60c1eb None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.672643 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19f7a6-aca5-4708-8c3c-448cda60c1eb None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.675596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 151/300] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:38.676803 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19f7a6-aca5-4708-8c3c-448cda60c1eb None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:38.687935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ec80c-2f9c-4001-8151-9d9cfaee5784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:38.688781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ec80c-2f9c-4001-8151-9d9cfaee5784 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.689062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ec80c-2f9c-4001-8151-9d9cfaee5784 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.689338 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ec80c-2f9c-4001-8151-9d9cfaee5784 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.705032 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ec80c-2f9c-4001-8151-9d9cfaee5784 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:38.706786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:38.716224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-059ec80c-2f9c-4001-8151-9d9cfaee5784 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:38.716224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:38.716224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:38.716224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:38.716224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:38.716224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:38.716224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:38.716224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:38.716224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:38.716224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:38.716224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:38.716224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:38.716224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:38.716224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:38.716224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:38.716224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:38.717605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:38.717605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:38.717605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:38.717605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:38.717605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:38.717605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:38.717605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:38.717605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:38.717605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:38.717605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:38.717605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:38.717605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:38.717605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:38.717605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:38.717605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:38.717605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:38.718408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:38.718408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:38.718408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:38.718408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:38.718408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:38.718408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:38.718408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:38.718408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:38.718408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:38.718408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:38.718408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:38.718408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:38.718408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 150/301] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:38.720577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72645a09-72e9-4327-a5de-89f8b6b66bbc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.720577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72645a09-72e9-4327-a5de-89f8b6b66bbc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.720577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72645a09-72e9-4327-a5de-89f8b6b66bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.737109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-72645a09-72e9-4327-a5de-89f8b6b66bbc None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:38.738341 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-72645a09-72e9-4327-a5de-89f8b6b66bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:38.799768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:38.822746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 151/302] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:38.823625 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72645a09-72e9-4327-a5de-89f8b6b66bbc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:38.833081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19f7a6-aca5-4708-8c3c-448cda60c1eb None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:38.872968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1684e-ac52-4746-987f-ba6d189f56a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:38.873949 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1684e-ac52-4746-987f-ba6d189f56a2 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:38.874243 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1684e-ac52-4746-987f-ba6d189f56a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:38.874542 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1684e-ac52-4746-987f-ba6d189f56a2 None admin] PATH_INFO: `/v3/groups` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:38.875663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1684e-ac52-4746-987f-ba6d189f56a2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:38.877674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1684e-ac52-4746-987f-ba6d189f56a2 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:38.895068 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 152/303] 10.222.0.36 () {60 vars in 1134 bytes} [Wed Jun 15 00:21:38 2022] POST /identity/v3/groups => generated 229 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:21:38.895883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1684e-ac52-4746-987f-ba6d189f56a2 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:38.950639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72645a09-72e9-4327-a5de-89f8b6b66bbc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:38.985117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:39.003695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d234eb2-55a8-43bd-a82a-977be83ce052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:39.003958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1684e-ac52-4746-987f-ba6d189f56a2 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:39.004943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d234eb2-55a8-43bd-a82a-977be83ce052 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:39.005617 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d234eb2-55a8-43bd-a82a-977be83ce052 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:39.005913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d234eb2-55a8-43bd-a82a-977be83ce052 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:39.006702 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d234eb2-55a8-43bd-a82a-977be83ce052 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:39.007012 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d234eb2-55a8-43bd-a82a-977be83ce052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:39.008432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d234eb2-55a8-43bd-a82a-977be83ce052 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:39.018318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 152/304] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:39.023816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d234eb2-55a8-43bd-a82a-977be83ce052 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:39.061557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb0c7b-2cc5-4070-871e-279776b269e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:39.062312 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0c7b-2cc5-4070-871e-279776b269e0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:39.062602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0c7b-2cc5-4070-871e-279776b269e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:39.062886 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb0c7b-2cc5-4070-871e-279776b269e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:39.083158 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb0c7b-2cc5-4070-871e-279776b269e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:39.085249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:39.093681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-8deb0c7b-2cc5-4070-871e-279776b269e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:39.093681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:39.093681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:39.093681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:39.093681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:39.093681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:39.093681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:39.093681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:39.093681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:39.093681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:39.093681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:39.093681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:39.093681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:39.093681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:39.093681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:39.093681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:39.094597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:39.094597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:39.094597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:39.094597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:39.094597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:39.094597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:39.094597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:39.094597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:39.094597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:39.094597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:39.094597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:39.094597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:39.094597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:39.094597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:39.094597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:39.094597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:39.095402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:39.095402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:39.095402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:39.095402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:39.095402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:39.095402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:39.095402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:39.095402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:39.095402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:39.095402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:39.095402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:39.095402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:39.096022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 153/305] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:39.102548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb0c7b-2cc5-4070-871e-279776b269e0 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:39.154781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d234eb2-55a8-43bd-a82a-977be83ce052 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:39.195330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8716d1-e8ff-4407-bbde-635628b8b977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:39.196265 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8716d1-e8ff-4407-bbde-635628b8b977 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:39.196547 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8716d1-e8ff-4407-bbde-635628b8b977 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:39.196821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8716d1-e8ff-4407-bbde-635628b8b977 None admin] PATH_INFO: `/v3/users/1deaabc18e0d4e6883f7139118aa35fd` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:39.211982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8716d1-e8ff-4407-bbde-635628b8b977 None admin] RBAC: Authorizing `identity:get_user(user_id=1deaabc18e0d4e6883f7139118aa35fd)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:39.213577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8716d1-e8ff-4407-bbde-635628b8b977 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:39.215718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 153/306] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:39 2022] GET /identity/v3/users/1deaabc18e0d4e6883f7139118aa35fd => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:39.225368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8716d1-e8ff-4407-bbde-635628b8b977 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:39.227695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb0c7b-2cc5-4070-871e-279776b269e0 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:39.275805 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269530-ce53-4211-8005-8deb79c58ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:39.277173 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269530-ce53-4211-8005-8deb79c58ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:39.277666 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269530-ce53-4211-8005-8deb79c58ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:39.277960 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269530-ce53-4211-8005-8deb79c58ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:39.278742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73269530-ce53-4211-8005-8deb79c58ea4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:39.279057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73269530-ce53-4211-8005-8deb79c58ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:39.280507 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73269530-ce53-4211-8005-8deb79c58ea4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:39.289656 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 154/307] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:39.295100 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269530-ce53-4211-8005-8deb79c58ea4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:39.299585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:39.347642 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8716d1-e8ff-4407-bbde-635628b8b977 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:39.357484 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:39.386194 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2d9c3-a3d8-4138-adef-3568673ed670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:39.386876 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2d9c3-a3d8-4138-adef-3568673ed670 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:39.387162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2d9c3-a3d8-4138-adef-3568673ed670 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:39.387441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2d9c3-a3d8-4138-adef-3568673ed670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:39.388282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2d9c3-a3d8-4138-adef-3568673ed670 None admin] RBAC: Adding query filter params (role.id=52f18795c489403f89e3036b0cdd3dd8, user.id=1deaabc18e0d4e6883f7139118aa35fd, scope.system=all) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:39.388603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2d9c3-a3d8-4138-adef-3568673ed670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:39.390081 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2d9c3-a3d8-4138-adef-3568673ed670 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:39.396472 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 154/308] 10.222.0.36 () {56 vars in 1308 bytes} [Wed Jun 15 00:21:39 2022] GET /identity/v3/role_assignments?user.id=1deaabc18e0d4e6883f7139118aa35fd&scope.system=all&role.id=52f18795c489403f89e3036b0cdd3dd8 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:39.428037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269530-ce53-4211-8005-8deb79c58ea4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:39.469939 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669c073-b439-4fc1-ad87-b86a79752ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:39.471595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669c073-b439-4fc1-ad87-b86a79752ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:39.472424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669c073-b439-4fc1-ad87-b86a79752ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:39.473268 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669c073-b439-4fc1-ad87-b86a79752ce2 None admin] PATH_INFO: `/v3/users/ace922b534554fabbfc475fb0b6d3a58` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:39.475381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669c073-b439-4fc1-ad87-b86a79752ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=ace922b534554fabbfc475fb0b6d3a58)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:39.477142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669c073-b439-4fc1-ad87-b86a79752ce2 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:39.480642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 155/309] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:39 2022] GET /identity/v3/users/ace922b534554fabbfc475fb0b6d3a58 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:39.486446 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2d9c3-a3d8-4138-adef-3568673ed670 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:39.604895 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2d9c3-a3d8-4138-adef-3568673ed670 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:39.641016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8210e6d-7f62-4fcf-ba93-fdca0a155bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:39.642728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8210e6d-7f62-4fcf-ba93-fdca0a155bc7 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:39.643216 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8210e6d-7f62-4fcf-ba93-fdca0a155bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:39.643696 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8210e6d-7f62-4fcf-ba93-fdca0a155bc7 None admin] PATH_INFO: `/v3/system/users/ace922b534554fabbfc475fb0b6d3a58/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:39.645395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8210e6d-7f62-4fcf-ba93-fdca0a155bc7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ace922b534554fabbfc475fb0b6d3a58, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:39.647079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8210e6d-7f62-4fcf-ba93-fdca0a155bc7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:39.659935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 155/310] 10.222.0.36 () {58 vars in 1334 bytes} [Wed Jun 15 00:21:39 2022] PUT /identity/v3/system/users/ace922b534554fabbfc475fb0b6d3a58/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:40.211275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b704197-08c6-44ae-9d21-8ffa2c7448fb None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:40.211823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b704197-08c6-44ae-9d21-8ffa2c7448fb None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:40.211898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b704197-08c6-44ae-9d21-8ffa2c7448fb None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:40.213875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 156/311] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:40.219264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4718824-4ed0-40cc-b8b8-85cd1de96ab8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:40.219563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4718824-4ed0-40cc-b8b8-85cd1de96ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:40.219847 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4718824-4ed0-40cc-b8b8-85cd1de96ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:40.237475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f4718824-4ed0-40cc-b8b8-85cd1de96ab8 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:40.238680 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f4718824-4ed0-40cc-b8b8-85cd1de96ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:40.268372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:40.313423 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 156/312] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:40.331549 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b704197-08c6-44ae-9d21-8ffa2c7448fb None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:40.413364 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:40.448500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b704197-08c6-44ae-9d21-8ffa2c7448fb None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:40.485501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84732064-c93b-41f4-85eb-4d6eac05c866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:40.486704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84732064-c93b-41f4-85eb-4d6eac05c866 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:40.487209 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84732064-c93b-41f4-85eb-4d6eac05c866 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:40.487694 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84732064-c93b-41f4-85eb-4d6eac05c866 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:40.499079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84732064-c93b-41f4-85eb-4d6eac05c866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:40.507339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-84732064-c93b-41f4-85eb-4d6eac05c866 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:40.507339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:40.507339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:40.507339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:40.507339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:40.507339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:40.507339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:40.507339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:40.507339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:40.507339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:40.507339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:40.507339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:40.507339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:40.507339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:40.507339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:40.507339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:40.508220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:40.508220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:40.508220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:40.508220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:40.508220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:40.508220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:40.508220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:40.508220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:40.508220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:40.508220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:40.508220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:40.508220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:40.508220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:40.508220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:40.508220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:40.508220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:40.509415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:40.509415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:40.509415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:40.509415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:40.509415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:40.509415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:40.509415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:40.509415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:40.509415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:40.509415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:40.509415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:40.509415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:40.512172 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 157/313] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:40.518102 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4718824-4ed0-40cc-b8b8-85cd1de96ab8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:40.621386 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4718824-4ed0-40cc-b8b8-85cd1de96ab8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:40.654826 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea3265-0eae-42a6-bcac-ee22ae5ac5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:40.655563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea3265-0eae-42a6-bcac-ee22ae5ac5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:40.655778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea3265-0eae-42a6-bcac-ee22ae5ac5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:40.656051 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea3265-0eae-42a6-bcac-ee22ae5ac5b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:40.656803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea3265-0eae-42a6-bcac-ee22ae5ac5b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:40.657108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea3265-0eae-42a6-bcac-ee22ae5ac5b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:40.658532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea3265-0eae-42a6-bcac-ee22ae5ac5b5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:40.667350 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 157/314] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:40.677982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84732064-c93b-41f4-85eb-4d6eac05c866 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:40.795088 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84732064-c93b-41f4-85eb-4d6eac05c866 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:40.826469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:40.831531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6384395-b297-4965-8a64-ccba36f88f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:40.832455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6384395-b297-4965-8a64-ccba36f88f21 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:40.832740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6384395-b297-4965-8a64-ccba36f88f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:40.833023 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6384395-b297-4965-8a64-ccba36f88f21 None admin] PATH_INFO: `/v3/users/501cd7a1d405425ea88163a040620285` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:40.834485 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6384395-b297-4965-8a64-ccba36f88f21 None admin] RBAC: Authorizing `identity:get_user(user_id=501cd7a1d405425ea88163a040620285)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:40.836425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6384395-b297-4965-8a64-ccba36f88f21 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:40.838514 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 158/315] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:40 2022] GET /identity/v3/users/501cd7a1d405425ea88163a040620285 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:40.844011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea3265-0eae-42a6-bcac-ee22ae5ac5b5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:40.873672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:40.946428 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea3265-0eae-42a6-bcac-ee22ae5ac5b5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:40.980084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d247b3e-7cf7-450b-b6f3-9688d5622e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:40.980748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d247b3e-7cf7-450b-b6f3-9688d5622e70 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:40.981040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d247b3e-7cf7-450b-b6f3-9688d5622e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:40.981320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d247b3e-7cf7-450b-b6f3-9688d5622e70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:41.049709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d247b3e-7cf7-450b-b6f3-9688d5622e70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:41.051177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d247b3e-7cf7-450b-b6f3-9688d5622e70 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:41.081735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:41.153942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 158/316] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:41.159679 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6384395-b297-4965-8a64-ccba36f88f21 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:41.213019 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe83c8-9f79-41ee-a56f-64a029f68887 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:41.213381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe83c8-9f79-41ee-a56f-64a029f68887 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:41.213676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe83c8-9f79-41ee-a56f-64a029f68887 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:41.215041 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 159/317] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:41.220059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7afbc-5a35-4ac2-8585-e3acb6e403b1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:41.220356 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7afbc-5a35-4ac2-8585-e3acb6e403b1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:41.220648 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7afbc-5a35-4ac2-8585-e3acb6e403b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:41.238559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-89b7afbc-5a35-4ac2-8585-e3acb6e403b1 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:41.239753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-89b7afbc-5a35-4ac2-8585-e3acb6e403b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:41.271158 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6384395-b297-4965-8a64-ccba36f88f21 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:41.314098 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4355-3092-4356-9c5c-13527cec5c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:41.315263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4355-3092-4356-9c5c-13527cec5c18 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:41.315673 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4355-3092-4356-9c5c-13527cec5c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:41.316070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4355-3092-4356-9c5c-13527cec5c18 None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:41.317431 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a4355-3092-4356-9c5c-13527cec5c18 None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:41.319021 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a4355-3092-4356-9c5c-13527cec5c18 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:41.321176 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 159/319] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:41 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:41.325372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 160/319] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:41.327100 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4355-3092-4356-9c5c-13527cec5c18 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:41.337652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7afbc-5a35-4ac2-8585-e3acb6e403b1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:41.398126 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:41.435229 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4355-3092-4356-9c5c-13527cec5c18 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:41.441914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:41.464963 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7afbc-5a35-4ac2-8585-e3acb6e403b1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:41.471395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40669f3-7434-4237-8183-9dddd036919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:41.472078 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40669f3-7434-4237-8183-9dddd036919e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:41.472412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40669f3-7434-4237-8183-9dddd036919e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:41.472698 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40669f3-7434-4237-8183-9dddd036919e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:41.473575 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40669f3-7434-4237-8183-9dddd036919e None admin] RBAC: Adding query filter params (role.id=52f18795c489403f89e3036b0cdd3dd8, scope.project.id=b007b4f89cb74f898cbd2e8eb9919989, user.id=501cd7a1d405425ea88163a040620285) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:41.473893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40669f3-7434-4237-8183-9dddd036919e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:41.475353 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40669f3-7434-4237-8183-9dddd036919e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:41.488596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 160/320] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:21:41 2022] GET /identity/v3/role_assignments?user.id=501cd7a1d405425ea88163a040620285&scope.project.id=b007b4f89cb74f898cbd2e8eb9919989&role.id=52f18795c489403f89e3036b0cdd3dd8 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:41.508978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd154b0d-1a35-4908-8b70-bb6eab6591fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:41.510151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd154b0d-1a35-4908-8b70-bb6eab6591fb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:41.510586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd154b0d-1a35-4908-8b70-bb6eab6591fb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:41.511004 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd154b0d-1a35-4908-8b70-bb6eab6591fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:41.512597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd154b0d-1a35-4908-8b70-bb6eab6591fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:41.514444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd154b0d-1a35-4908-8b70-bb6eab6591fb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:41.516492 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 161/321] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:21:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:41.522732 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40669f3-7434-4237-8183-9dddd036919e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:41.565238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af716e0-660f-4706-918a-f81b31491c6f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:41.565590 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af716e0-660f-4706-918a-f81b31491c6f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:41.565829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af716e0-660f-4706-918a-f81b31491c6f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:41.567453 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 162/322] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:41.573458 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030461d2-3b39-4f13-b254-6e9ede2012ef None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:41.574078 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030461d2-3b39-4f13-b254-6e9ede2012ef None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:41.574562 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030461d2-3b39-4f13-b254-6e9ede2012ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:41.592873 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-030461d2-3b39-4f13-b254-6e9ede2012ef None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:41.594599 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-030461d2-3b39-4f13-b254-6e9ede2012ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:41.657425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40669f3-7434-4237-8183-9dddd036919e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:41.674478 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 163/323] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:41.691910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030461d2-3b39-4f13-b254-6e9ede2012ef None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:41.695235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:41.701582 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8eb50-591e-4ed8-a77a-e1e3988d6c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:41.702546 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8eb50-591e-4ed8-a77a-e1e3988d6c97 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:41.703047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8eb50-591e-4ed8-a77a-e1e3988d6c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:41.703596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8eb50-591e-4ed8-a77a-e1e3988d6c97 None admin] PATH_INFO: `/v3/groups` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:41.704565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8eb50-591e-4ed8-a77a-e1e3988d6c97 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:41.706281 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8eb50-591e-4ed8-a77a-e1e3988d6c97 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:41.725120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 161/324] 10.222.0.36 () {60 vars in 1134 bytes} [Wed Jun 15 00:21:41 2022] POST /identity/v3/groups => generated 226 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:21:41.773838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:41.828875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030461d2-3b39-4f13-b254-6e9ede2012ef None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:41.870722 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0894c-aa2d-47e5-b2ca-201358a79134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:41.871957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0894c-aa2d-47e5-b2ca-201358a79134 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:41.872465 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0894c-aa2d-47e5-b2ca-201358a79134 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:41.872934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0894c-aa2d-47e5-b2ca-201358a79134 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:41.878883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea77ab0-b9bf-4134-a4e7-353b8fb92888 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:41.879186 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea77ab0-b9bf-4134-a4e7-353b8fb92888 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:41.879470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea77ab0-b9bf-4134-a4e7-353b8fb92888 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:41.881162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 162/325] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:21:41.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0894c-aa2d-47e5-b2ca-201358a79134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:41.886846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf4165-a4b8-4ccf-becb-32dd097a3510 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:41.887142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf4165-a4b8-4ccf-becb-32dd097a3510 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:41.887595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf4165-a4b8-4ccf-becb-32dd097a3510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:41.894495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-15e0894c-aa2d-47e5-b2ca-201358a79134 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:41.894495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:41.894495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:41.894495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:41.894495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:41.894495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:41.894495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:41.894495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:41.894495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:41.894495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:41.894495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:41.894495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:41.894495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:41.894495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:41.894495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:41.894495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:41.895475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:41.895475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:41.895475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:41.895475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:41.895475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:41.895475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:41.895475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:41.895475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:41.895475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:41.895475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:41.895475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:41.895475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:41.895475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:41.895475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:41.895475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:41.895475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:41.896726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:41.896726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:41.896726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:41.896726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:41.896726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:41.896726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:41.896726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:41.896726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:41.896726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:41.896726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:41.896726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:41.896726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:41.896726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 164/326] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:21:41.901797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0894c-aa2d-47e5-b2ca-201358a79134 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:41.909308 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-7ebf4165-a4b8-4ccf-becb-32dd097a3510 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:41.910549 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7ebf4165-a4b8-4ccf-becb-32dd097a3510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:41.993432 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 163/327] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:42.014288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0894c-aa2d-47e5-b2ca-201358a79134 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:42.017445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf4165-a4b8-4ccf-becb-32dd097a3510 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:42.035724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:42.059008 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ea627-007a-429a-b771-16b8400c701b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:42.059696 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ea627-007a-429a-b771-16b8400c701b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:42.060131 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ea627-007a-429a-b771-16b8400c701b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:42.060411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ea627-007a-429a-b771-16b8400c701b None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:42.061931 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ea627-007a-429a-b771-16b8400c701b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:42.062259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ea627-007a-429a-b771-16b8400c701b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:42.063669 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ea627-007a-429a-b771-16b8400c701b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:42.078671 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 165/328] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:42.083825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ea627-007a-429a-b771-16b8400c701b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:42.146512 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf4165-a4b8-4ccf-becb-32dd097a3510 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:42.175360 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:42.190266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312362a-5207-4446-ae35-3cc246fe4246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:42.191092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312362a-5207-4446-ae35-3cc246fe4246 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:42.191374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312362a-5207-4446-ae35-3cc246fe4246 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:42.191709 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312362a-5207-4446-ae35-3cc246fe4246 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:42.197125 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ea627-007a-429a-b771-16b8400c701b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:42.204699 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312362a-5207-4446-ae35-3cc246fe4246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:42.213446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c312362a-5207-4446-ae35-3cc246fe4246 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:42.213446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:42.213446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:42.213446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:42.213446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:42.213446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:42.213446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:42.213446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:42.213446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:42.213446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:42.213446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:42.213446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:42.213446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:42.213446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:42.213446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:42.213446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:42.214375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:42.214375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:42.214375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:42.214375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:42.214375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:42.214375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:42.214375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:42.214375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:42.214375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:42.214375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:42.214375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:42.214375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:42.214375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:42.214375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:42.214375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:42.214375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:42.215174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:42.215174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:42.215174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:42.215174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:42.215174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:42.215174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:42.215174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:42.215174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:42.215174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:42.215174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:42.215174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:42.215174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:42.219532 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 164/329] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:21:42.220752 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312362a-5207-4446-ae35-3cc246fe4246 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:42.241296 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be3639-ca2a-4ef4-ade9-cd0e934fac4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:42.244651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be3639-ca2a-4ef4-ade9-cd0e934fac4c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:42.244886 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be3639-ca2a-4ef4-ade9-cd0e934fac4c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:42.245169 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be3639-ca2a-4ef4-ade9-cd0e934fac4c None admin] PATH_INFO: `/v3/users/1deaabc18e0d4e6883f7139118aa35fd` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:42.246453 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be3639-ca2a-4ef4-ade9-cd0e934fac4c None admin] RBAC: Authorizing `identity:get_user(user_id=1deaabc18e0d4e6883f7139118aa35fd)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:42.248437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be3639-ca2a-4ef4-ade9-cd0e934fac4c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:42.251034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 166/330] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:42 2022] GET /identity/v3/users/1deaabc18e0d4e6883f7139118aa35fd => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:42.256280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be3639-ca2a-4ef4-ade9-cd0e934fac4c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:42.317207 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:42.351041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312362a-5207-4446-ae35-3cc246fe4246 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:42.378846 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be3639-ca2a-4ef4-ade9-cd0e934fac4c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:42.391586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a912e-d06a-4e40-b932-8c3365cc59c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:42.392281 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a912e-d06a-4e40-b932-8c3365cc59c6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:42.392561 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a912e-d06a-4e40-b932-8c3365cc59c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:42.392836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a912e-d06a-4e40-b932-8c3365cc59c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:42.393655 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a912e-d06a-4e40-b932-8c3365cc59c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:42.393971 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a912e-d06a-4e40-b932-8c3365cc59c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:42.395385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a912e-d06a-4e40-b932-8c3365cc59c6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:42.409461 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 165/331] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:42.411278 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a912e-d06a-4e40-b932-8c3365cc59c6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:42.414603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf32f6-f649-41e1-a030-33b72a66f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:42.415520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf32f6-f649-41e1-a030-33b72a66f10a None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:42.415857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf32f6-f649-41e1-a030-33b72a66f10a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:42.416152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf32f6-f649-41e1-a030-33b72a66f10a None admin] PATH_INFO: `/v3/system/users/1deaabc18e0d4e6883f7139118aa35fd/roles/52f18795c489403f89e3036b0cdd3dd8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:42.417803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf32f6-f649-41e1-a030-33b72a66f10a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1deaabc18e0d4e6883f7139118aa35fd, role_id=52f18795c489403f89e3036b0cdd3dd8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:42.419208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf32f6-f649-41e1-a030-33b72a66f10a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:42.431082 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 167/332] 10.222.0.36 () {58 vars in 1334 bytes} [Wed Jun 15 00:21:42 2022] PUT /identity/v3/system/users/1deaabc18e0d4e6883f7139118aa35fd/roles/52f18795c489403f89e3036b0cdd3dd8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:21:42.464196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:42.526251 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a912e-d06a-4e40-b932-8c3365cc59c6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:42.564563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c959099-3733-4eb7-9860-bb4f5e52bfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:42.565779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c959099-3733-4eb7-9860-bb4f5e52bfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:42.566235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c959099-3733-4eb7-9860-bb4f5e52bfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:42.566651 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c959099-3733-4eb7-9860-bb4f5e52bfd1 None admin] PATH_INFO: `/v3/users/ace922b534554fabbfc475fb0b6d3a58` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:42.568092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c959099-3733-4eb7-9860-bb4f5e52bfd1 None admin] RBAC: Authorizing `identity:get_user(user_id=ace922b534554fabbfc475fb0b6d3a58)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:42.569774 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c959099-3733-4eb7-9860-bb4f5e52bfd1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:42.576607 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 166/333] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:42 2022] GET /identity/v3/users/ace922b534554fabbfc475fb0b6d3a58 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:42.578337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf32f6-f649-41e1-a030-33b72a66f10a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:42.689771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf32f6-f649-41e1-a030-33b72a66f10a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:42.701332 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:42.732220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e41da-9ab6-42d8-944e-1bb0b1f6af6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:42.732898 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e41da-9ab6-42d8-944e-1bb0b1f6af6e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:42.733185 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e41da-9ab6-42d8-944e-1bb0b1f6af6e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:42.733498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e41da-9ab6-42d8-944e-1bb0b1f6af6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:42.734347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e41da-9ab6-42d8-944e-1bb0b1f6af6e None admin] RBAC: Adding query filter params (role.id=5dd696285c0b41d3acb854981774eaae, user.id=ace922b534554fabbfc475fb0b6d3a58, scope.system=all) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:42.734659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e41da-9ab6-42d8-944e-1bb0b1f6af6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:42.736172 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e41da-9ab6-42d8-944e-1bb0b1f6af6e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:42.750140 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 168/334] 10.222.0.36 () {56 vars in 1308 bytes} [Wed Jun 15 00:21:42 2022] GET /identity/v3/role_assignments?user.id=ace922b534554fabbfc475fb0b6d3a58&scope.system=all&role.id=5dd696285c0b41d3acb854981774eaae => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:44.434883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40690bac-95ba-4a15-a586-ee5dc3ca4859 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:44.435370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40690bac-95ba-4a15-a586-ee5dc3ca4859 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:44.435370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40690bac-95ba-4a15-a586-ee5dc3ca4859 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:44.437046 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 167/335] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:44.451247 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee615f95-57e8-405d-9c01-2cf6fbe9973d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:44.451731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee615f95-57e8-405d-9c01-2cf6fbe9973d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:44.451835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee615f95-57e8-405d-9c01-2cf6fbe9973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:44.474437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ee615f95-57e8-405d-9c01-2cf6fbe9973d None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:44.475659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ee615f95-57e8-405d-9c01-2cf6fbe9973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:44.572129 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 169/336] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:44.614012 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40690bac-95ba-4a15-a586-ee5dc3ca4859 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:44.658925 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e8aea-bf04-497a-af03-a12200cea49e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:44.659569 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e8aea-bf04-497a-af03-a12200cea49e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:44.660067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e8aea-bf04-497a-af03-a12200cea49e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:44.661970 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 170/337] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:44.667678 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdb855-178b-4327-903a-07358eebf313 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:44.668264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdb855-178b-4327-903a-07358eebf313 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:44.668741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdb855-178b-4327-903a-07358eebf313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:44.703399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2dfdb855-178b-4327-903a-07358eebf313 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:44.704591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2dfdb855-178b-4327-903a-07358eebf313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:44.746644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40690bac-95ba-4a15-a586-ee5dc3ca4859 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:44.775320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:44.835589 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771679ca-8af5-4144-af03-089fccd58e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:44.836315 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771679ca-8af5-4144-af03-089fccd58e40 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:44.836622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771679ca-8af5-4144-af03-089fccd58e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:44.837133 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771679ca-8af5-4144-af03-089fccd58e40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:44.867252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 171/338] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:44.870331 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771679ca-8af5-4144-af03-089fccd58e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:44.878274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-771679ca-8af5-4144-af03-089fccd58e40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:44.878274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:44.878274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:44.878274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:44.878274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:44.878274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:44.878274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:44.878274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:44.878274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:44.878274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:44.878274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:44.878274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:44.878274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:44.878274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:44.878274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:44.878274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:44.879378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:44.879378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:44.879378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:44.879378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:44.879378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:44.879378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:44.879378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:44.879378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:44.879378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:44.879378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:44.879378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:44.879378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:44.879378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:44.879378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:44.879378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:44.879378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:44.880349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:44.880349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:44.880349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:44.880349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:44.880349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:44.880349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:44.880349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:44.880349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:44.880349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:44.880349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:44.880349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:44.880349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:44.880349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 168/339] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:44.886797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdb855-178b-4327-903a-07358eebf313 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:44.910519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771679ca-8af5-4144-af03-089fccd58e40 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:44.935687 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:45.086154 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdb855-178b-4327-903a-07358eebf313 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:45.140021 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771679ca-8af5-4144-af03-089fccd58e40 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:45.144837 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379edb2-b88a-477c-8ad5-aeaf45915dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:45.146665 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379edb2-b88a-477c-8ad5-aeaf45915dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:45.146962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379edb2-b88a-477c-8ad5-aeaf45915dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:45.147246 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379edb2-b88a-477c-8ad5-aeaf45915dc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:45.148105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379edb2-b88a-477c-8ad5-aeaf45915dc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:45.148475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379edb2-b88a-477c-8ad5-aeaf45915dc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:45.150077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379edb2-b88a-477c-8ad5-aeaf45915dc6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:45.165437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 172/340] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:45.166993 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f07f9-aa7e-46b1-ab23-dc1dc8f00cfd None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:45.167291 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f07f9-aa7e-46b1-ab23-dc1dc8f00cfd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:45.167576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f07f9-aa7e-46b1-ab23-dc1dc8f00cfd None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:45.169381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 173/341] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:45.175575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d138230-fa5a-4335-b8c8-54ab89fa1f78 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:45.175919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d138230-fa5a-4335-b8c8-54ab89fa1f78 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:45.176209 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d138230-fa5a-4335-b8c8-54ab89fa1f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:45.197214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8d138230-fa5a-4335-b8c8-54ab89fa1f78 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:45.198991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8d138230-fa5a-4335-b8c8-54ab89fa1f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:45.250526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c329e4-a359-4f22-ade8-295c32cdf884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:45.251379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c329e4-a359-4f22-ade8-295c32cdf884 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:45.251665 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c329e4-a359-4f22-ade8-295c32cdf884 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:45.251947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c329e4-a359-4f22-ade8-295c32cdf884 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:45.263619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c329e4-a359-4f22-ade8-295c32cdf884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:45.272086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-f0c329e4-a359-4f22-ade8-295c32cdf884 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:45.272086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:45.272086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:45.272086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:45.272086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:45.272086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:45.272086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:45.272086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:45.272086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:45.272086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:45.272086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:45.272086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:45.272086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:45.272086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:45.272086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:45.272086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:45.272972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:45.272972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:45.272972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:45.272972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:45.272972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:45.272972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:45.272972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:45.272972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:45.272972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:45.272972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:45.272972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:45.272972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:45.272972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:45.272972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:45.272972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:45.272972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:45.273798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:45.273798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:45.273798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:45.273798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:45.273798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:45.273798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:45.273798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:45.273798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:45.273798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:45.273798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:45.273798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:45.273798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:45.274950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 169/342] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:21:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:21:45.275685 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c329e4-a359-4f22-ade8-295c32cdf884 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:45.278685 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 174/343] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:45.281439 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9bc9e-a76e-43f6-8f1a-319bb23cb5cf None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:45.281771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9bc9e-a76e-43f6-8f1a-319bb23cb5cf None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:45.282054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9bc9e-a76e-43f6-8f1a-319bb23cb5cf None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:45.283440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 175/344] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:45.284152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9bc9e-a76e-43f6-8f1a-319bb23cb5cf None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:45.317034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:45.320733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:45.407054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c329e4-a359-4f22-ade8-295c32cdf884 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:45.428581 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9bc9e-a76e-43f6-8f1a-319bb23cb5cf None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:45.445311 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf28cd1-41d7-47a4-ba91-ace6eddc55e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:45.446060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf28cd1-41d7-47a4-ba91-ace6eddc55e5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:45.446348 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf28cd1-41d7-47a4-ba91-ace6eddc55e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:45.446629 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf28cd1-41d7-47a4-ba91-ace6eddc55e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:45.477416 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f236a7-d2c3-4196-ab99-61f5a681bee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:45.479557 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f236a7-d2c3-4196-ab99-61f5a681bee3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:45.480306 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f236a7-d2c3-4196-ab99-61f5a681bee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:45.480794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f236a7-d2c3-4196-ab99-61f5a681bee3 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:45.482429 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f236a7-d2c3-4196-ab99-61f5a681bee3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:45.482960 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f236a7-d2c3-4196-ab99-61f5a681bee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:45.485076 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f236a7-d2c3-4196-ab99-61f5a681bee3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:45.497012 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 176/345] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:21:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:45.499016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a37e5f-f3aa-4525-828d-4c72f363fce3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:45.499530 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a37e5f-f3aa-4525-828d-4c72f363fce3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:45.500335 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a37e5f-f3aa-4525-828d-4c72f363fce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:45.520325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-52a37e5f-f3aa-4525-828d-4c72f363fce3 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:45.521886 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-52a37e5f-f3aa-4525-828d-4c72f363fce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:45.530880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf28cd1-41d7-47a4-ba91-ace6eddc55e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:45.532446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf28cd1-41d7-47a4-ba91-ace6eddc55e5 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:45.564769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:45.598300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 177/346] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:45.599522 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a37e5f-f3aa-4525-828d-4c72f363fce3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:45.622697 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:45.651097 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 170/347] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:45.651991 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf28cd1-41d7-47a4-ba91-ace6eddc55e5 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:45.732324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a37e5f-f3aa-4525-828d-4c72f363fce3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:45.759218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf28cd1-41d7-47a4-ba91-ace6eddc55e5 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:45.770033 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8691d28-cbd8-48a0-91f6-79e76bcbe3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:45.771184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8691d28-cbd8-48a0-91f6-79e76bcbe3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:45.771682 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8691d28-cbd8-48a0-91f6-79e76bcbe3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:45.772183 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8691d28-cbd8-48a0-91f6-79e76bcbe3a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:45.784735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8691d28-cbd8-48a0-91f6-79e76bcbe3a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:45.790825 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:45.793551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b8691d28-cbd8-48a0-91f6-79e76bcbe3a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:45.793551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:45.793551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:45.793551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:45.793551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:45.793551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:45.793551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:45.793551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:45.793551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:45.793551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:45.793551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:45.793551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:45.793551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:45.793551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:45.793551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:45.793551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:45.796438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:45.796438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:45.796438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:45.796438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:45.796438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:45.796438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:45.796438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:45.796438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:45.796438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:45.796438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:45.796438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:45.796438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:45.796438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:45.796438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:45.796438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:45.796438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:45.797310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:45.797310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:45.797310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:45.797310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:45.797310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:45.797310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:45.797310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:45.797310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:45.797310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:45.797310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:45.797310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 15 00:21:45.797310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:45.798469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7e8c8-8600-4b82-9beb-95162f97b23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:45.798469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7e8c8-8600-4b82-9beb-95162f97b23f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:45.798469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7e8c8-8600-4b82-9beb-95162f97b23f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:45.798469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7e8c8-8600-4b82-9beb-95162f97b23f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:45.799423 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 178/348] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:45.800494 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8691d28-cbd8-48a0-91f6-79e76bcbe3a0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:45.871972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7e8c8-8600-4b82-9beb-95162f97b23f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:45.873481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7e8c8-8600-4b82-9beb-95162f97b23f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:45.875314 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:45.909000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8691d28-cbd8-48a0-91f6-79e76bcbe3a0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:45.947106 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bca99a-5d12-4fe7-88df-e6abcaadf877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:45.948277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bca99a-5d12-4fe7-88df-e6abcaadf877 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:45.948788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bca99a-5d12-4fe7-88df-e6abcaadf877 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:45.949264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bca99a-5d12-4fe7-88df-e6abcaadf877 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:45.960763 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bca99a-5d12-4fe7-88df-e6abcaadf877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:45.969413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-65bca99a-5d12-4fe7-88df-e6abcaadf877 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:45.969413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:45.969413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:45.969413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:45.969413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:45.969413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:45.969413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:45.969413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:45.969413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:45.969413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:45.969413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:45.969413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:45.969413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:45.969413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:45.969413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:45.969413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:45.970325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:45.970325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:45.970325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:45.970325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:45.970325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:45.970325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:45.970325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:45.970325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:45.970325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:45.970325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:45.970325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:45.970325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:45.970325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:45.970325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:45.970325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:45.970325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:45.971144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:45.971144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:45.971144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:45.971144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:45.971144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:45.971144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:45.971144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:45.971144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:45.971144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:45.971144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:45.971144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:45.971144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:45.973917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 179/349] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:45.974916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bca99a-5d12-4fe7-88df-e6abcaadf877 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:45.977923 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 171/350] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:45.978522 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7e8c8-8600-4b82-9beb-95162f97b23f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:46.014986 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:46.087990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bca99a-5d12-4fe7-88df-e6abcaadf877 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:46.114496 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7e8c8-8600-4b82-9beb-95162f97b23f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:46.120961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:46.129096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c0582-d5ff-4537-a7f8-ef80d678a291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:46.130393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c0582-d5ff-4537-a7f8-ef80d678a291 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:46.130891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c0582-d5ff-4537-a7f8-ef80d678a291 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:46.131377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c0582-d5ff-4537-a7f8-ef80d678a291 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:46.132862 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c0582-d5ff-4537-a7f8-ef80d678a291 None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:46.134665 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c0582-d5ff-4537-a7f8-ef80d678a291 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:46.136915 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 180/351] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:45 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:46.137937 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c0582-d5ff-4537-a7f8-ef80d678a291 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:46.160102 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053073e-1b79-4de8-9840-d0d40cc894a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:46.160809 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053073e-1b79-4de8-9840-d0d40cc894a0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:46.161093 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053073e-1b79-4de8-9840-d0d40cc894a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:46.161401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053073e-1b79-4de8-9840-d0d40cc894a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:46.162182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053073e-1b79-4de8-9840-d0d40cc894a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:46.162500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053073e-1b79-4de8-9840-d0d40cc894a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:46.163922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053073e-1b79-4de8-9840-d0d40cc894a0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:46.178323 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 172/352] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:46.179260 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053073e-1b79-4de8-9840-d0d40cc894a0 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:46.247724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c0582-d5ff-4537-a7f8-ef80d678a291 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:46.280665 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:46.288886 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad374c-fef9-49a4-b3bd-3377364cdee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:46.289873 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad374c-fef9-49a4-b3bd-3377364cdee7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:46.289983 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad374c-fef9-49a4-b3bd-3377364cdee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:46.290215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad374c-fef9-49a4-b3bd-3377364cdee7 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:46.290982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad374c-fef9-49a4-b3bd-3377364cdee7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:46.291292 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad374c-fef9-49a4-b3bd-3377364cdee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:46.292709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad374c-fef9-49a4-b3bd-3377364cdee7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:46.292945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053073e-1b79-4de8-9840-d0d40cc894a0 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:46.304719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 181/353] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:46.306168 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad374c-fef9-49a4-b3bd-3377364cdee7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:46.341869 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e6ea7-9b19-4992-ae3c-cdfeb3f17fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:46.342873 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e6ea7-9b19-4992-ae3c-cdfeb3f17fef None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:46.343165 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e6ea7-9b19-4992-ae3c-cdfeb3f17fef None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:46.343540 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e6ea7-9b19-4992-ae3c-cdfeb3f17fef None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:46.344843 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e6ea7-9b19-4992-ae3c-cdfeb3f17fef None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:46.346492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e6ea7-9b19-4992-ae3c-cdfeb3f17fef None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:46.348697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 173/354] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:46 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:46.349530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e6ea7-9b19-4992-ae3c-cdfeb3f17fef None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:46.386299 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:46.431235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad374c-fef9-49a4-b3bd-3377364cdee7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:46.472785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4461024-bd2d-4d7f-8440-de5f3c211653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:46.473757 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4461024-bd2d-4d7f-8440-de5f3c211653 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:46.474043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4461024-bd2d-4d7f-8440-de5f3c211653 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:46.474336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4461024-bd2d-4d7f-8440-de5f3c211653 None admin] PATH_INFO: `/v3/groups/dadaa50ccc2143eb86169726387512eb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:46.482497 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e6ea7-9b19-4992-ae3c-cdfeb3f17fef None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:46.482995 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4461024-bd2d-4d7f-8440-de5f3c211653 None admin] RBAC: Authorizing `identity:get_group(group_id=dadaa50ccc2143eb86169726387512eb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:46.484931 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4461024-bd2d-4d7f-8440-de5f3c211653 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:46.487749 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 182/355] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 15 00:21:46 2022] GET /identity/v3/groups/dadaa50ccc2143eb86169726387512eb => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:46.488384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4461024-bd2d-4d7f-8440-de5f3c211653 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:46.520066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca21d4-edb9-4e3a-a3cd-5edf52421c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:46.520959 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca21d4-edb9-4e3a-a3cd-5edf52421c87 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:46.521504 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca21d4-edb9-4e3a-a3cd-5edf52421c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:46.521631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca21d4-edb9-4e3a-a3cd-5edf52421c87 None admin] PATH_INFO: `/v3/users/1deaabc18e0d4e6883f7139118aa35fd` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:46.523458 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca21d4-edb9-4e3a-a3cd-5edf52421c87 None admin] RBAC: Authorizing `identity:get_user(user_id=1deaabc18e0d4e6883f7139118aa35fd)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:46.525480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca21d4-edb9-4e3a-a3cd-5edf52421c87 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:46.527143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 174/356] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:21:46 2022] GET /identity/v3/users/1deaabc18e0d4e6883f7139118aa35fd => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:46.528019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca21d4-edb9-4e3a-a3cd-5edf52421c87 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:46.568488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:46.620303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4461024-bd2d-4d7f-8440-de5f3c211653 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:46.650659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:46.661650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca21d4-edb9-4e3a-a3cd-5edf52421c87 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:46.667785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735b582-0032-409b-974e-149986d3eab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:46.668461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735b582-0032-409b-974e-149986d3eab4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:46.668751 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735b582-0032-409b-974e-149986d3eab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:46.669031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735b582-0032-409b-974e-149986d3eab4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:46.704855 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e1727-4704-4cb9-a14d-a89e9e6d19b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:46.705776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e1727-4704-4cb9-a14d-a89e9e6d19b5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:46.706063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e1727-4704-4cb9-a14d-a89e9e6d19b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:46.706383 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e1727-4704-4cb9-a14d-a89e9e6d19b5 None admin] PATH_INFO: `/v3/groups/dadaa50ccc2143eb86169726387512eb` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:46.707547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e1727-4704-4cb9-a14d-a89e9e6d19b5 None admin] RBAC: Authorizing `identity:get_group(group_id=dadaa50ccc2143eb86169726387512eb)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:46.709033 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e1727-4704-4cb9-a14d-a89e9e6d19b5 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:46.711202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 175/357] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 15 00:21:46 2022] GET /identity/v3/groups/dadaa50ccc2143eb86169726387512eb => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:46.712651 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c0e75-66d8-40d7-a04a-4a9031ef2e3b None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:46.712942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c0e75-66d8-40d7-a04a-4a9031ef2e3b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:46.713222 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c0e75-66d8-40d7-a04a-4a9031ef2e3b None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:46.714953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 176/358] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:46.715758 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c0e75-66d8-40d7-a04a-4a9031ef2e3b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:46.756725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735b582-0032-409b-974e-149986d3eab4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:46.758541 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735b582-0032-409b-974e-149986d3eab4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:46.829235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:46.834422 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c0e75-66d8-40d7-a04a-4a9031ef2e3b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:46.872542 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfde0ca-fbb4-4869-bd20-4e8713c95f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:46.873220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfde0ca-fbb4-4869-bd20-4e8713c95f74 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:46.873969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfde0ca-fbb4-4869-bd20-4e8713c95f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:46.873969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfde0ca-fbb4-4869-bd20-4e8713c95f74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:46.874657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfde0ca-fbb4-4869-bd20-4e8713c95f74 None admin] RBAC: Adding query filter params (group.id=dadaa50ccc2143eb86169726387512eb, role.id=5dd696285c0b41d3acb854981774eaae, scope.project.id=a82bf7161bd44f5e83eae52981f952ab) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:46.877268 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfde0ca-fbb4-4869-bd20-4e8713c95f74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:46.877268 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfde0ca-fbb4-4869-bd20-4e8713c95f74 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:46.878262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 183/359] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:46.879125 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735b582-0032-409b-974e-149986d3eab4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:46.883442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 177/360] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 15 00:21:46 2022] GET /identity/v3/role_assignments?group.id=dadaa50ccc2143eb86169726387512eb&scope.project.id=a82bf7161bd44f5e83eae52981f952ab&role.id=5dd696285c0b41d3acb854981774eaae => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:46.884334 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfde0ca-fbb4-4869-bd20-4e8713c95f74 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:46.911203 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:47.019213 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735b582-0032-409b-974e-149986d3eab4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:47.020654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfde0ca-fbb4-4869-bd20-4e8713c95f74 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:47.061492 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ff969-1896-4123-8005-69ebcf2d2cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:47.062131 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ff969-1896-4123-8005-69ebcf2d2cfb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:47.062419 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ff969-1896-4123-8005-69ebcf2d2cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:47.062697 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ff969-1896-4123-8005-69ebcf2d2cfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:47.063560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ff969-1896-4123-8005-69ebcf2d2cfb None admin] RBAC: Adding query filter params (role.id=52f18795c489403f89e3036b0cdd3dd8, user.id=1deaabc18e0d4e6883f7139118aa35fd, scope.system=all) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:47.063902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ff969-1896-4123-8005-69ebcf2d2cfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:47.065369 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ff969-1896-4123-8005-69ebcf2d2cfb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:47.068510 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36330352-99eb-4f37-bc15-56c4fbdb9e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:47.069960 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36330352-99eb-4f37-bc15-56c4fbdb9e71 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:47.070896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36330352-99eb-4f37-bc15-56c4fbdb9e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:47.071022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36330352-99eb-4f37-bc15-56c4fbdb9e71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:47.072071 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36330352-99eb-4f37-bc15-56c4fbdb9e71 None admin] RBAC: Adding query filter params (group.id=dadaa50ccc2143eb86169726387512eb, role.id=1be1544572744e849ed04df01cdca3fb, scope.project.id=a82bf7161bd44f5e83eae52981f952ab) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:47.072356 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36330352-99eb-4f37-bc15-56c4fbdb9e71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:47.075958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36330352-99eb-4f37-bc15-56c4fbdb9e71 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:47.081397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 178/361] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 15 00:21:46 2022] GET /identity/v3/role_assignments?group.id=dadaa50ccc2143eb86169726387512eb&scope.project.id=a82bf7161bd44f5e83eae52981f952ab&role.id=1be1544572744e849ed04df01cdca3fb => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:47.082458 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63892033-9db8-4b34-b11a-a7b321224b02 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:47.082888 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63892033-9db8-4b34-b11a-a7b321224b02 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:47.083043 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63892033-9db8-4b34-b11a-a7b321224b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:47.083717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 184/362] 10.222.0.36 () {56 vars in 1308 bytes} [Wed Jun 15 00:21:46 2022] GET /identity/v3/role_assignments?user.id=1deaabc18e0d4e6883f7139118aa35fd&scope.system=all&role.id=52f18795c489403f89e3036b0cdd3dd8 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:47.084962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154e7c7-37b6-47bc-851c-c558a2131a2b None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:47.085247 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154e7c7-37b6-47bc-851c-c558a2131a2b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:47.085562 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154e7c7-37b6-47bc-851c-c558a2131a2b None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:47.087162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 185/363] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:47.087751 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154e7c7-37b6-47bc-851c-c558a2131a2b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:47.112751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-63892033-9db8-4b34-b11a-a7b321224b02 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:47.114825 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-63892033-9db8-4b34-b11a-a7b321224b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:47.149786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:47.209990 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 179/364] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:47.212358 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f64748-2dcd-4657-9cc0-09777e5b6303 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:47.212876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f64748-2dcd-4657-9cc0-09777e5b6303 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:47.213228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f64748-2dcd-4657-9cc0-09777e5b6303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:47.233565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-28f64748-2dcd-4657-9cc0-09777e5b6303 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:47.234800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-28f64748-2dcd-4657-9cc0-09777e5b6303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:47.259193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:47.303007 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154e7c7-37b6-47bc-851c-c558a2131a2b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:47.340754 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 180/365] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:47.341314 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f64748-2dcd-4657-9cc0-09777e5b6303 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:47.363122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5ddde-d504-446d-ad46-4cd35404e4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:47.364014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5ddde-d504-446d-ad46-4cd35404e4db None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:47.364299 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5ddde-d504-446d-ad46-4cd35404e4db None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:47.364881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5ddde-d504-446d-ad46-4cd35404e4db None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:47.366178 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5ddde-d504-446d-ad46-4cd35404e4db None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:47.367681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5ddde-d504-446d-ad46-4cd35404e4db None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:47.370068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 186/366] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:47 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:47.375699 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5ddde-d504-446d-ad46-4cd35404e4db None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:47.453760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:47.471059 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f64748-2dcd-4657-9cc0-09777e5b6303 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:47.505721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5ddde-d504-446d-ad46-4cd35404e4db None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:47.507493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ebc7f-01f9-423a-8f3a-5e29996da3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:47.508899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ebc7f-01f9-423a-8f3a-5e29996da3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:47.509416 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ebc7f-01f9-423a-8f3a-5e29996da3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:47.509886 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ebc7f-01f9-423a-8f3a-5e29996da3a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:47.521221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ebc7f-01f9-423a-8f3a-5e29996da3a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:47.532966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-f93ebc7f-01f9-423a-8f3a-5e29996da3a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:47.532966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:47.532966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:47.532966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:47.532966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:47.532966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:47.532966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:47.532966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:47.532966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:47.532966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:47.532966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:47.532966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:47.532966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:47.532966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:47.532966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:47.532966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:47.533966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:47.533966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:47.533966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:47.533966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:47.533966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:47.533966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:47.533966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:47.533966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:47.533966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:47.533966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:47.533966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:47.533966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:47.533966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:47.533966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:47.533966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:47.533966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:47.534773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:47.534773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:47.534773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:47.534773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:47.534773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:47.534773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:47.534773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:47.534773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:47.534773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:47.534773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:47.534773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:47.534773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:47.537231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 181/367] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:21:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:47.538354 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ebc7f-01f9-423a-8f3a-5e29996da3a5 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:47.544330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9025e-dd9b-4cee-9412-716659834e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:47.545223 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9025e-dd9b-4cee-9412-716659834e18 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:47.545558 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9025e-dd9b-4cee-9412-716659834e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:47.545845 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a9025e-dd9b-4cee-9412-716659834e18 None admin] PATH_INFO: `/v3/groups/dadaa50ccc2143eb86169726387512eb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:47.547036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9025e-dd9b-4cee-9412-716659834e18 None admin] RBAC: Authorizing `identity:get_group(group_id=dadaa50ccc2143eb86169726387512eb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:47.548523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a9025e-dd9b-4cee-9412-716659834e18 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:47.550542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 187/368] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 15 00:21:47 2022] GET /identity/v3/groups/dadaa50ccc2143eb86169726387512eb => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:47.551375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9025e-dd9b-4cee-9412-716659834e18 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:47.576077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:47.646790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ebc7f-01f9-423a-8f3a-5e29996da3a5 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:47.662756 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a9025e-dd9b-4cee-9412-716659834e18 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:47.683506 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb18c52-d8c4-4476-b14d-1a1bb6e59abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:47.684703 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb18c52-d8c4-4476-b14d-1a1bb6e59abb None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:47.685234 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb18c52-d8c4-4476-b14d-1a1bb6e59abb None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:47.685740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb18c52-d8c4-4476-b14d-1a1bb6e59abb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:47.698079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb18c52-d8c4-4476-b14d-1a1bb6e59abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:47.706668 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda9d17-66c9-4036-8533-d97d196bcb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:47.707031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-edb18c52-d8c4-4476-b14d-1a1bb6e59abb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:47.707031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:47.707031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:47.707031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:47.707031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:47.707031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:47.707031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:47.707031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:47.707031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:47.707031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:47.707031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:47.707031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:47.707031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:47.707031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:47.707031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:47.707031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:47.707905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:47.707905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:47.707905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:47.707905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:47.707905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:47.707905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:47.707905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:47.707905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:47.707905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:47.707905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:47.707905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:47.707905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:47.707905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:47.707905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:47.707905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:47.707905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:47.708755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:47.708755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:47.708755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:47.708755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:47.708755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:47.708755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:47.708755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:47.708755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:47.708755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:47.708755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:47.708755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:47.708755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:47.709919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda9d17-66c9-4036-8533-d97d196bcb50 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:47.709919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda9d17-66c9-4036-8533-d97d196bcb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:47.709919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda9d17-66c9-4036-8533-d97d196bcb50 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:47.709919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda9d17-66c9-4036-8533-d97d196bcb50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:47.709919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda9d17-66c9-4036-8533-d97d196bcb50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:47.710369 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda9d17-66c9-4036-8533-d97d196bcb50 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:47.712022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 182/369] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:21:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:47.713234 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb18c52-d8c4-4476-b14d-1a1bb6e59abb None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:47.720027 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 188/370] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:21:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:47.720943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda9d17-66c9-4036-8533-d97d196bcb50 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:47.741767 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:47.812667 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:47.829270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb18c52-d8c4-4476-b14d-1a1bb6e59abb None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:47.857764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda9d17-66c9-4036-8533-d97d196bcb50 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:47.866573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0f0e9-f8fc-43b9-81ec-3d918e44b5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:47.867487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0f0e9-f8fc-43b9-81ec-3d918e44b5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:47.867953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0f0e9-f8fc-43b9-81ec-3d918e44b5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:47.868393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0f0e9-f8fc-43b9-81ec-3d918e44b5c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:47.869482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0f0e9-f8fc-43b9-81ec-3d918e44b5c5 None admin] RBAC: Adding query filter params (group.id=dadaa50ccc2143eb86169726387512eb, role.id=5dd696285c0b41d3acb854981774eaae, scope.project.id=b007b4f89cb74f898cbd2e8eb9919989) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:47.869950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0f0e9-f8fc-43b9-81ec-3d918e44b5c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:47.871601 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0f0e9-f8fc-43b9-81ec-3d918e44b5c5 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:47.878186 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 183/371] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 15 00:21:47 2022] GET /identity/v3/role_assignments?group.id=dadaa50ccc2143eb86169726387512eb&scope.project.id=b007b4f89cb74f898cbd2e8eb9919989&role.id=5dd696285c0b41d3acb854981774eaae => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:47.879225 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0f0e9-f8fc-43b9-81ec-3d918e44b5c5 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:47.917205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb62d61-1282-4f30-acd9-b9f8a793efc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:47.918229 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb62d61-1282-4f30-acd9-b9f8a793efc4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:47.918658 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb62d61-1282-4f30-acd9-b9f8a793efc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:47.919076 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb62d61-1282-4f30-acd9-b9f8a793efc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:47.920024 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb62d61-1282-4f30-acd9-b9f8a793efc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:47.920481 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb62d61-1282-4f30-acd9-b9f8a793efc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:47.922989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb62d61-1282-4f30-acd9-b9f8a793efc4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:47.940771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 189/372] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:47.950459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb62d61-1282-4f30-acd9-b9f8a793efc4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:47.996982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:48.037211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0f0e9-f8fc-43b9-81ec-3d918e44b5c5 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:48.074703 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ded26-4395-45d6-9304-a40c0baaa5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:48.075391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ded26-4395-45d6-9304-a40c0baaa5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:48.075680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ded26-4395-45d6-9304-a40c0baaa5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:48.076303 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ded26-4395-45d6-9304-a40c0baaa5c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:48.157607 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ded26-4395-45d6-9304-a40c0baaa5c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:48.159101 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ded26-4395-45d6-9304-a40c0baaa5c1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:48.187230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb62d61-1282-4f30-acd9-b9f8a793efc4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:48.224366 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffb4ad-1af4-4bd6-94d2-59ca0f4c094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:48.225031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffb4ad-1af4-4bd6-94d2-59ca0f4c094c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:48.225886 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffb4ad-1af4-4bd6-94d2-59ca0f4c094c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:48.226179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffb4ad-1af4-4bd6-94d2-59ca0f4c094c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:48.245416 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:48.257024 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:48.313453 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffb4ad-1af4-4bd6-94d2-59ca0f4c094c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:48.314927 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffb4ad-1af4-4bd6-94d2-59ca0f4c094c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:48.323555 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 184/373] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:48.329661 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ded26-4395-45d6-9304-a40c0baaa5c1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:48.463201 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 190/374] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:48.472712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffb4ad-1af4-4bd6-94d2-59ca0f4c094c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:48.529826 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ded26-4395-45d6-9304-a40c0baaa5c1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:48.539052 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:48.590901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffb4ad-1af4-4bd6-94d2-59ca0f4c094c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:48.618533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248dd27-564d-4009-95c0-954710d728ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:48.619427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248dd27-564d-4009-95c0-954710d728ac None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:48.619712 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248dd27-564d-4009-95c0-954710d728ac None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:48.619992 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248dd27-564d-4009-95c0-954710d728ac None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:48.621215 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248dd27-564d-4009-95c0-954710d728ac None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:48.622738 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248dd27-564d-4009-95c0-954710d728ac None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:48.625923 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 185/375] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:48 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:48.632277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf7462-8874-4230-a8e9-3b8b0225d6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:48.633374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf7462-8874-4230-a8e9-3b8b0225d6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:48.633578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf7462-8874-4230-a8e9-3b8b0225d6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:48.633865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf7462-8874-4230-a8e9-3b8b0225d6b6 None admin] PATH_INFO: `/v3/projects/ac65417652594c99a423cc960be9081e` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:48.634257 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248dd27-564d-4009-95c0-954710d728ac None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:48.635189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf7462-8874-4230-a8e9-3b8b0225d6b6 None admin] RBAC: Authorizing `identity:get_project(project_id=ac65417652594c99a423cc960be9081e)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:48.636670 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf7462-8874-4230-a8e9-3b8b0225d6b6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:48.639609 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 191/376] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:48 2022] GET /identity/v3/projects/ac65417652594c99a423cc960be9081e => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:48.645496 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf7462-8874-4230-a8e9-3b8b0225d6b6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:48.705759 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:48.804462 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248dd27-564d-4009-95c0-954710d728ac None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:48.842173 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf7462-8874-4230-a8e9-3b8b0225d6b6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:48.863644 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:48.870138 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cddf47-13be-4ec6-b7df-17daf3177757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:48.871030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cddf47-13be-4ec6-b7df-17daf3177757 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:48.871312 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cddf47-13be-4ec6-b7df-17daf3177757 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:48.871576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cddf47-13be-4ec6-b7df-17daf3177757 None admin] PATH_INFO: `/v3/groups/dadaa50ccc2143eb86169726387512eb` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:48.873531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cddf47-13be-4ec6-b7df-17daf3177757 None admin] RBAC: Authorizing `identity:get_group(group_id=dadaa50ccc2143eb86169726387512eb)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:48.875009 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cddf47-13be-4ec6-b7df-17daf3177757 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:48.880025 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 186/377] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 15 00:21:48 2022] GET /identity/v3/groups/dadaa50ccc2143eb86169726387512eb => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:48.883529 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cddf47-13be-4ec6-b7df-17daf3177757 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:48.907584 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f753e-7512-4f08-ae65-62dc3330d3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:48.908469 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f753e-7512-4f08-ae65-62dc3330d3ad None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:48.908747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f753e-7512-4f08-ae65-62dc3330d3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:48.909016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f753e-7512-4f08-ae65-62dc3330d3ad None admin] PATH_INFO: `/v3/groups/e4c54504ee844f13ad562f91c6489665` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:48.920218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f753e-7512-4f08-ae65-62dc3330d3ad None admin] RBAC: Authorizing `identity:get_group(group_id=e4c54504ee844f13ad562f91c6489665)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:48.921753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f753e-7512-4f08-ae65-62dc3330d3ad None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:48.925184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 192/378] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 15 00:21:48 2022] GET /identity/v3/groups/e4c54504ee844f13ad562f91c6489665 => generated 229 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:48.930080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f753e-7512-4f08-ae65-62dc3330d3ad None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:49.053720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cddf47-13be-4ec6-b7df-17daf3177757 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:49.081704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:49.133805 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f33ed1-04e3-458f-85ef-9bc41a8d219a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:49.134483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33ed1-04e3-458f-85ef-9bc41a8d219a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:49.134766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33ed1-04e3-458f-85ef-9bc41a8d219a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:49.135044 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33ed1-04e3-458f-85ef-9bc41a8d219a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:49.135889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f33ed1-04e3-458f-85ef-9bc41a8d219a None admin] RBAC: Adding query filter params (group.id=dadaa50ccc2143eb86169726387512eb, role.id=1be1544572744e849ed04df01cdca3fb, scope.project.id=b007b4f89cb74f898cbd2e8eb9919989) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:49.136204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f33ed1-04e3-458f-85ef-9bc41a8d219a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:49.137698 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f33ed1-04e3-458f-85ef-9bc41a8d219a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:49.148757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 187/379] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 15 00:21:48 2022] GET /identity/v3/role_assignments?group.id=dadaa50ccc2143eb86169726387512eb&scope.project.id=b007b4f89cb74f898cbd2e8eb9919989&role.id=1be1544572744e849ed04df01cdca3fb => generated 260 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:49.150762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f753e-7512-4f08-ae65-62dc3330d3ad None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:49.191035 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a9096-0242-4e59-9f50-52f664bd9884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:49.191764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a9096-0242-4e59-9f50-52f664bd9884 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:49.192056 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a9096-0242-4e59-9f50-52f664bd9884 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:49.192333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a9096-0242-4e59-9f50-52f664bd9884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:49.193176 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a9096-0242-4e59-9f50-52f664bd9884 None admin] RBAC: Adding query filter params (group.id=e4c54504ee844f13ad562f91c6489665, role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=ac65417652594c99a423cc960be9081e) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:49.193516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a9096-0242-4e59-9f50-52f664bd9884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:49.195025 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a9096-0242-4e59-9f50-52f664bd9884 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:49.201566 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 193/380] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 15 00:21:48 2022] GET /identity/v3/role_assignments?group.id=e4c54504ee844f13ad562f91c6489665&scope.project.id=ac65417652594c99a423cc960be9081e&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 260 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:49.606482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e2ea-c9c7-47c5-b7b7-fcb955a17067 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:49.607045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e2ea-c9c7-47c5-b7b7-fcb955a17067 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:49.607295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704e2ea-c9c7-47c5-b7b7-fcb955a17067 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:49.608981 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 188/381] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:49.614059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb0968-d827-4934-9813-42c10d724262 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:49.614459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb0968-d827-4934-9813-42c10d724262 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:49.614624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb0968-d827-4934-9813-42c10d724262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:49.637449 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e3cb0968-d827-4934-9813-42c10d724262 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:49.638629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e3cb0968-d827-4934-9813-42c10d724262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:49.685186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:49.728979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 194/382] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:49.754867 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704e2ea-c9c7-47c5-b7b7-fcb955a17067 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:49.861999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9eeda-b510-42e7-8338-cec3bf1993ce None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:49.862186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9eeda-b510-42e7-8338-cec3bf1993ce None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:49.862468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9eeda-b510-42e7-8338-cec3bf1993ce None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:49.863860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 195/383] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:21:49.869444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c7f8f-595e-441d-a269-caaea42f1f6c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:49.869734 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c7f8f-595e-441d-a269-caaea42f1f6c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:49.870013 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c7f8f-595e-441d-a269-caaea42f1f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:49.901119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d72c7f8f-595e-441d-a269-caaea42f1f6c None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:49.903337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d72c7f8f-595e-441d-a269-caaea42f1f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:49.920431 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704e2ea-c9c7-47c5-b7b7-fcb955a17067 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:49.989584 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990ef2f-19e8-4fd3-a673-93682821b937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:49.991253 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990ef2f-19e8-4fd3-a673-93682821b937 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:49.991735 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990ef2f-19e8-4fd3-a673-93682821b937 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:49.992291 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990ef2f-19e8-4fd3-a673-93682821b937 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.015141 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990ef2f-19e8-4fd3-a673-93682821b937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:50.028854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-e990ef2f-19e8-4fd3-a673-93682821b937 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:50.028854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:50.028854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:50.028854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:50.028854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:50.028854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:50.028854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:50.028854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:50.028854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:50.028854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:50.028854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:50.028854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:50.028854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:50.028854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:50.028854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:50.028854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:50.029828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:50.029828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:50.029828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:50.029828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:50.029828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:50.029828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:50.029828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:50.029828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:50.029828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:50.029828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:50.029828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:50.029828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:50.029828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:50.029828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:50.029828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:50.029828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:50.030649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:50.030649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:50.030649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:50.030649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:50.030649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:50.030649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:50.030649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:50.030649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:50.030649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:50.030649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:50.030649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:50.030649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:50.036414 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 189/384] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:50.046383 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990ef2f-19e8-4fd3-a673-93682821b937 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.047915 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 196/385] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:50.080091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c7f8f-595e-441d-a269-caaea42f1f6c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.125823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:50.223118 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:50.226248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c7f8f-595e-441d-a269-caaea42f1f6c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.251749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990ef2f-19e8-4fd3-a673-93682821b937 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.271483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29931606-c198-40da-9a21-5dfa909a99e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:50.272326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29931606-c198-40da-9a21-5dfa909a99e4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.272612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29931606-c198-40da-9a21-5dfa909a99e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.272887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29931606-c198-40da-9a21-5dfa909a99e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.294003 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29931606-c198-40da-9a21-5dfa909a99e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:50.302651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-29931606-c198-40da-9a21-5dfa909a99e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:50.302651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:50.302651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:50.302651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:50.302651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:50.302651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:50.302651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:50.302651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:50.302651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:50.302651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:50.302651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:50.302651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:50.302651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:50.302651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:50.302651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:50.302651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:50.303555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:50.303555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:50.303555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:50.303555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:50.303555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:50.303555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:50.303555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:50.303555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:50.303555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:50.303555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:50.303555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:50.303555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:50.303555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:50.303555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:50.303555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:50.303555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:50.304360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:50.304360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:50.304360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:50.304360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:50.304360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:50.304360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:50.304360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:50.304360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:50.304360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:50.304360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:50.304360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:50.304360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:50.304360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 197/386] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:50.311449 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29931606-c198-40da-9a21-5dfa909a99e4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.329658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63351d47-48c7-4e8a-859b-fcad9d2f6b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:50.330408 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63351d47-48c7-4e8a-859b-fcad9d2f6b11 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.330694 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63351d47-48c7-4e8a-859b-fcad9d2f6b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.330972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63351d47-48c7-4e8a-859b-fcad9d2f6b11 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.331798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63351d47-48c7-4e8a-859b-fcad9d2f6b11 None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:50.332111 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63351d47-48c7-4e8a-859b-fcad9d2f6b11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:50.335121 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63351d47-48c7-4e8a-859b-fcad9d2f6b11 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:50.354202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 190/387] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:50.359786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63351d47-48c7-4e8a-859b-fcad9d2f6b11 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.485718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:50.496072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63351d47-48c7-4e8a-859b-fcad9d2f6b11 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.513070 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29931606-c198-40da-9a21-5dfa909a99e4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.565469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee018b-62e4-4af0-9160-f00d66e4e8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:50.566766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee018b-62e4-4af0-9160-f00d66e4e8bf None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.567241 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee018b-62e4-4af0-9160-f00d66e4e8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.567705 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee018b-62e4-4af0-9160-f00d66e4e8bf None admin] PATH_INFO: `/v3/groups/dadaa50ccc2143eb86169726387512eb` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.571657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee018b-62e4-4af0-9160-f00d66e4e8bf None admin] RBAC: Authorizing `identity:get_group(group_id=dadaa50ccc2143eb86169726387512eb)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:50.573580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee018b-62e4-4af0-9160-f00d66e4e8bf None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:50.573977 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f96df7-fbaf-4356-9ca3-9df3d111f013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:50.574802 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f96df7-fbaf-4356-9ca3-9df3d111f013 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.575240 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f96df7-fbaf-4356-9ca3-9df3d111f013 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.575617 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f96df7-fbaf-4356-9ca3-9df3d111f013 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.576535 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 191/388] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/groups/dadaa50ccc2143eb86169726387512eb => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:50.576663 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f96df7-fbaf-4356-9ca3-9df3d111f013 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:50.577761 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f96df7-fbaf-4356-9ca3-9df3d111f013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:50.578790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f96df7-fbaf-4356-9ca3-9df3d111f013 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:50.584848 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee018b-62e4-4af0-9160-f00d66e4e8bf None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.592188 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 198/389] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:50.599182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f96df7-fbaf-4356-9ca3-9df3d111f013 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.641431 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:50.735052 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee018b-62e4-4af0-9160-f00d66e4e8bf None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.780427 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f96df7-fbaf-4356-9ca3-9df3d111f013 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.789786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9129ee-7d3f-4539-894d-5649feac27c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:50.790695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9129ee-7d3f-4539-894d-5649feac27c8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.790982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9129ee-7d3f-4539-894d-5649feac27c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.791261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9129ee-7d3f-4539-894d-5649feac27c8 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.794234 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9129ee-7d3f-4539-894d-5649feac27c8 None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:50.796174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9129ee-7d3f-4539-894d-5649feac27c8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:50.798480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 192/390] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:50.800110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d1c1d-d222-432e-a6ff-e9cec507fdf5 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.805276 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d1c1d-d222-432e-a6ff-e9cec507fdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.805955 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d1c1d-d222-432e-a6ff-e9cec507fdf5 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.807558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 193/391] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:50.808483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d1c1d-d222-432e-a6ff-e9cec507fdf5 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.827000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762b1c7-07f8-40af-9328-347ae61e0b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:50.827894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762b1c7-07f8-40af-9328-347ae61e0b6d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.828189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762b1c7-07f8-40af-9328-347ae61e0b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.828473 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762b1c7-07f8-40af-9328-347ae61e0b6d None admin] PATH_INFO: `/v3/groups/dadaa50ccc2143eb86169726387512eb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.830804 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762b1c7-07f8-40af-9328-347ae61e0b6d None admin] RBAC: Authorizing `identity:get_group(group_id=dadaa50ccc2143eb86169726387512eb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:50.832346 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762b1c7-07f8-40af-9328-347ae61e0b6d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:50.834613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 199/392] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/groups/dadaa50ccc2143eb86169726387512eb => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:50.835952 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8ddb9-0e8d-48fc-a6f8-cd0b4532438a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:50.836315 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8ddb9-0e8d-48fc-a6f8-cd0b4532438a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:50.836603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8ddb9-0e8d-48fc-a6f8-cd0b4532438a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:50.849710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:50.858751 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-83b8ddb9-0e8d-48fc-a6f8-cd0b4532438a None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:50.860417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-83b8ddb9-0e8d-48fc-a6f8-cd0b4532438a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:50.950871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d1c1d-d222-432e-a6ff-e9cec507fdf5 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:50.962819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 200/393] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:50.964030 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8ddb9-0e8d-48fc-a6f8-cd0b4532438a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:50.998363 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:51.010207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0e0ef-9dec-411a-b2e6-70839a6382e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.011586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0e0ef-9dec-411a-b2e6-70839a6382e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.012415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0e0ef-9dec-411a-b2e6-70839a6382e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.012856 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0e0ef-9dec-411a-b2e6-70839a6382e4 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab/groups/dadaa50ccc2143eb86169726387512eb/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.015385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0e0ef-9dec-411a-b2e6-70839a6382e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a82bf7161bd44f5e83eae52981f952ab, group_id=dadaa50ccc2143eb86169726387512eb, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:51.018180 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0e0ef-9dec-411a-b2e6-70839a6382e4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:51.049029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 194/394] 10.222.0.36 () {58 vars in 1442 bytes} [Wed Jun 15 00:21:50 2022] PUT /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab/groups/dadaa50ccc2143eb86169726387512eb/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:51.049029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0e0ef-9dec-411a-b2e6-70839a6382e4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:51.119130 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8ddb9-0e8d-48fc-a6f8-cd0b4532438a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:51.164709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77729cd6-64eb-45a1-a82f-b3b9cbd62fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.165922 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77729cd6-64eb-45a1-a82f-b3b9cbd62fbc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.166207 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77729cd6-64eb-45a1-a82f-b3b9cbd62fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.166483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77729cd6-64eb-45a1-a82f-b3b9cbd62fbc None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.167738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77729cd6-64eb-45a1-a82f-b3b9cbd62fbc None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:51.169282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77729cd6-64eb-45a1-a82f-b3b9cbd62fbc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:51.171685 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 201/395] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:50 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:51.176973 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:51.178266 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77729cd6-64eb-45a1-a82f-b3b9cbd62fbc None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:51.196113 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0e0ef-9dec-411a-b2e6-70839a6382e4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:51.244027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2341fc-4396-482b-9793-7a122422bf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.245240 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2341fc-4396-482b-9793-7a122422bf95 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.245745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2341fc-4396-482b-9793-7a122422bf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.246780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2341fc-4396-482b-9793-7a122422bf95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.261864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2341fc-4396-482b-9793-7a122422bf95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:51.272597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-ed2341fc-4396-482b-9793-7a122422bf95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:51.272597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:51.272597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:51.272597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:51.272597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:51.272597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:51.272597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:51.272597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:51.272597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:51.272597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:51.272597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:51.272597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:51.272597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:51.272597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:51.272597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:51.272597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:51.273757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:51.273757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:51.273757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:51.273757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:51.273757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:51.273757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:51.273757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:51.273757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:51.273757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:51.273757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:51.273757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:51.273757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:51.273757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:51.273757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:51.273757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:51.273757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:51.274606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:51.274606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:51.274606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:51.274606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:51.274606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:51.274606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:51.274606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:51.274606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:51.274606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:51.274606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:51.274606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:51.274606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:51.278137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 195/396] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:51.284864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2341fc-4396-482b-9793-7a122422bf95 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:51.296147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:51.315778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77729cd6-64eb-45a1-a82f-b3b9cbd62fbc None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:51.364797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68b15e-6c0b-46da-9874-8e3ca631d359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.366139 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68b15e-6c0b-46da-9874-8e3ca631d359 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.366423 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68b15e-6c0b-46da-9874-8e3ca631d359 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.366702 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68b15e-6c0b-46da-9874-8e3ca631d359 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab/groups/dadaa50ccc2143eb86169726387512eb/roles/1be1544572744e849ed04df01cdca3fb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.369941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68b15e-6c0b-46da-9874-8e3ca631d359 None admin] RBAC: Authorizing `identity:create_grant(project_id=a82bf7161bd44f5e83eae52981f952ab, group_id=dadaa50ccc2143eb86169726387512eb, role_id=1be1544572744e849ed04df01cdca3fb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:51.371551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68b15e-6c0b-46da-9874-8e3ca631d359 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:51.400497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 202/397] 10.222.0.36 () {58 vars in 1442 bytes} [Wed Jun 15 00:21:51 2022] PUT /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab/groups/dadaa50ccc2143eb86169726387512eb/roles/1be1544572744e849ed04df01cdca3fb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:51.437807 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2341fc-4396-482b-9793-7a122422bf95 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:51.480015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd18f76-20ca-44ce-b969-4dcc0e7ae6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.480719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd18f76-20ca-44ce-b969-4dcc0e7ae6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.481006 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd18f76-20ca-44ce-b969-4dcc0e7ae6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.481326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd18f76-20ca-44ce-b969-4dcc0e7ae6a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.482192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd18f76-20ca-44ce-b969-4dcc0e7ae6a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:51.482505 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd18f76-20ca-44ce-b969-4dcc0e7ae6a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:51.483971 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd18f76-20ca-44ce-b969-4dcc0e7ae6a3 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:51.494621 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 196/398] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:51.500188 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68b15e-6c0b-46da-9874-8e3ca631d359 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:51.624603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68b15e-6c0b-46da-9874-8e3ca631d359 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:51.661895 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96380d40-1341-4a5a-86df-f4442bd81e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.662785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96380d40-1341-4a5a-86df-f4442bd81e73 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.663131 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96380d40-1341-4a5a-86df-f4442bd81e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.663414 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96380d40-1341-4a5a-86df-f4442bd81e73 None admin] PATH_INFO: `/v3/groups/dadaa50ccc2143eb86169726387512eb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.664692 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96380d40-1341-4a5a-86df-f4442bd81e73 None admin] RBAC: Authorizing `identity:get_group(group_id=dadaa50ccc2143eb86169726387512eb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:51.666174 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96380d40-1341-4a5a-86df-f4442bd81e73 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:51.667893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 203/399] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 15 00:21:51 2022] GET /identity/v3/groups/dadaa50ccc2143eb86169726387512eb => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:51.673585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd18f76-20ca-44ce-b969-4dcc0e7ae6a3 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:51.687648 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:51.780892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd18f76-20ca-44ce-b969-4dcc0e7ae6a3 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:51.814713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141d9ec-60e3-49c9-b897-4b878f3823da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.815611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141d9ec-60e3-49c9-b897-4b878f3823da None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.815905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141d9ec-60e3-49c9-b897-4b878f3823da None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.816182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141d9ec-60e3-49c9-b897-4b878f3823da None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.817391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141d9ec-60e3-49c9-b897-4b878f3823da None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:51.818848 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141d9ec-60e3-49c9-b897-4b878f3823da None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:51.820902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 197/400] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:51 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:51.826687 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96380d40-1341-4a5a-86df-f4442bd81e73 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:51.845050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:51.932543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96380d40-1341-4a5a-86df-f4442bd81e73 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:51.967861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb381ec9-9ad6-486f-8bf3-1b3470a1feba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:51.968770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb381ec9-9ad6-486f-8bf3-1b3470a1feba None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:51.969053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb381ec9-9ad6-486f-8bf3-1b3470a1feba None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:51.969452 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb381ec9-9ad6-486f-8bf3-1b3470a1feba None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989/groups/dadaa50ccc2143eb86169726387512eb/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:51.971430 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb381ec9-9ad6-486f-8bf3-1b3470a1feba None admin] RBAC: Authorizing `identity:create_grant(project_id=b007b4f89cb74f898cbd2e8eb9919989, group_id=dadaa50ccc2143eb86169726387512eb, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:51.972882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb381ec9-9ad6-486f-8bf3-1b3470a1feba None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:51.988739 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 204/401] 10.222.0.36 () {58 vars in 1442 bytes} [Wed Jun 15 00:21:51 2022] PUT /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989/groups/dadaa50ccc2143eb86169726387512eb/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:52.095113 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c3bc7-b30a-4b7a-b305-22bd19694538 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:52.095466 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c3bc7-b30a-4b7a-b305-22bd19694538 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:52.095683 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c3bc7-b30a-4b7a-b305-22bd19694538 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:52.097547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 198/402] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:52.103590 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4fbc7-fb53-4276-b3ee-d09638c376d8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:52.103893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4fbc7-fb53-4276-b3ee-d09638c376d8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:52.104160 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4fbc7-fb53-4276-b3ee-d09638c376d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:52.130532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c1c4fbc7-fb53-4276-b3ee-d09638c376d8 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:52.131758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c1c4fbc7-fb53-4276-b3ee-d09638c376d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:52.165449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e896108-bc48-426b-8081-08b1004dbbd9 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:52.165766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e896108-bc48-426b-8081-08b1004dbbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:52.166010 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e896108-bc48-426b-8081-08b1004dbbd9 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:52.167647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 199/403] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:21:52.174741 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d941fe6-1f13-4ec6-90b9-059aae12422a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:52.175028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d941fe6-1f13-4ec6-90b9-059aae12422a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:52.175311 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d941fe6-1f13-4ec6-90b9-059aae12422a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:52.213115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 205/404] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:52.218662 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1d941fe6-1f13-4ec6-90b9-059aae12422a None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:52.219890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1d941fe6-1f13-4ec6-90b9-059aae12422a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:52.252217 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4fbc7-fb53-4276-b3ee-d09638c376d8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:52.260620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:52.318411 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 200/405] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:52.341203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d941fe6-1f13-4ec6-90b9-059aae12422a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:52.354031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:52.367379 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4fbc7-fb53-4276-b3ee-d09638c376d8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:52.402654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15869ed7-d43b-4cb5-b0f9-f2c9883f12b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:52.403696 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15869ed7-d43b-4cb5-b0f9-f2c9883f12b7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:52.404118 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15869ed7-d43b-4cb5-b0f9-f2c9883f12b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:52.404557 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15869ed7-d43b-4cb5-b0f9-f2c9883f12b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:52.415240 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15869ed7-d43b-4cb5-b0f9-f2c9883f12b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:52.423861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-15869ed7-d43b-4cb5-b0f9-f2c9883f12b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:52.423861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:52.423861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:52.423861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:52.423861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:52.423861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:52.423861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:52.423861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:52.423861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:52.423861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:52.423861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:52.423861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:52.423861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:52.423861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:52.423861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:52.423861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:52.424935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:52.424935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:52.424935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:52.424935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:52.424935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:52.424935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:52.424935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:52.424935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:52.424935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:52.424935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:52.424935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:52.424935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:52.424935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:52.424935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:52.424935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:52.424935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:52.425961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:52.425961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:52.425961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:52.425961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:52.425961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:52.425961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:52.425961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:52.425961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:52.425961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:52.425961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:52.425961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:52.425961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:52.428384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 206/406] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:21:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:21:52.435316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15869ed7-d43b-4cb5-b0f9-f2c9883f12b7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:52.536152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d941fe6-1f13-4ec6-90b9-059aae12422a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:52.556629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:52.607612 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf812d32-12b6-4b6d-b0c7-aec7b0895da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:52.608859 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf812d32-12b6-4b6d-b0c7-aec7b0895da1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:52.610265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf812d32-12b6-4b6d-b0c7-aec7b0895da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:52.610871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf812d32-12b6-4b6d-b0c7-aec7b0895da1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:52.623299 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15869ed7-d43b-4cb5-b0f9-f2c9883f12b7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:52.634854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf812d32-12b6-4b6d-b0c7-aec7b0895da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:52.648019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-cf812d32-12b6-4b6d-b0c7-aec7b0895da1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:52.648019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:52.648019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:52.648019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:52.648019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:52.648019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:52.648019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:52.648019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:52.648019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:52.648019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:52.648019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:52.648019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:52.648019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:52.648019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:52.648019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:52.648019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:52.649070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:52.649070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:52.649070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:52.649070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:52.649070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:52.649070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:52.649070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:52.649070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:52.649070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:52.649070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:52.649070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:52.649070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:52.649070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:52.649070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:52.649070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:52.649070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:52.649901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:52.649901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:52.649901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:52.649901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:52.649901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:52.649901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:52.649901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:52.649901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:52.649901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:52.649901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:52.649901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:52.649901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:52.659382 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 201/407] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:21:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:21:52.661396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf812d32-12b6-4b6d-b0c7-aec7b0895da1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:52.707387 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d4620-e9b7-401c-b422-f251e895ce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:52.708083 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d4620-e9b7-401c-b422-f251e895ce75 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:52.708371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d4620-e9b7-401c-b422-f251e895ce75 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:52.708651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d4620-e9b7-401c-b422-f251e895ce75 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:52.709455 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d4620-e9b7-401c-b422-f251e895ce75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:52.709770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d4620-e9b7-401c-b422-f251e895ce75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:52.711196 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d4620-e9b7-401c-b422-f251e895ce75 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:52.727035 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 207/408] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:52.732864 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d4620-e9b7-401c-b422-f251e895ce75 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:52.786092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:52.842126 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf812d32-12b6-4b6d-b0c7-aec7b0895da1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:52.887091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d4620-e9b7-401c-b422-f251e895ce75 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:52.894057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b02e6-c0f9-4064-ab55-a31f7039a272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:52.894878 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b02e6-c0f9-4064-ab55-a31f7039a272 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:52.895256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b02e6-c0f9-4064-ab55-a31f7039a272 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:52.895630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b02e6-c0f9-4064-ab55-a31f7039a272 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:52.896491 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b02e6-c0f9-4064-ab55-a31f7039a272 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:52.896898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b02e6-c0f9-4064-ab55-a31f7039a272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:52.898425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b02e6-c0f9-4064-ab55-a31f7039a272 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:52.916631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:52.927322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 202/409] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:21:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:52.927479 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18232f-178f-4adc-a178-c789feadd719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:52.927572 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18232f-178f-4adc-a178-c789feadd719 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:52.927867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18232f-178f-4adc-a178-c789feadd719 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:52.928401 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18232f-178f-4adc-a178-c789feadd719 None admin] PATH_INFO: `/v3/groups/e4c54504ee844f13ad562f91c6489665` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:52.929858 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b02e6-c0f9-4064-ab55-a31f7039a272 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:52.933230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18232f-178f-4adc-a178-c789feadd719 None admin] RBAC: Authorizing `identity:get_group(group_id=e4c54504ee844f13ad562f91c6489665)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:52.934762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18232f-178f-4adc-a178-c789feadd719 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:52.941816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 208/410] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 15 00:21:52 2022] GET /identity/v3/groups/e4c54504ee844f13ad562f91c6489665 => generated 229 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:52.943354 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18232f-178f-4adc-a178-c789feadd719 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:53.149532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18232f-178f-4adc-a178-c789feadd719 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:53.206516 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b02e6-c0f9-4064-ab55-a31f7039a272 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:53.266952 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975318dc-bd99-4a93-9d86-ff327823233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:53.267847 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975318dc-bd99-4a93-9d86-ff327823233c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:53.268136 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975318dc-bd99-4a93-9d86-ff327823233c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:53.268413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975318dc-bd99-4a93-9d86-ff327823233c None admin] PATH_INFO: `/v3/projects/ac65417652594c99a423cc960be9081e` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:53.274138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975318dc-bd99-4a93-9d86-ff327823233c None admin] RBAC: Authorizing `identity:get_project(project_id=ac65417652594c99a423cc960be9081e)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:53.275610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975318dc-bd99-4a93-9d86-ff327823233c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:53.282229 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 209/411] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:52 2022] GET /identity/v3/projects/ac65417652594c99a423cc960be9081e => generated 344 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:53.283561 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975318dc-bd99-4a93-9d86-ff327823233c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:53.318340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:53.334161 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c3337-a220-4eef-9532-f48ab954ffa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:53.336000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c3337-a220-4eef-9532-f48ab954ffa8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:53.337190 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c3337-a220-4eef-9532-f48ab954ffa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:53.339479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c3337-a220-4eef-9532-f48ab954ffa8 None admin] PATH_INFO: `/v3/groups/dadaa50ccc2143eb86169726387512eb` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:53.340882 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c3337-a220-4eef-9532-f48ab954ffa8 None admin] RBAC: Authorizing `identity:get_group(group_id=dadaa50ccc2143eb86169726387512eb)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:53.343302 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c3337-a220-4eef-9532-f48ab954ffa8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:53.354083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 203/412] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 15 00:21:52 2022] GET /identity/v3/groups/dadaa50ccc2143eb86169726387512eb => generated 226 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:53.355696 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c3337-a220-4eef-9532-f48ab954ffa8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:53.397888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:53.468683 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975318dc-bd99-4a93-9d86-ff327823233c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:53.536489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f3b34-c084-4045-9f44-fa5c8da07126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:53.537691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f3b34-c084-4045-9f44-fa5c8da07126 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:53.538210 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f3b34-c084-4045-9f44-fa5c8da07126 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:53.538762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f3b34-c084-4045-9f44-fa5c8da07126 None admin] PATH_INFO: `/v3/projects/ac65417652594c99a423cc960be9081e/groups/e4c54504ee844f13ad562f91c6489665/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:53.541962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f3b34-c084-4045-9f44-fa5c8da07126 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac65417652594c99a423cc960be9081e, group_id=e4c54504ee844f13ad562f91c6489665, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:53.543845 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f3b34-c084-4045-9f44-fa5c8da07126 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:53.553717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c3337-a220-4eef-9532-f48ab954ffa8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:53.573653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 210/413] 10.222.0.36 () {58 vars in 1442 bytes} [Wed Jun 15 00:21:53 2022] PUT /identity/v3/projects/ac65417652594c99a423cc960be9081e/groups/e4c54504ee844f13ad562f91c6489665/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:21:53.623259 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9aa5ae-7aae-4586-996c-3ce708612f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:53.624173 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9aa5ae-7aae-4586-996c-3ce708612f36 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:53.624468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9aa5ae-7aae-4586-996c-3ce708612f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:53.624746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9aa5ae-7aae-4586-996c-3ce708612f36 None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:53.626037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9aa5ae-7aae-4586-996c-3ce708612f36 None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:53.627582 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9aa5ae-7aae-4586-996c-3ce708612f36 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:53.629787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 204/414] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:53 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:53.635729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f3b34-c084-4045-9f44-fa5c8da07126 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:53.787452 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f3b34-c084-4045-9f44-fa5c8da07126 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:53.819554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:53.841163 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75129d-6318-4126-aba3-03e40ac0b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:53.842170 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75129d-6318-4126-aba3-03e40ac0b5cc None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:53.842453 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75129d-6318-4126-aba3-03e40ac0b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:53.842784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75129d-6318-4126-aba3-03e40ac0b5cc None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989/groups/dadaa50ccc2143eb86169726387512eb/roles/1be1544572744e849ed04df01cdca3fb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:53.846502 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75129d-6318-4126-aba3-03e40ac0b5cc None admin] RBAC: Authorizing `identity:create_grant(project_id=b007b4f89cb74f898cbd2e8eb9919989, group_id=dadaa50ccc2143eb86169726387512eb, role_id=1be1544572744e849ed04df01cdca3fb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:53.849389 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75129d-6318-4126-aba3-03e40ac0b5cc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:53.869283 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 211/415] 10.222.0.36 () {58 vars in 1442 bytes} [Wed Jun 15 00:21:53 2022] PUT /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989/groups/dadaa50ccc2143eb86169726387512eb/roles/1be1544572744e849ed04df01cdca3fb => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:21:53.918848 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fbc7b-0ddd-4111-a9d1-e993e5c65969 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:53.919359 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fbc7b-0ddd-4111-a9d1-e993e5c65969 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:53.919434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fbc7b-0ddd-4111-a9d1-e993e5c65969 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:53.920966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 205/416] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:53.927016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187425bc-902e-4bad-b808-259ed57d8552 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:53.927347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187425bc-902e-4bad-b808-259ed57d8552 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:53.927587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187425bc-902e-4bad-b808-259ed57d8552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:53.950641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-187425bc-902e-4bad-b808-259ed57d8552 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:53.951870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-187425bc-902e-4bad-b808-259ed57d8552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:54.043507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 212/417] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:54.076991 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fbc7b-0ddd-4111-a9d1-e993e5c65969 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:54.160000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:54.167138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab68bce-e039-4385-a9fa-cf5af5f6520a None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.167431 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab68bce-e039-4385-a9fa-cf5af5f6520a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.167712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab68bce-e039-4385-a9fa-cf5af5f6520a None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.172684 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 213/418] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:54.174386 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1581a7-8608-4e02-96cb-07b6dbfbbdcd None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.174498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1581a7-8608-4e02-96cb-07b6dbfbbdcd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.174767 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1581a7-8608-4e02-96cb-07b6dbfbbdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.195844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1b1581a7-8608-4e02-96cb-07b6dbfbbdcd None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:54.197537 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1b1581a7-8608-4e02-96cb-07b6dbfbbdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:54.199611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fbc7b-0ddd-4111-a9d1-e993e5c65969 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:54.251957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786a1eb-bd81-4fc9-a67a-537e94f2486f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:54.252792 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786a1eb-bd81-4fc9-a67a-537e94f2486f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.253078 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786a1eb-bd81-4fc9-a67a-537e94f2486f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.253367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786a1eb-bd81-4fc9-a67a-537e94f2486f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.281166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786a1eb-bd81-4fc9-a67a-537e94f2486f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:54.288985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-5786a1eb-bd81-4fc9-a67a-537e94f2486f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:54.288985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:54.288985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:54.288985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:54.288985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:54.288985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:54.288985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:54.288985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:54.288985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:54.288985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:54.288985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:54.288985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:54.288985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:54.288985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:54.288985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:54.288985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:54.289978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:54.289978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:54.289978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:54.289978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:54.289978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:54.289978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:54.289978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:54.289978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:54.289978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:54.289978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:54.289978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:54.289978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:54.289978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:54.289978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:54.289978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:54.289978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:54.290797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:54.290797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:54.290797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:54.290797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:54.290797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:54.290797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:54.290797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:54.290797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:54.290797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:54.290797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:54.290797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:54.290797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:54.301086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 206/419] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:54.301985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786a1eb-bd81-4fc9-a67a-537e94f2486f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:54.320719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 214/420] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:54.348966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1581a7-8608-4e02-96cb-07b6dbfbbdcd None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:54.415750 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:54.449469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786a1eb-bd81-4fc9-a67a-537e94f2486f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:54.460781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1581a7-8608-4e02-96cb-07b6dbfbbdcd None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:54.498611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:54.502071 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78ba9b-efbd-4d09-aadb-eeefb09815ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:54.502915 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78ba9b-efbd-4d09-aadb-eeefb09815ab None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.503232 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78ba9b-efbd-4d09-aadb-eeefb09815ab None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.504064 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78ba9b-efbd-4d09-aadb-eeefb09815ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.515245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78ba9b-efbd-4d09-aadb-eeefb09815ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:54.518964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb8a4c-c71d-4166-8961-7ac80af5d67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:54.519653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb8a4c-c71d-4166-8961-7ac80af5d67b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.519936 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb8a4c-c71d-4166-8961-7ac80af5d67b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.520214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb8a4c-c71d-4166-8961-7ac80af5d67b None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.520982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb8a4c-c71d-4166-8961-7ac80af5d67b None admin] RBAC: Adding query filter params (name=member) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:54.521290 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb8a4c-c71d-4166-8961-7ac80af5d67b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:54.522814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb8a4c-c71d-4166-8961-7ac80af5d67b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:54.523716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5b78ba9b-efbd-4d09-aadb-eeefb09815ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:54.523716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:54.523716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:54.523716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:54.523716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:54.523716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:54.523716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:54.523716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:54.523716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:54.523716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:54.523716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:54.523716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:54.523716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:54.523716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:54.523716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:54.523716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:54.525666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:54.525666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:54.525666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:54.525666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:54.525666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:54.525666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:54.525666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:54.525666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:54.525666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:54.525666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:54.525666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:54.525666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:54.525666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:54.525666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:54.525666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:54.525666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:54.527501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:54.527501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:54.527501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:54.527501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:54.527501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:54.527501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:54.527501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:54.527501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:54.527501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:54.527501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:54.527501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:54.527501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:54.537648 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 215/421] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:21:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:21:54.537648 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78ba9b-efbd-4d09-aadb-eeefb09815ab None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:54.537868 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 207/422] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:54.539456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb8a4c-c71d-4166-8961-7ac80af5d67b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:54.641641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78ba9b-efbd-4d09-aadb-eeefb09815ab None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:54.644202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:54.677525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf491e1-aa05-4ff2-9c87-330f5626948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:54.678214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf491e1-aa05-4ff2-9c87-330f5626948d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.678502 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf491e1-aa05-4ff2-9c87-330f5626948d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.678783 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf491e1-aa05-4ff2-9c87-330f5626948d None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.679549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf491e1-aa05-4ff2-9c87-330f5626948d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:54.679887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf491e1-aa05-4ff2-9c87-330f5626948d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:54.681276 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf491e1-aa05-4ff2-9c87-330f5626948d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:54.689527 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 216/423] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:21:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:54.695404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba30f6-8a12-4c9c-a045-148c848d9e9d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.695792 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba30f6-8a12-4c9c-a045-148c848d9e9d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.696083 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba30f6-8a12-4c9c-a045-148c848d9e9d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.697912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 217/424] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:54.698649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba30f6-8a12-4c9c-a045-148c848d9e9d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:54.705239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb8a4c-c71d-4166-8961-7ac80af5d67b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:54.744769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cbecd-15bb-4440-b029-2eb8a093b9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:54.745508 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cbecd-15bb-4440-b029-2eb8a093b9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.745800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cbecd-15bb-4440-b029-2eb8a093b9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.746416 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cbecd-15bb-4440-b029-2eb8a093b9d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.814438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba30f6-8a12-4c9c-a045-148c848d9e9d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:54.826456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:54.841883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cbecd-15bb-4440-b029-2eb8a093b9d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:54.844020 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cbecd-15bb-4440-b029-2eb8a093b9d3 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:54.855308 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c1605-2bbe-401a-aa3c-1f55a25e8db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:54.856493 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c1605-2bbe-401a-aa3c-1f55a25e8db9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.856967 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c1605-2bbe-401a-aa3c-1f55a25e8db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.857510 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c1605-2bbe-401a-aa3c-1f55a25e8db9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.895782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:54.935604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c1605-2bbe-401a-aa3c-1f55a25e8db9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:54.937382 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c1605-2bbe-401a-aa3c-1f55a25e8db9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:54.972778 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 208/425] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:54.974518 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2a21f-84bf-4dd2-bd92-1f65aaf9e6ae None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:54.974814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2a21f-84bf-4dd2-bd92-1f65aaf9e6ae None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:54.975097 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2a21f-84bf-4dd2-bd92-1f65aaf9e6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:54.997276 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-bdd2a21f-84bf-4dd2-bd92-1f65aaf9e6ae None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:54.999149 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-bdd2a21f-84bf-4dd2-bd92-1f65aaf9e6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:55.049374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 218/426] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:55.050587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c1605-2bbe-401a-aa3c-1f55a25e8db9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:55.081859 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 209/427] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:55.089444 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2a21f-84bf-4dd2-bd92-1f65aaf9e6ae None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:55.101063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:55.150651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:55.184611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2a21f-84bf-4dd2-bd92-1f65aaf9e6ae None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.189939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c1605-2bbe-401a-aa3c-1f55a25e8db9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.219290 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7500e4b-e5d7-418b-8b79-0fb084f2bab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.220045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7500e4b-e5d7-418b-8b79-0fb084f2bab4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.220329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7500e4b-e5d7-418b-8b79-0fb084f2bab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.220645 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7500e4b-e5d7-418b-8b79-0fb084f2bab4 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.221843 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7500e4b-e5d7-418b-8b79-0fb084f2bab4 None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:55.223362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7500e4b-e5d7-418b-8b79-0fb084f2bab4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:55.228182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa536386-8723-4ace-bddd-e211ee96d786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.229281 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa536386-8723-4ace-bddd-e211ee96d786 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.229459 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 210/428] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:55 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:55.229903 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa536386-8723-4ace-bddd-e211ee96d786 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.230291 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7500e4b-e5d7-418b-8b79-0fb084f2bab4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:55.230544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa536386-8723-4ace-bddd-e211ee96d786 None admin] PATH_INFO: `/v3/projects/a82bf7161bd44f5e83eae52981f952ab` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.231935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa536386-8723-4ace-bddd-e211ee96d786 None admin] RBAC: Authorizing `identity:get_project(project_id=a82bf7161bd44f5e83eae52981f952ab)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:55.233979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa536386-8723-4ace-bddd-e211ee96d786 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:55.236254 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 219/429] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:55 2022] GET /identity/v3/projects/a82bf7161bd44f5e83eae52981f952ab => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:55.237592 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa536386-8723-4ace-bddd-e211ee96d786 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:55.331562 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:55.347264 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7500e4b-e5d7-418b-8b79-0fb084f2bab4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.350836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa536386-8723-4ace-bddd-e211ee96d786 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.382256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce75447-1863-4453-84c7-4969d4b42c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.383137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce75447-1863-4453-84c7-4969d4b42c3d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.383421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce75447-1863-4453-84c7-4969d4b42c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.383924 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce75447-1863-4453-84c7-4969d4b42c3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.388707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab2a98-08e4-4719-9246-fee18bfe7c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.389818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab2a98-08e4-4719-9246-fee18bfe7c85 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.390278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab2a98-08e4-4719-9246-fee18bfe7c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.391996 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab2a98-08e4-4719-9246-fee18bfe7c85 None admin] PATH_INFO: `/v3/groups/dadaa50ccc2143eb86169726387512eb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.393402 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab2a98-08e4-4719-9246-fee18bfe7c85 None admin] RBAC: Authorizing `identity:get_group(group_id=dadaa50ccc2143eb86169726387512eb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:55.394255 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce75447-1863-4453-84c7-4969d4b42c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:55.395280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab2a98-08e4-4719-9246-fee18bfe7c85 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:55.397105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 220/430] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 15 00:21:55 2022] GET /identity/v3/groups/dadaa50ccc2143eb86169726387512eb => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:55.398062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab2a98-08e4-4719-9246-fee18bfe7c85 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:55.400979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:55.407107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-4ce75447-1863-4453-84c7-4969d4b42c3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:55.407107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:55.407107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:55.407107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:55.407107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:55.407107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:55.407107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:55.407107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:55.407107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:55.407107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:55.407107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:55.407107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:55.407107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:55.407107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:55.407107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:55.407107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:55.408048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:55.408048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:55.408048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:55.408048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:55.408048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:55.408048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:55.408048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:55.408048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:55.408048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:55.408048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:55.408048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:55.408048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:55.408048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:55.408048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:55.408048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:55.408048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:55.408847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:55.408847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:55.408847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:55.408847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:55.408847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:55.408847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:55.408847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:55.408847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:55.408847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:55.408847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:55.408847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 15 00:21:55.408847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:55.408847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 211/431] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:55.409813 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce75447-1863-4453-84c7-4969d4b42c3d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:55.511846 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab2a98-08e4-4719-9246-fee18bfe7c85 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.516899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce75447-1863-4453-84c7-4969d4b42c3d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.548672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97ca4d-9089-4170-8ae5-6a6a5d0b6433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.550511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97ca4d-9089-4170-8ae5-6a6a5d0b6433 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.551233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97ca4d-9089-4170-8ae5-6a6a5d0b6433 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.551728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97ca4d-9089-4170-8ae5-6a6a5d0b6433 None admin] PATH_INFO: `/v3/groups/dadaa50ccc2143eb86169726387512eb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.553112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97ca4d-9089-4170-8ae5-6a6a5d0b6433 None admin] RBAC: Authorizing `identity:get_group(group_id=dadaa50ccc2143eb86169726387512eb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:55.554738 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b926609-6740-4039-b805-45dade6aac24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.555161 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97ca4d-9089-4170-8ae5-6a6a5d0b6433 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:55.555474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b926609-6740-4039-b805-45dade6aac24 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.555758 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b926609-6740-4039-b805-45dade6aac24 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.556034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b926609-6740-4039-b805-45dade6aac24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.556870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b926609-6740-4039-b805-45dade6aac24 None admin] RBAC: Adding query filter params (group.id=dadaa50ccc2143eb86169726387512eb, role.id=1be1544572744e849ed04df01cdca3fb, scope.project.id=a82bf7161bd44f5e83eae52981f952ab) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:55.557181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b926609-6740-4039-b805-45dade6aac24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:55.558425 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 221/432] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 15 00:21:55 2022] GET /identity/v3/groups/dadaa50ccc2143eb86169726387512eb => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:55.558730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b926609-6740-4039-b805-45dade6aac24 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:55.559580 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97ca4d-9089-4170-8ae5-6a6a5d0b6433 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:55.574064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 212/433] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 15 00:21:55 2022] GET /identity/v3/role_assignments?group.id=dadaa50ccc2143eb86169726387512eb&scope.project.id=a82bf7161bd44f5e83eae52981f952ab&role.id=1be1544572744e849ed04df01cdca3fb => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:55.575072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b926609-6740-4039-b805-45dade6aac24 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:55.603660 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:55.645825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:55.680791 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97ca4d-9089-4170-8ae5-6a6a5d0b6433 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.721957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280ef3d-88bf-48de-84aa-6eda37d9576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.723075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280ef3d-88bf-48de-84aa-6eda37d9576a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.723595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280ef3d-88bf-48de-84aa-6eda37d9576a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.724144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280ef3d-88bf-48de-84aa-6eda37d9576a None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.725803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280ef3d-88bf-48de-84aa-6eda37d9576a None admin] RBAC: Adding query filter params (name=member) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:55.726321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280ef3d-88bf-48de-84aa-6eda37d9576a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:55.727969 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280ef3d-88bf-48de-84aa-6eda37d9576a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:55.738831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 222/434] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:21:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:55.745817 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280ef3d-88bf-48de-84aa-6eda37d9576a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:55.865619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b926609-6740-4039-b805-45dade6aac24 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.879673 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280ef3d-88bf-48de-84aa-6eda37d9576a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:55.914705 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db2936-a806-49cb-bbe5-5210d70b15fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.915382 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db2936-a806-49cb-bbe5-5210d70b15fb None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.915673 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db2936-a806-49cb-bbe5-5210d70b15fb None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.915950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db2936-a806-49cb-bbe5-5210d70b15fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:55.916902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db2936-a806-49cb-bbe5-5210d70b15fb None admin] RBAC: Adding query filter params (group.id=dadaa50ccc2143eb86169726387512eb, role.id=5dd696285c0b41d3acb854981774eaae, scope.project.id=a82bf7161bd44f5e83eae52981f952ab) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:55.917179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db2936-a806-49cb-bbe5-5210d70b15fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:55.918667 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db2936-a806-49cb-bbe5-5210d70b15fb None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:55.925317 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 213/435] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 15 00:21:55 2022] GET /identity/v3/role_assignments?group.id=dadaa50ccc2143eb86169726387512eb&scope.project.id=a82bf7161bd44f5e83eae52981f952ab&role.id=5dd696285c0b41d3acb854981774eaae => generated 611 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:55.926397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:55.932614 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e65fb1-86d1-4d74-b767-0973cef5cc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:55.933908 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e65fb1-86d1-4d74-b767-0973cef5cc1e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:55.934401 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e65fb1-86d1-4d74-b767-0973cef5cc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:55.934910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e65fb1-86d1-4d74-b767-0973cef5cc1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.016160 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e65fb1-86d1-4d74-b767-0973cef5cc1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:56.018087 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e65fb1-86d1-4d74-b767-0973cef5cc1e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:56.132036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 223/436] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 00:21:56.138186 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db2936-a806-49cb-bbe5-5210d70b15fb None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.206399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5ffe-ea43-49b3-ad69-fc8c2fcbc370 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.207047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5ffe-ea43-49b3-ad69-fc8c2fcbc370 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.207669 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5ffe-ea43-49b3-ad69-fc8c2fcbc370 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.210272 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 224/437] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:21:56.216294 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80c68-ee60-4b37-859c-106635ebc6c1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.216866 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80c68-ee60-4b37-859c-106635ebc6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.217154 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80c68-ee60-4b37-859c-106635ebc6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.227273 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:56.239948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6ad80c68-ee60-4b37-859c-106635ebc6c1 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:56.241617 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6ad80c68-ee60-4b37-859c-106635ebc6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:56.259795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db2936-a806-49cb-bbe5-5210d70b15fb None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.281458 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:56.310179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165a5ac-d656-4e23-8088-317b8779e56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.311086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165a5ac-d656-4e23-8088-317b8779e56f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.311380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165a5ac-d656-4e23-8088-317b8779e56f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.311653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165a5ac-d656-4e23-8088-317b8779e56f None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.314425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165a5ac-d656-4e23-8088-317b8779e56f None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:56.315168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165a5ac-d656-4e23-8088-317b8779e56f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:56.317248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 214/438] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:56 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:56.322796 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165a5ac-d656-4e23-8088-317b8779e56f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.337222 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 225/439] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:21:56.339513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6a6d5-dc16-445e-8b21-45a91563ec97 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.339811 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6a6d5-dc16-445e-8b21-45a91563ec97 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.340089 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6a6d5-dc16-445e-8b21-45a91563ec97 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.341564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 226/440] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:21:56.346498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d311d-0e82-4b99-b4fb-6b059d913b18 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.346851 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d311d-0e82-4b99-b4fb-6b059d913b18 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.347193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d311d-0e82-4b99-b4fb-6b059d913b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.366132 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-042d311d-0e82-4b99-b4fb-6b059d913b18 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:21:56.367519 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-042d311d-0e82-4b99-b4fb-6b059d913b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:21:56.438836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165a5ac-d656-4e23-8088-317b8779e56f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.439354 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 227/441] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:21:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:21:56.440197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d311d-0e82-4b99-b4fb-6b059d913b18 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.486117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3bdef-da45-4a28-adb9-ca758e108c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.486944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3bdef-da45-4a28-adb9-ca758e108c03 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.487226 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3bdef-da45-4a28-adb9-ca758e108c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.487502 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3bdef-da45-4a28-adb9-ca758e108c03 None admin] PATH_INFO: `/v3/groups/dadaa50ccc2143eb86169726387512eb` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.488758 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3bdef-da45-4a28-adb9-ca758e108c03 None admin] RBAC: Authorizing `identity:get_group(group_id=dadaa50ccc2143eb86169726387512eb)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:56.490565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3bdef-da45-4a28-adb9-ca758e108c03 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:56.497255 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 215/442] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 15 00:21:56 2022] GET /identity/v3/groups/dadaa50ccc2143eb86169726387512eb => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:56.497255 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3bdef-da45-4a28-adb9-ca758e108c03 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.510627 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:56.553513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:56.563763 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d311d-0e82-4b99-b4fb-6b059d913b18 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.602729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ec34c-bb1f-44a5-b933-50437f63fa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.603549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ec34c-bb1f-44a5-b933-50437f63fa10 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.603828 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ec34c-bb1f-44a5-b933-50437f63fa10 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.604099 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ec34c-bb1f-44a5-b933-50437f63fa10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.608249 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3bdef-da45-4a28-adb9-ca758e108c03 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.614220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ec34c-bb1f-44a5-b933-50437f63fa10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:56.622343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ad2ec34c-bb1f-44a5-b933-50437f63fa10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:56.622343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:56.622343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:56.622343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:56.622343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:56.622343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:56.622343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:56.622343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:56.622343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:56.622343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:56.622343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:56.622343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:56.622343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:56.622343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:56.622343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:56.622343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:56.623259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:56.623259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:56.623259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:56.623259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:56.623259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:56.623259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:56.623259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:56.623259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:56.623259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:56.623259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:56.623259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:56.623259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:56.623259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:56.623259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:56.623259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:56.623259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:56.624048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:56.624048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:56.624048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:56.624048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:56.624048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:56.624048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:56.624048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:56.624048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:56.624048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:56.624048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:56.624048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:21:56.624048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:21:56.624048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 228/443] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:21:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:56.624721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ec34c-bb1f-44a5-b933-50437f63fa10 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.646380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba887ff4-d3cc-4cc6-9e0a-355b3ef3d573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.647208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba887ff4-d3cc-4cc6-9e0a-355b3ef3d573 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.647489 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba887ff4-d3cc-4cc6-9e0a-355b3ef3d573 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.647764 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba887ff4-d3cc-4cc6-9e0a-355b3ef3d573 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.657836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba887ff4-d3cc-4cc6-9e0a-355b3ef3d573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:21:56.665977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-ba887ff4-d3cc-4cc6-9e0a-355b3ef3d573 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:56.665977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:21:56.665977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:21:56.665977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:21:56.665977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:21:56.665977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:21:56.665977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:21:56.665977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:21:56.665977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:21:56.665977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:21:56.665977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:21:56.665977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:21:56.665977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:21:56.665977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:21:56.665977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:21:56.665977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:21:56.666908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:21:56.666908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:21:56.666908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:21:56.666908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:21:56.666908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:21:56.666908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:21:56.666908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:21:56.666908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:21:56.666908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:21:56.666908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:21:56.666908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:21:56.666908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:21:56.666908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:21:56.666908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:21:56.666908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:21:56.666908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:21:56.672671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:21:56.672671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:21:56.672671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:21:56.672671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:21:56.672671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:21:56.672671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:21:56.672671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:21:56.672671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:21:56.672671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:21:56.672671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:21:56.672671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:21:56.672671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:21:56.672671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 216/444] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:21:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:21:56.672671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba887ff4-d3cc-4cc6-9e0a-355b3ef3d573 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.734618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ec34c-bb1f-44a5-b933-50437f63fa10 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.736872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:56.767772 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aaf1a-6079-4570-a96f-ca295028c690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.768495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aaf1a-6079-4570-a96f-ca295028c690 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.768777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aaf1a-6079-4570-a96f-ca295028c690 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.769001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba887ff4-d3cc-4cc6-9e0a-355b3ef3d573 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.769099 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8aaf1a-6079-4570-a96f-ca295028c690 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.770031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8aaf1a-6079-4570-a96f-ca295028c690 None admin] RBAC: Adding query filter params (group.id=dadaa50ccc2143eb86169726387512eb, role.id=5dd696285c0b41d3acb854981774eaae, scope.project.id=b007b4f89cb74f898cbd2e8eb9919989) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:56.770452 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8aaf1a-6079-4570-a96f-ca295028c690 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:56.771960 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8aaf1a-6079-4570-a96f-ca295028c690 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:56.793375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 229/445] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 15 00:21:56 2022] GET /identity/v3/role_assignments?group.id=dadaa50ccc2143eb86169726387512eb&scope.project.id=b007b4f89cb74f898cbd2e8eb9919989&role.id=5dd696285c0b41d3acb854981774eaae => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:56.793375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aaf1a-6079-4570-a96f-ca295028c690 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.800886 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:56.806234 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a945209-decc-4e34-b0dc-715f1b80459d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.806944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a945209-decc-4e34-b0dc-715f1b80459d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.807234 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a945209-decc-4e34-b0dc-715f1b80459d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.807512 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a945209-decc-4e34-b0dc-715f1b80459d None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.808303 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a945209-decc-4e34-b0dc-715f1b80459d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:56.808616 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a945209-decc-4e34-b0dc-715f1b80459d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:56.810091 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a945209-decc-4e34-b0dc-715f1b80459d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:56.820149 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 217/446] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:21:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:56.826528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a945209-decc-4e34-b0dc-715f1b80459d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.897392 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8aaf1a-6079-4570-a96f-ca295028c690 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.936649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2d4ff-f032-407a-a6f9-8a872608af43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.936905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a945209-decc-4e34-b0dc-715f1b80459d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:56.937440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2d4ff-f032-407a-a6f9-8a872608af43 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.937731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2d4ff-f032-407a-a6f9-8a872608af43 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.938010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2d4ff-f032-407a-a6f9-8a872608af43 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:56.938775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2d4ff-f032-407a-a6f9-8a872608af43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:56.939083 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2d4ff-f032-407a-a6f9-8a872608af43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:56.940503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2d4ff-f032-407a-a6f9-8a872608af43 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:56.952806 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 230/447] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:21:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:56.958269 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2d4ff-f032-407a-a6f9-8a872608af43 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:56.977407 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:56.983561 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e951c-3e6c-4a6b-9866-bbc62d0ff278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:56.984157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e951c-3e6c-4a6b-9866-bbc62d0ff278 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:56.984444 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e951c-3e6c-4a6b-9866-bbc62d0ff278 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:56.986456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e951c-3e6c-4a6b-9866-bbc62d0ff278 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:57.059484 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:57.067800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e951c-3e6c-4a6b-9866-bbc62d0ff278 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:57.069229 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e951c-3e6c-4a6b-9866-bbc62d0ff278 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:57.089245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2d4ff-f032-407a-a6f9-8a872608af43 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:57.133891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac204799-00e8-4ff7-873e-7eee8dd2439e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:57.133891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac204799-00e8-4ff7-873e-7eee8dd2439e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:57.134204 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac204799-00e8-4ff7-873e-7eee8dd2439e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:57.134291 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac204799-00e8-4ff7-873e-7eee8dd2439e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:57.181079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 218/448] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:21:57.186771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e951c-3e6c-4a6b-9866-bbc62d0ff278 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:57.206560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac204799-00e8-4ff7-873e-7eee8dd2439e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:57.208045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac204799-00e8-4ff7-873e-7eee8dd2439e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:57.215724 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:57.284617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e951c-3e6c-4a6b-9866-bbc62d0ff278 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:57.285334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:57.308823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 231/449] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:21:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 00:21:57.314300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac204799-00e8-4ff7-873e-7eee8dd2439e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:57.318836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03632c-4cc3-450c-9468-b0c04361974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:57.319735 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03632c-4cc3-450c-9468-b0c04361974c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:57.320015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03632c-4cc3-450c-9468-b0c04361974c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:57.320289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03632c-4cc3-450c-9468-b0c04361974c None admin] PATH_INFO: `/v3/projects/ac65417652594c99a423cc960be9081e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:57.321519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03632c-4cc3-450c-9468-b0c04361974c None admin] RBAC: Authorizing `identity:get_project(project_id=ac65417652594c99a423cc960be9081e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:57.322970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03632c-4cc3-450c-9468-b0c04361974c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:57.324667 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 219/450] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:57 2022] GET /identity/v3/projects/ac65417652594c99a423cc960be9081e => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:57.329920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03632c-4cc3-450c-9468-b0c04361974c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:57.410917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac204799-00e8-4ff7-873e-7eee8dd2439e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:57.425448 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:57.428786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03632c-4cc3-450c-9468-b0c04361974c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:57.444339 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90819661-94fc-4d04-8eeb-92a31c1f8c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:57.445233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90819661-94fc-4d04-8eeb-92a31c1f8c83 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:57.445608 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90819661-94fc-4d04-8eeb-92a31c1f8c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:57.445892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90819661-94fc-4d04-8eeb-92a31c1f8c83 None admin] PATH_INFO: `/v3/projects/b007b4f89cb74f898cbd2e8eb9919989` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:57.447070 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90819661-94fc-4d04-8eeb-92a31c1f8c83 None admin] RBAC: Authorizing `identity:get_project(project_id=b007b4f89cb74f898cbd2e8eb9919989)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:57.448517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90819661-94fc-4d04-8eeb-92a31c1f8c83 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:57.450245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 232/451] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:21:57 2022] GET /identity/v3/projects/b007b4f89cb74f898cbd2e8eb9919989 => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:57.455732 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90819661-94fc-4d04-8eeb-92a31c1f8c83 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:57.463004 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9472839-97bb-4bd3-85b9-2e947dabf663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:57.463887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9472839-97bb-4bd3-85b9-2e947dabf663 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:57.464168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9472839-97bb-4bd3-85b9-2e947dabf663 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:57.464442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9472839-97bb-4bd3-85b9-2e947dabf663 None admin] PATH_INFO: `/v3/groups/e4c54504ee844f13ad562f91c6489665` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:57.465656 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9472839-97bb-4bd3-85b9-2e947dabf663 None admin] RBAC: Authorizing `identity:get_group(group_id=e4c54504ee844f13ad562f91c6489665)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:57.467087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9472839-97bb-4bd3-85b9-2e947dabf663 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:57.468844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 220/452] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 15 00:21:57 2022] GET /identity/v3/groups/e4c54504ee844f13ad562f91c6489665 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:21:57.474449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9472839-97bb-4bd3-85b9-2e947dabf663 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:57.505732 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:57.558878 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90819661-94fc-4d04-8eeb-92a31c1f8c83 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:57.576167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9472839-97bb-4bd3-85b9-2e947dabf663 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:57.592260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dbbbc-24d7-4c25-9f2e-f680a263e7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:57.593128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dbbbc-24d7-4c25-9f2e-f680a263e7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:57.593428 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dbbbc-24d7-4c25-9f2e-f680a263e7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:57.593738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dbbbc-24d7-4c25-9f2e-f680a263e7d7 None admin] PATH_INFO: `/v3/groups/dadaa50ccc2143eb86169726387512eb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:57.594939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dbbbc-24d7-4c25-9f2e-f680a263e7d7 None admin] RBAC: Authorizing `identity:get_group(group_id=dadaa50ccc2143eb86169726387512eb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:57.596379 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dbbbc-24d7-4c25-9f2e-f680a263e7d7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:57.598022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 233/453] 10.222.0.36 () {56 vars in 1180 bytes} [Wed Jun 15 00:21:57 2022] GET /identity/v3/groups/dadaa50ccc2143eb86169726387512eb => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:57.604085 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dbbbc-24d7-4c25-9f2e-f680a263e7d7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:21:57.609994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fac33e-37cd-40e9-bcd8-581141e7ed19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:57.610659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fac33e-37cd-40e9-bcd8-581141e7ed19 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:57.610939 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fac33e-37cd-40e9-bcd8-581141e7ed19 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:57.611211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fac33e-37cd-40e9-bcd8-581141e7ed19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:57.612030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fac33e-37cd-40e9-bcd8-581141e7ed19 None admin] RBAC: Adding query filter params (group.id=e4c54504ee844f13ad562f91c6489665, role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=ac65417652594c99a423cc960be9081e) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:57.612338 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fac33e-37cd-40e9-bcd8-581141e7ed19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:57.613802 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fac33e-37cd-40e9-bcd8-581141e7ed19 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:57.620198 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 221/454] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 15 00:21:57 2022] GET /identity/v3/role_assignments?group.id=e4c54504ee844f13ad562f91c6489665&scope.project.id=ac65417652594c99a423cc960be9081e&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:21:57.708324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dbbbc-24d7-4c25-9f2e-f680a263e7d7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:21:57.723998 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:21:57.746839 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d320db-ffb1-4624-abb9-d4b1a1acae8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:21:57.747517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d320db-ffb1-4624-abb9-d4b1a1acae8d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:21:57.747798 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d320db-ffb1-4624-abb9-d4b1a1acae8d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:21:57.748076 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d320db-ffb1-4624-abb9-d4b1a1acae8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:21:57.748925 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d320db-ffb1-4624-abb9-d4b1a1acae8d None admin] RBAC: Adding query filter params (group.id=dadaa50ccc2143eb86169726387512eb, role.id=1be1544572744e849ed04df01cdca3fb, scope.project.id=b007b4f89cb74f898cbd2e8eb9919989) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:21:57.749241 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d320db-ffb1-4624-abb9-d4b1a1acae8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:21:57.750737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d320db-ffb1-4624-abb9-d4b1a1acae8d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:21:57.769375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 234/455] 10.222.0.36 () {56 vars in 1376 bytes} [Wed Jun 15 00:21:57 2022] GET /identity/v3/role_assignments?group.id=dadaa50ccc2143eb86169726387512eb&scope.project.id=b007b4f89cb74f898cbd2e8eb9919989&role.id=1be1544572744e849ed04df01cdca3fb => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:00.612951 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca48af-a8b5-4893-b5d4-0b579b1f6ba2 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.613500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca48af-a8b5-4893-b5d4-0b579b1f6ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.613618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca48af-a8b5-4893-b5d4-0b579b1f6ba2 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.615555 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 222/456] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:00.621260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350877c-1663-48d8-b7e8-0c39a1d9b368 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.621697 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350877c-1663-48d8-b7e8-0c39a1d9b368 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.621867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350877c-1663-48d8-b7e8-0c39a1d9b368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.640990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4350877c-1663-48d8-b7e8-0c39a1d9b368 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:00.642683 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4350877c-1663-48d8-b7e8-0c39a1d9b368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:00.718432 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5ab4e-c1df-4fda-987b-23d737cc7ea6 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.719089 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5ab4e-c1df-4fda-987b-23d737cc7ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.719566 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5ab4e-c1df-4fda-987b-23d737cc7ea6 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.721397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 223/458] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:00.725104 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 235/458] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:00.726498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5cc2a-a5d3-4be7-ace2-fb5d9c4ca0c7 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.727054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5cc2a-a5d3-4be7-ace2-fb5d9c4ca0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.727529 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5cc2a-a5d3-4be7-ace2-fb5d9c4ca0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.744905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-bbd5cc2a-a5d3-4be7-ace2-fb5d9c4ca0c7 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:00.746457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-bbd5cc2a-a5d3-4be7-ace2-fb5d9c4ca0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:00.746654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350877c-1663-48d8-b7e8-0c39a1d9b368 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:00.789812 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:00.845369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 224/459] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:00.845369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89e433-a9e5-470f-9cce-731223112871 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.845369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89e433-a9e5-470f-9cce-731223112871 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.845369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89e433-a9e5-470f-9cce-731223112871 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.845369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 225/460] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:00.851192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c43f0-fbc8-4879-a22f-365709967693 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.851477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c43f0-fbc8-4879-a22f-365709967693 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.851786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c43f0-fbc8-4879-a22f-365709967693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.869246 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350877c-1663-48d8-b7e8-0c39a1d9b368 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:00.882038 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:00.882555 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9b6c43f0-fbc8-4879-a22f-365709967693 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:00.885057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9b6c43f0-fbc8-4879-a22f-365709967693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:00.914289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94842362-f770-4627-9829-24ac65ba7bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:00.915254 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94842362-f770-4627-9829-24ac65ba7bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:00.915628 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94842362-f770-4627-9829-24ac65ba7bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:00.915907 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94842362-f770-4627-9829-24ac65ba7bc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:00.928797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94842362-f770-4627-9829-24ac65ba7bc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:00.930404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94842362-f770-4627-9829-24ac65ba7bc9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:00.954489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-94842362-f770-4627-9829-24ac65ba7bc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:00.954489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:00.954489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:00.954489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:00.954489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:00.954489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:00.954489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:00.954489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:00.954489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:00.954489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:00.954489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:00.954489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:00.954489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:00.954489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:00.954489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:00.955433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:00.956319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:00.956319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:00.956319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:00.956319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:00.956319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 236/461] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:00.957055 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94842362-f770-4627-9829-24ac65ba7bc9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:00.963363 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 226/462] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:00.964515 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c43f0-fbc8-4879-a22f-365709967693 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:01.079419 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94842362-f770-4627-9829-24ac65ba7bc9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:01.080093 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:01.093744 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c43f0-fbc8-4879-a22f-365709967693 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:01.123593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5878480-4633-4bc0-947c-7ad95470440a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:01.124317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5878480-4633-4bc0-947c-7ad95470440a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.124602 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5878480-4633-4bc0-947c-7ad95470440a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.124876 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5878480-4633-4bc0-947c-7ad95470440a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.137208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5878480-4633-4bc0-947c-7ad95470440a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:01.138848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5878480-4633-4bc0-947c-7ad95470440a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:01.139161 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6776e64-2299-4835-a2ec-9cbb9693a8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:01.140046 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6776e64-2299-4835-a2ec-9cbb9693a8bd None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.140687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6776e64-2299-4835-a2ec-9cbb9693a8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.141169 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6776e64-2299-4835-a2ec-9cbb9693a8bd None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.142399 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6776e64-2299-4835-a2ec-9cbb9693a8bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:01.142903 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6776e64-2299-4835-a2ec-9cbb9693a8bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:01.144464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6776e64-2299-4835-a2ec-9cbb9693a8bd None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:01.158123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-c5878480-4633-4bc0-947c-7ad95470440a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:01.158123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:01.158123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:01.158123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:01.158123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:01.158123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:01.158123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:01.158123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:01.158123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:01.158123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:01.158123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:01.158123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:01.158123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:01.158123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:01.158123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:01.159050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:01.159906 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:01.159906 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:01.159906 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:01.159906 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:01.159906 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 237/463] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:01.160171 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5878480-4633-4bc0-947c-7ad95470440a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:01.163421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 227/464] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:01.165320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f8408-3628-42cf-a8ff-5f33c1aa9447 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.165320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f8408-3628-42cf-a8ff-5f33c1aa9447 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.165320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f8408-3628-42cf-a8ff-5f33c1aa9447 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.166899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 228/465] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:01.167610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f8408-3628-42cf-a8ff-5f33c1aa9447 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:01.181666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:01.276262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f8408-3628-42cf-a8ff-5f33c1aa9447 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:01.277062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5878480-4633-4bc0-947c-7ad95470440a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:01.312251 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb503501-3da6-48b6-8b6c-4812ec586420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:01.313180 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb503501-3da6-48b6-8b6c-4812ec586420 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.313541 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb503501-3da6-48b6-8b6c-4812ec586420 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.313799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb503501-3da6-48b6-8b6c-4812ec586420 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.314530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb503501-3da6-48b6-8b6c-4812ec586420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:01.314844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb503501-3da6-48b6-8b6c-4812ec586420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:01.316416 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb503501-3da6-48b6-8b6c-4812ec586420 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:01.316822 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53173fe-04eb-4625-b9ec-6f1ee8d4c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:01.317652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53173fe-04eb-4625-b9ec-6f1ee8d4c36d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.317949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53173fe-04eb-4625-b9ec-6f1ee8d4c36d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.318205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53173fe-04eb-4625-b9ec-6f1ee8d4c36d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.329110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 229/466] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:01.329540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53173fe-04eb-4625-b9ec-6f1ee8d4c36d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:01.331283 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53173fe-04eb-4625-b9ec-6f1ee8d4c36d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:01.335339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb503501-3da6-48b6-8b6c-4812ec586420 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:01.352311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b53173fe-04eb-4625-b9ec-6f1ee8d4c36d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:01.352311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:01.352311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:01.352311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:01.352311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:01.352311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:01.352311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:01.352311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:01.352311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:01.352311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:01.352311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:01.352311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:01.352311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:01.352311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:01.352311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:01.353286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:01.354179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:01.354179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:01.354179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:01.354179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:01.354179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 238/467] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:01.355017 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4908da5-357b-473b-9f8a-3c8370fe2bc1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.355017 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4908da5-357b-473b-9f8a-3c8370fe2bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.355473 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4908da5-357b-473b-9f8a-3c8370fe2bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.359406 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:01.372975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a4908da5-357b-473b-9f8a-3c8370fe2bc1 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:01.374241 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a4908da5-357b-473b-9f8a-3c8370fe2bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:01.435829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:01.447016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 239/468] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:01.447766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4908da5-357b-473b-9f8a-3c8370fe2bc1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:01.454413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb503501-3da6-48b6-8b6c-4812ec586420 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:01.489796 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b4850-5e18-4828-aa38-8883b84cee14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:01.490845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b4850-5e18-4828-aa38-8883b84cee14 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.491175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b4850-5e18-4828-aa38-8883b84cee14 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.491405 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b4850-5e18-4828-aa38-8883b84cee14 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.492142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b4850-5e18-4828-aa38-8883b84cee14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:01.493624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b4850-5e18-4828-aa38-8883b84cee14 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:01.514102 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 230/469] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:22:01 2022] POST /identity/v3/users => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:01.514992 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b4850-5e18-4828-aa38-8883b84cee14 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:01.565786 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4908da5-357b-473b-9f8a-3c8370fe2bc1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:01.605529 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158b4db-baf8-4de6-9500-8d16d45ab357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:01.606636 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158b4db-baf8-4de6-9500-8d16d45ab357 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.607181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158b4db-baf8-4de6-9500-8d16d45ab357 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.607526 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158b4db-baf8-4de6-9500-8d16d45ab357 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.608328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158b4db-baf8-4de6-9500-8d16d45ab357 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:01.609989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158b4db-baf8-4de6-9500-8d16d45ab357 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:01.635719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:01.639910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 240/470] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:22:01 2022] POST /identity/v3/users => generated 248 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:01.642231 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158b4db-baf8-4de6-9500-8d16d45ab357 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:01.711210 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:01.724741 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b4850-5e18-4828-aa38-8883b84cee14 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:01.776404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158b4db-baf8-4de6-9500-8d16d45ab357 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:01.797716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0424be-93c9-41f8-a44c-0f2f6dd161ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:01.798840 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0424be-93c9-41f8-a44c-0f2f6dd161ab None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.799280 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0424be-93c9-41f8-a44c-0f2f6dd161ab None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.799701 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0424be-93c9-41f8-a44c-0f2f6dd161ab None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.800596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0424be-93c9-41f8-a44c-0f2f6dd161ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:01.801108 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0424be-93c9-41f8-a44c-0f2f6dd161ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:01.802943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0424be-93c9-41f8-a44c-0f2f6dd161ab None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:01.823580 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faec36-dcf9-4e25-acb1-11b08f6d1eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:01.823580 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faec36-dcf9-4e25-acb1-11b08f6d1eaf None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:01.823580 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faec36-dcf9-4e25-acb1-11b08f6d1eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:01.823580 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faec36-dcf9-4e25-acb1-11b08f6d1eaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:01.824275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 231/471] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:01.827283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0424be-93c9-41f8-a44c-0f2f6dd161ab None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:01.841756 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95faec36-dcf9-4e25-acb1-11b08f6d1eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:01.843868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95faec36-dcf9-4e25-acb1-11b08f6d1eaf None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:01.863726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-95faec36-dcf9-4e25-acb1-11b08f6d1eaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:01.863726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:01.863726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:01.863726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:01.863726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:01.863726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:01.863726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:01.863726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:01.863726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:01.863726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:01.863726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:01.863726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:01.863726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:01.863726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:01.863726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:01.864821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:01.866710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:01.866710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:01.866710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:01.866710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:01.866710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 241/472] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:01.871073 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faec36-dcf9-4e25-acb1-11b08f6d1eaf None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:01.960821 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0424be-93c9-41f8-a44c-0f2f6dd161ab None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:01.993433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faec36-dcf9-4e25-acb1-11b08f6d1eaf None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:01.995135 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:02.000436 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:02.012976 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db10ccf-423e-427a-a364-cc5f43b18a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.014117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db10ccf-423e-427a-a364-cc5f43b18a5e None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.014412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db10ccf-423e-427a-a364-cc5f43b18a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.014699 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db10ccf-423e-427a-a364-cc5f43b18a5e None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.015724 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db10ccf-423e-427a-a364-cc5f43b18a5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:02.017393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db10ccf-423e-427a-a364-cc5f43b18a5e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:02.042627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92706ef0-f933-4cbf-87f8-d351f35a70d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.043755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92706ef0-f933-4cbf-87f8-d351f35a70d5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.044245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92706ef0-f933-4cbf-87f8-d351f35a70d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.044744 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92706ef0-f933-4cbf-87f8-d351f35a70d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.045678 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92706ef0-f933-4cbf-87f8-d351f35a70d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:02.046182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92706ef0-f933-4cbf-87f8-d351f35a70d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:02.047742 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92706ef0-f933-4cbf-87f8-d351f35a70d5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:02.052238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 232/473] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:22:01 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:22:02.056205 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be543-f7bc-4d87-a931-8438d1921076 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.056490 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be543-f7bc-4d87-a931-8438d1921076 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.056779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784be543-f7bc-4d87-a931-8438d1921076 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.058580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 233/474] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:02.068954 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd98f1d-cccb-45c4-a17c-e15c56f8e6e4 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.068954 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd98f1d-cccb-45c4-a17c-e15c56f8e6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.068954 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd98f1d-cccb-45c4-a17c-e15c56f8e6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.075644 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 242/475] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:02.083679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92706ef0-f933-4cbf-87f8-d351f35a70d5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:02.098094 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-fcd98f1d-cccb-45c4-a17c-e15c56f8e6e4 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:02.102066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fcd98f1d-cccb-45c4-a17c-e15c56f8e6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:02.244223 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 234/476] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:02.264016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd98f1d-cccb-45c4-a17c-e15c56f8e6e4 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:02.269321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92706ef0-f933-4cbf-87f8-d351f35a70d5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:02.316215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a5e40-8a02-4856-b4eb-4d0e4b90350e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.318008 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a5e40-8a02-4856-b4eb-4d0e4b90350e None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.318503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a5e40-8a02-4856-b4eb-4d0e4b90350e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.319044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a5e40-8a02-4856-b4eb-4d0e4b90350e None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.321634 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a5e40-8a02-4856-b4eb-4d0e4b90350e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:02.323179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a5e40-8a02-4856-b4eb-4d0e4b90350e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:02.350538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 243/477] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:22:02 2022] POST /identity/v3/users => generated 249 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:02.392855 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd98f1d-cccb-45c4-a17c-e15c56f8e6e4 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:02.409518 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:02.433686 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b989f-fbfc-48e5-bd1e-3ce93cb44506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.435756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b989f-fbfc-48e5-bd1e-3ce93cb44506 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.436052 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b989f-fbfc-48e5-bd1e-3ce93cb44506 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.436332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b989f-fbfc-48e5-bd1e-3ce93cb44506 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.437114 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b989f-fbfc-48e5-bd1e-3ce93cb44506 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:02.438594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83b989f-fbfc-48e5-bd1e-3ce93cb44506 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:02.446238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.sql.core [None req-b83b989f-fbfc-48e5-bd1e-3ce93cb44506 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 00:22:02.446238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 15 00:22:02.446238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [parameters: {'id': 'cafbf46420ba4736b3c987c9addc6df9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 15 00:22:02.446238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80188) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 00:22:02.464184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-b83b989f-fbfc-48e5-bd1e-3ce93cb44506 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 15 00:22:02.464184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:02.464184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 00:22:02.464184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 00:22:02.464184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 00:22:02.464184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 00:22:02.464184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 00:22:02.464184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 00:22:02.464184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 00:22:02.464184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application conn.query(q) Jun 15 00:22:02.464184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 00:22:02.464184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 00:22:02.464184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 00:22:02.464184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application result.read() Jun 15 00:22:02.464184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return ref.to_dict() Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 00:22:02.465159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application next(self.gen) Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application yield resource Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application next(self.gen) Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise self.value Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application session.commit() Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 00:22:02.466199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self.session.flush() Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application compat.raise_( Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 00:22:02.467047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 00:22:02.467957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 00:22:02.467957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 00:22:02.467957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 15 00:22:02.467957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 15 00:22:02.467957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 00:22:02.467957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 00:22:02.467957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 00:22:02.467957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 00:22:02.467957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 00:22:02.467957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 00:22:02.467957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 00:22:02.467957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 00:22:02.467957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 00:22:02.467957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 00:22:02.467957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 00:22:02.467957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception Jun 15 00:22:02.468777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 00:22:02.468777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 00:22:02.468777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 00:22:02.468777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 00:22:02.468777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 00:22:02.468777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 00:22:02.468777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 00:22:02.468777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application conn.query(q) Jun 15 00:22:02.468777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 00:22:02.468777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 00:22:02.468777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 00:22:02.468777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application result.read() Jun 15 00:22:02.468777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 00:22:02.468777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 00:22:02.468777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 00:22:02.468777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 00:22:02.469620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 00:22:02.469620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 00:22:02.469620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 00:22:02.469620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 00:22:02.469620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 15 00:22:02.469620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 15 00:22:02.469620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [parameters: {'id': 'cafbf46420ba4736b3c987c9addc6df9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 15 00:22:02.469620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 00:22:02.469620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:02.469620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:02.469620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:02.469620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:02.469620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:02.469620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:02.469620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:02.469620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:02.470423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:02.470423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:02.470423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:02.470423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:02.470423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:02.470423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:02.470423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 15 00:22:02.470423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 15 00:22:02.470423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:02.470423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:02.470423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 15 00:22:02.470423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 15 00:22:02.470423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 00:22:02.470423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 00:22:02.470423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 15 00:22:02.470423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:02.471263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 235/478] 10.222.0.36 () {60 vars in 1131 bytes} [Wed Jun 15 00:22:02 2022] POST /identity/v3/roles => generated 144 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:02.477084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a5e40-8a02-4856-b4eb-4d0e4b90350e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:02.500647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:02.596949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a5e40-8a02-4856-b4eb-4d0e4b90350e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:02.632452 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ddfda-758c-4401-8c8a-d92286b9b490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.633712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ddfda-758c-4401-8c8a-d92286b9b490 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.634068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ddfda-758c-4401-8c8a-d92286b9b490 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.634416 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ddfda-758c-4401-8c8a-d92286b9b490 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.645530 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ddfda-758c-4401-8c8a-d92286b9b490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:02.653982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ae3ddfda-758c-4401-8c8a-d92286b9b490 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:02.653982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:02.653982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:02.653982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:02.653982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:02.653982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:02.653982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:02.653982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:02.653982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:02.653982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:02.653982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:02.653982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:02.653982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:02.653982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:02.653982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:02.653982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:02.654887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:02.654887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:02.654887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:02.654887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:02.654887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:02.654887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:02.654887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:02.654887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:02.654887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:02.654887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:02.654887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:02.654887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:02.654887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:02.654887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:02.654887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:02.654887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:02.655688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:02.655688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:02.655688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:02.655688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:02.655688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:02.655688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:02.655688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:02.655688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:02.655688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:02.655688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:02.655688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 15 00:22:02.655688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:02.655688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 244/479] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:02.661219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b989f-fbfc-48e5-bd1e-3ce93cb44506 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:02.770259 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b989f-fbfc-48e5-bd1e-3ce93cb44506 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:02.808713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c56f4a-8224-4ca9-b64a-93ee7ec9bb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:02.809509 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c56f4a-8224-4ca9-b64a-93ee7ec9bb96 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:02.809795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c56f4a-8224-4ca9-b64a-93ee7ec9bb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:02.810074 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c56f4a-8224-4ca9-b64a-93ee7ec9bb96 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:02.810839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c56f4a-8224-4ca9-b64a-93ee7ec9bb96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:02.811147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c56f4a-8224-4ca9-b64a-93ee7ec9bb96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:02.812543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c56f4a-8224-4ca9-b64a-93ee7ec9bb96 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:02.821521 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 236/480] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:04.225950 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37300d53-3ae3-4945-ac09-d6f94ed4915c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:04.226494 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37300d53-3ae3-4945-ac09-d6f94ed4915c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:04.226632 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37300d53-3ae3-4945-ac09-d6f94ed4915c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:04.228256 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 245/481] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:04.236397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a322154-0fc6-4b85-8b27-823933ea7638 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:04.236793 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a322154-0fc6-4b85-8b27-823933ea7638 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:04.236959 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a322154-0fc6-4b85-8b27-823933ea7638 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:04.238620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 237/482] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:04.241836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16af1a-b7be-43fb-8be6-76a6e0531309 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:04.242200 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16af1a-b7be-43fb-8be6-76a6e0531309 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:04.242726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16af1a-b7be-43fb-8be6-76a6e0531309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:04.243884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c25ae-930a-40f2-a7f9-d540baa72a7c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:04.244169 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c25ae-930a-40f2-a7f9-d540baa72a7c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:04.244450 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c25ae-930a-40f2-a7f9-d540baa72a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:04.268262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3e16af1a-b7be-43fb-8be6-76a6e0531309 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:04.269500 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3e16af1a-b7be-43fb-8be6-76a6e0531309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:04.288315 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ed6c25ae-930a-40f2-a7f9-d540baa72a7c None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:04.289601 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ed6c25ae-930a-40f2-a7f9-d540baa72a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:04.365863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:04.399759 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 246/483] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:04.420065 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 238/484] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:04.423905 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16af1a-b7be-43fb-8be6-76a6e0531309 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:04.434243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:04.461183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c25ae-930a-40f2-a7f9-d540baa72a7c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:04.528278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16af1a-b7be-43fb-8be6-76a6e0531309 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:04.569731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bf507-0ef5-4d6d-87ed-decbcc59d86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:04.570767 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bf507-0ef5-4d6d-87ed-decbcc59d86e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:04.571062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bf507-0ef5-4d6d-87ed-decbcc59d86e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:04.571337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bf507-0ef5-4d6d-87ed-decbcc59d86e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:04.596378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bf507-0ef5-4d6d-87ed-decbcc59d86e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:04.604252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-279bf507-0ef5-4d6d-87ed-decbcc59d86e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:04.604252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:04.604252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:04.604252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:04.604252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:04.604252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:04.604252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:04.604252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:04.604252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:04.604252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:04.604252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:04.604252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:04.604252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:04.604252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:04.604252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:04.604252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:04.605153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:04.605153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:04.605153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:04.605153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:04.605153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:04.605153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:04.605153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:04.605153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:04.605153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:04.605153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:04.605153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:04.605153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:04.605153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:04.605153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:04.605153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:04.605153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:04.606077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:04.606077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:04.606077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:04.606077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:04.606077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:04.606077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:04.606077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:04.606077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:04.606077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:04.606077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:04.606077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:04.606077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:04.609304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 247/485] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:04.622231 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bf507-0ef5-4d6d-87ed-decbcc59d86e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:04.668007 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c25ae-930a-40f2-a7f9-d540baa72a7c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:04.705310 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f985a-688e-4fbc-9a11-3fa86010a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:04.707709 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f985a-688e-4fbc-9a11-3fa86010a68a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:04.707709 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f985a-688e-4fbc-9a11-3fa86010a68a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:04.707709 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f985a-688e-4fbc-9a11-3fa86010a68a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:04.735666 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f985a-688e-4fbc-9a11-3fa86010a68a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:04.744395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-e07f985a-688e-4fbc-9a11-3fa86010a68a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:04.744395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:04.744395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:04.744395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:04.744395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:04.744395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:04.744395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:04.744395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:04.744395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:04.744395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:04.744395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:04.744395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:04.744395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:04.744395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:04.744395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:04.744395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:04.745336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:04.745336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:04.745336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:04.745336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:04.745336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:04.745336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:04.745336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:04.745336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:04.745336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:04.745336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:04.745336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:04.745336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:04.745336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:04.745336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:04.745336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:04.745336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:04.746208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:04.746208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:04.746208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:04.746208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:04.746208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:04.746208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:04.746208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:04.746208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:04.746208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:04.746208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:04.746208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:04.746208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:04.755341 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 239/486] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:04.763423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f985a-688e-4fbc-9a11-3fa86010a68a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:04.771890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:04.812602 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bf507-0ef5-4d6d-87ed-decbcc59d86e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:04.826791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:04.853150 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01d611-4768-4a13-a143-73c73dfd904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:04.854002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d611-4768-4a13-a143-73c73dfd904a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:04.854296 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d611-4768-4a13-a143-73c73dfd904a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:04.854580 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d611-4768-4a13-a143-73c73dfd904a None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:04.855344 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01d611-4768-4a13-a143-73c73dfd904a None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:04.855664 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01d611-4768-4a13-a143-73c73dfd904a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:04.857232 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01d611-4768-4a13-a143-73c73dfd904a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:04.867351 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 248/487] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:04.876919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01d611-4768-4a13-a143-73c73dfd904a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:04.934616 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f985a-688e-4fbc-9a11-3fa86010a68a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:04.977052 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f02cc7-0430-411c-81cd-d20d3181eadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:04.977790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f02cc7-0430-411c-81cd-d20d3181eadc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:04.978073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f02cc7-0430-411c-81cd-d20d3181eadc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:04.978349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f02cc7-0430-411c-81cd-d20d3181eadc None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:04.979232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f02cc7-0430-411c-81cd-d20d3181eadc None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:04.979543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f02cc7-0430-411c-81cd-d20d3181eadc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:04.981063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f02cc7-0430-411c-81cd-d20d3181eadc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:04.991580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 240/488] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:04.992998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579ee34-b00d-46b1-ae59-1721a806d6de None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:04.993282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579ee34-b00d-46b1-ae59-1721a806d6de None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:04.993595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579ee34-b00d-46b1-ae59-1721a806d6de None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:04.997434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 241/489] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:04.998237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579ee34-b00d-46b1-ae59-1721a806d6de None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.049372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01d611-4768-4a13-a143-73c73dfd904a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.091028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:05.096743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9320dc-5f10-46d5-8ad3-8786ff3084ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.097609 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9320dc-5f10-46d5-8ad3-8786ff3084ae None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.097902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9320dc-5f10-46d5-8ad3-8786ff3084ae None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.098182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9320dc-5f10-46d5-8ad3-8786ff3084ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.103571 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:05.109716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9320dc-5f10-46d5-8ad3-8786ff3084ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.111190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9320dc-5f10-46d5-8ad3-8786ff3084ae None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.117081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579ee34-b00d-46b1-ae59-1721a806d6de None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.129066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-fe9320dc-5f10-46d5-8ad3-8786ff3084ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:05.129066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:05.129066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:05.129066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:05.129066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:05.129066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:05.129066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:05.129066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:05.129066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:05.129066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:05.129066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:05.129066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:05.129066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:05.129066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:05.129066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:05.130058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:05.131048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:05.131048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:05.131048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:05.131048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:05.134926 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 249/490] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:05.136282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b415e6c-9cca-4030-9b7e-6ecab7d508d2 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.136591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b415e6c-9cca-4030-9b7e-6ecab7d508d2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.136874 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b415e6c-9cca-4030-9b7e-6ecab7d508d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.153968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0b415e6c-9cca-4030-9b7e-6ecab7d508d2 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:05.155163 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0b415e6c-9cca-4030-9b7e-6ecab7d508d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:05.156847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78174d5-2f4b-478a-974b-67129d98d376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.157687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78174d5-2f4b-478a-974b-67129d98d376 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.157971 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78174d5-2f4b-478a-974b-67129d98d376 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.158925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78174d5-2f4b-478a-974b-67129d98d376 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.169549 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78174d5-2f4b-478a-974b-67129d98d376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.171029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78174d5-2f4b-478a-974b-67129d98d376 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.190342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c78174d5-2f4b-478a-974b-67129d98d376 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:05.190342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:05.190342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:05.190342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:05.190342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:05.190342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:05.190342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:05.190342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:05.190342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:05.190342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:05.190342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:05.190342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:05.190342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:05.190342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:05.190342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:05.191204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:05.192077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:05.192077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:05.192077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:05.192077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:05.192077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 242/491] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:05.192897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e4b65-21b7-4359-abec-44240b05cad4 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.193213 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e4b65-21b7-4359-abec-44240b05cad4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.193558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e4b65-21b7-4359-abec-44240b05cad4 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.194862 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 243/492] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:05.197485 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e4b65-21b7-4359-abec-44240b05cad4 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.241747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 250/493] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:05.243731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b415e6c-9cca-4030-9b7e-6ecab7d508d2 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.305379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e4b65-21b7-4359-abec-44240b05cad4 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.341687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8da7f-38a6-4ccc-ab8b-6d86b8d8fb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.342390 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8da7f-38a6-4ccc-ab8b-6d86b8d8fb15 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.342674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8da7f-38a6-4ccc-ab8b-6d86b8d8fb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.342938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8da7f-38a6-4ccc-ab8b-6d86b8d8fb15 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.343682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8da7f-38a6-4ccc-ab8b-6d86b8d8fb15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:05.343998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8da7f-38a6-4ccc-ab8b-6d86b8d8fb15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.345428 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8da7f-38a6-4ccc-ab8b-6d86b8d8fb15 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.352136 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b415e6c-9cca-4030-9b7e-6ecab7d508d2 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.357297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 244/494] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:05.358619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ec01c-85e6-438c-9848-d45c56858409 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.358912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ec01c-85e6-438c-9848-d45c56858409 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.359192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ec01c-85e6-438c-9848-d45c56858409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.367322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:05.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:05.378143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9d7ec01c-85e6-438c-9848-d45c56858409 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:05.379412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9d7ec01c-85e6-438c-9848-d45c56858409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:05.397330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f49e6f-e19c-4efa-9de4-cdb4d8334ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.398428 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f49e6f-e19c-4efa-9de4-cdb4d8334ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.398877 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f49e6f-e19c-4efa-9de4-cdb4d8334ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.399342 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f49e6f-e19c-4efa-9de4-cdb4d8334ec7 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.400635 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f49e6f-e19c-4efa-9de4-cdb4d8334ec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:05.401275 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f49e6f-e19c-4efa-9de4-cdb4d8334ec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.402686 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f49e6f-e19c-4efa-9de4-cdb4d8334ec7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.415174 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 251/495] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:05.416316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f49e6f-e19c-4efa-9de4-cdb4d8334ec7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.454617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 245/496] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:05.455490 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ec01c-85e6-438c-9848-d45c56858409 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.535814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f49e6f-e19c-4efa-9de4-cdb4d8334ec7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.575546 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f443ee5-e6ee-40bc-8116-fd37a73cc84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.576364 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f443ee5-e6ee-40bc-8116-fd37a73cc84b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.576658 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f443ee5-e6ee-40bc-8116-fd37a73cc84b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.576935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f443ee5-e6ee-40bc-8116-fd37a73cc84b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.577199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ec01c-85e6-438c-9848-d45c56858409 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.588123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f443ee5-e6ee-40bc-8116-fd37a73cc84b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:05.596111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-6f443ee5-e6ee-40bc-8116-fd37a73cc84b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:05.596111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:05.596111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:05.596111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:05.596111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:05.596111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:05.596111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:05.596111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:05.596111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:05.596111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:05.596111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:05.596111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:05.596111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:05.596111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:05.596111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:05.596111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:05.597011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:05.597011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:05.597011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:05.597011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:05.597011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:05.597011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:05.597011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:05.597011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:05.597011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:05.597011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:05.597011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:05.597011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:05.597011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:05.597011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:05.597011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:05.597011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:05.597844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:05.597844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:05.597844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:05.597844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:05.597844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:05.597844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:05.597844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:05.597844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:05.597844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:05.597844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:05.597844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:05.597844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:05.597844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 252/497] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:05.598505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f443ee5-e6ee-40bc-8116-fd37a73cc84b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.621359 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6d206-eadb-45be-a9ea-21e63a77263f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.622189 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6d206-eadb-45be-a9ea-21e63a77263f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.622473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6d206-eadb-45be-a9ea-21e63a77263f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.622753 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6d206-eadb-45be-a9ea-21e63a77263f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.624678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:05.630688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6d206-eadb-45be-a9ea-21e63a77263f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.632279 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6d206-eadb-45be-a9ea-21e63a77263f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.634347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:05.648829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-5fc6d206-eadb-45be-a9ea-21e63a77263f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:22:05.648829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:05.648829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:05.648829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:05.648829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:05.648829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:05.648829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:05.648829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:05.648829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:05.648829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:05.648829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:05.648829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:05.648829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:05.648829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:05.648829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:05.648829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:05.649827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:05.650713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:05.650713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:05.650713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:05.650713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:05.650713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:05.650713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:05.650713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:05.650713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:05.650713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:22:05.650713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:05.650713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 246/498] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:05.651280 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6d206-eadb-45be-a9ea-21e63a77263f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.703806 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f443ee5-e6ee-40bc-8116-fd37a73cc84b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.737615 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02859a16-a209-4a80-8269-149c69fb3ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.738849 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02859a16-a209-4a80-8269-149c69fb3ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.739130 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02859a16-a209-4a80-8269-149c69fb3ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.739411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02859a16-a209-4a80-8269-149c69fb3ae2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.747411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02859a16-a209-4a80-8269-149c69fb3ae2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.748868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02859a16-a209-4a80-8269-149c69fb3ae2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.750372 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6d206-eadb-45be-a9ea-21e63a77263f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.764325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-02859a16-a209-4a80-8269-149c69fb3ae2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 00:22:05.764325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:05.764325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:05.764325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:05.764325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:05.764325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:05.764325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:05.764325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:05.764325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:05.764325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:05.764325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:05.764325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:05.764325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:05.764325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:05.764325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:05.764325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:05.765243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:05.766182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:05.766182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:05.766182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:05.766182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:05.766182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:05.766182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:05.766182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:05.766182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:05.766182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 00:22:05.766182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:05.766182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 253/499] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:05.767132 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02859a16-a209-4a80-8269-149c69fb3ae2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.788088 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558506c-4a1a-437c-b9fc-96d4cd6758fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.789062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558506c-4a1a-437c-b9fc-96d4cd6758fe None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.789366 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558506c-4a1a-437c-b9fc-96d4cd6758fe None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.789646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558506c-4a1a-437c-b9fc-96d4cd6758fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.799705 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558506c-4a1a-437c-b9fc-96d4cd6758fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:05.809547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-1558506c-4a1a-437c-b9fc-96d4cd6758fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:05.809547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:05.809547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:05.809547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:05.809547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:05.809547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:05.809547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:05.809547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:05.809547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:05.809547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:05.809547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:05.809547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:05.809547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:05.809547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:05.809547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:05.809547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:05.810617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:05.810617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:05.810617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:05.810617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:05.810617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:05.810617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:05.810617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:05.810617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:05.810617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:05.810617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:05.810617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:05.810617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:05.810617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:05.810617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:05.810617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:05.810617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:05.811528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:05.811528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:05.811528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:05.811528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:05.811528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:05.811528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:05.811528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:05.811528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:05.811528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:05.811528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:05.811528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:05.811528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:05.812153 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 247/500] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:05.813531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb4c7b-f7c2-4aa4-bf0f-30c6ac25a8f0 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.813956 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb4c7b-f7c2-4aa4-bf0f-30c6ac25a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.814406 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb4c7b-f7c2-4aa4-bf0f-30c6ac25a8f0 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.816440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 248/501] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:05.817857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb4c7b-f7c2-4aa4-bf0f-30c6ac25a8f0 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.863487 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:05.873864 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02859a16-a209-4a80-8269-149c69fb3ae2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.874693 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:05.907160 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b19e2-269e-4193-9f8e-b7ad2803add3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.907766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b19e2-269e-4193-9f8e-b7ad2803add3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.908048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b19e2-269e-4193-9f8e-b7ad2803add3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.908326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b19e2-269e-4193-9f8e-b7ad2803add3 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.909086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b19e2-269e-4193-9f8e-b7ad2803add3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:05.909433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b19e2-269e-4193-9f8e-b7ad2803add3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.910834 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b19e2-269e-4193-9f8e-b7ad2803add3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.918726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 254/502] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:05.918846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb4c7b-f7c2-4aa4-bf0f-30c6ac25a8f0 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:05.919496 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b19e2-269e-4193-9f8e-b7ad2803add3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:05.955084 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204da48-cc4a-4a3f-952c-e0aa405b399d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:05.955756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204da48-cc4a-4a3f-952c-e0aa405b399d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:05.956039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204da48-cc4a-4a3f-952c-e0aa405b399d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:05.956322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204da48-cc4a-4a3f-952c-e0aa405b399d None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:05.957163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204da48-cc4a-4a3f-952c-e0aa405b399d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:05.957533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204da48-cc4a-4a3f-952c-e0aa405b399d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:05.958992 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204da48-cc4a-4a3f-952c-e0aa405b399d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:05.995579 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 249/503] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:05.996405 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204da48-cc4a-4a3f-952c-e0aa405b399d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:06.018869 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b19e2-269e-4193-9f8e-b7ad2803add3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.051936 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b812ba-4d31-4297-bcad-11fb925f8e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.052619 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b812ba-4d31-4297-bcad-11fb925f8e30 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.052905 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b812ba-4d31-4297-bcad-11fb925f8e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.053186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b812ba-4d31-4297-bcad-11fb925f8e30 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.054057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b812ba-4d31-4297-bcad-11fb925f8e30 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:06.054375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b812ba-4d31-4297-bcad-11fb925f8e30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:06.055847 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b812ba-4d31-4297-bcad-11fb925f8e30 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:06.093021 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 255/504] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:06.094349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09332dad-d2eb-4563-8633-56bf5c01fd4b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.094640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09332dad-d2eb-4563-8633-56bf5c01fd4b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.094920 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09332dad-d2eb-4563-8633-56bf5c01fd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.096962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204da48-cc4a-4a3f-952c-e0aa405b399d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.110164 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:06.112323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-09332dad-d2eb-4563-8633-56bf5c01fd4b None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:06.113575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-09332dad-d2eb-4563-8633-56bf5c01fd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:06.121245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:06.132811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a4b12-320b-49f1-887e-eb5cb4b88e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.133531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a4b12-320b-49f1-887e-eb5cb4b88e8a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.133819 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a4b12-320b-49f1-887e-eb5cb4b88e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.134097 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a4b12-320b-49f1-887e-eb5cb4b88e8a None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.134852 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a4b12-320b-49f1-887e-eb5cb4b88e8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:06.135163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a4b12-320b-49f1-887e-eb5cb4b88e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:06.136554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a4b12-320b-49f1-887e-eb5cb4b88e8a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:06.144327 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 250/505] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:06.145092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a4b12-320b-49f1-887e-eb5cb4b88e8a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:06.183498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 256/506] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:06.184301 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09332dad-d2eb-4563-8633-56bf5c01fd4b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:06.249828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a4b12-320b-49f1-887e-eb5cb4b88e8a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.283151 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ca2f1-e9ce-4dbf-8933-477b1772e91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.283675 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09332dad-d2eb-4563-8633-56bf5c01fd4b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.284113 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ca2f1-e9ce-4dbf-8933-477b1772e91a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.284214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ca2f1-e9ce-4dbf-8933-477b1772e91a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.284488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ca2f1-e9ce-4dbf-8933-477b1772e91a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.295218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ca2f1-e9ce-4dbf-8933-477b1772e91a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:06.296687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ca2f1-e9ce-4dbf-8933-477b1772e91a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:06.313659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-e67ca2f1-e9ce-4dbf-8933-477b1772e91a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:06.313659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:06.313659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:06.313659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:06.313659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:06.313659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:06.313659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:06.313659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:06.313659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:06.313659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:06.313659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:06.313659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:06.313659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:06.313659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:06.313659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:06.315016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:06.316027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:06.316027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:06.316027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:06.316027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:06.316027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 251/507] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:06.316027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ca2f1-e9ce-4dbf-8933-477b1772e91a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:06.321981 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a02052-6200-4021-9a69-4b49ae25b925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.322643 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a02052-6200-4021-9a69-4b49ae25b925 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.322926 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a02052-6200-4021-9a69-4b49ae25b925 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.323198 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a02052-6200-4021-9a69-4b49ae25b925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.335804 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:06.346358 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:06.394014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a02052-6200-4021-9a69-4b49ae25b925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:06.395493 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a02052-6200-4021-9a69-4b49ae25b925 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:06.423405 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ca2f1-e9ce-4dbf-8933-477b1772e91a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.462055 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fe82a-f7cc-4846-b536-0c0e64952933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.462719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fe82a-f7cc-4846-b536-0c0e64952933 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.463007 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fe82a-f7cc-4846-b536-0c0e64952933 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.463288 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fe82a-f7cc-4846-b536-0c0e64952933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.499159 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 257/508] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:06.504073 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a02052-6200-4021-9a69-4b49ae25b925 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:06.532870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fe82a-f7cc-4846-b536-0c0e64952933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:06.534375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fe82a-f7cc-4846-b536-0c0e64952933 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:06.542845 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:06.559884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:06.598610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a02052-6200-4021-9a69-4b49ae25b925 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.633944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 252/509] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:06.634817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fe82a-f7cc-4846-b536-0c0e64952933 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:06.641599 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12007bd-4c70-4766-9d05-6f4b13150c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.642414 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12007bd-4c70-4766-9d05-6f4b13150c51 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.642698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12007bd-4c70-4766-9d05-6f4b13150c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.642971 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12007bd-4c70-4766-9d05-6f4b13150c51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.653520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12007bd-4c70-4766-9d05-6f4b13150c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:06.654991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12007bd-4c70-4766-9d05-6f4b13150c51 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:06.672311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-f12007bd-4c70-4766-9d05-6f4b13150c51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:06.672311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:06.672311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:06.672311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:06.672311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:06.672311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:06.672311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:06.672311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:06.672311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:06.672311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:06.672311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:06.672311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:06.672311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:06.672311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:06.672311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:06.673180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:06.674121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:06.674121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:06.674121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:06.674121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:06.674121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 258/510] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:06.674396 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12007bd-4c70-4766-9d05-6f4b13150c51 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:06.735688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fe82a-f7cc-4846-b536-0c0e64952933 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.762384 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:06.769269 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:06.772728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8213945-68c1-4f46-bf06-e274707ed794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.773609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213945-68c1-4f46-bf06-e274707ed794 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.773865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213945-68c1-4f46-bf06-e274707ed794 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.774143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8213945-68c1-4f46-bf06-e274707ed794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.776345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12007bd-4c70-4766-9d05-6f4b13150c51 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.784282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8213945-68c1-4f46-bf06-e274707ed794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:06.785777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8213945-68c1-4f46-bf06-e274707ed794 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:06.803092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a8213945-68c1-4f46-bf06-e274707ed794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:06.803092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:06.803092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:06.803092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:06.803092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:06.803092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:06.803092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:06.803092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:06.803092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:06.803092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:06.803092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:06.803092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:06.803092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:06.803092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:06.803092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:06.803975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:06.804928 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:06.804928 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:06.804928 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:06.804928 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:06.804928 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 253/511] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:06.805192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8213945-68c1-4f46-bf06-e274707ed794 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:06.815717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee879bc-3f4d-41ea-bdc2-f5781bdc2d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.816381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee879bc-3f4d-41ea-bdc2-f5781bdc2d03 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.816970 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee879bc-3f4d-41ea-bdc2-f5781bdc2d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.817255 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee879bc-3f4d-41ea-bdc2-f5781bdc2d03 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.818029 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee879bc-3f4d-41ea-bdc2-f5781bdc2d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:06.818340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee879bc-3f4d-41ea-bdc2-f5781bdc2d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:06.819733 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee879bc-3f4d-41ea-bdc2-f5781bdc2d03 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:06.832370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 259/512] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:06.833143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee879bc-3f4d-41ea-bdc2-f5781bdc2d03 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:06.901573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8213945-68c1-4f46-bf06-e274707ed794 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.937756 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee879bc-3f4d-41ea-bdc2-f5781bdc2d03 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:06.941745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b4138-6e0e-4e71-94b9-ccda70acbdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.942565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b4138-6e0e-4e71-94b9-ccda70acbdf8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.942851 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b4138-6e0e-4e71-94b9-ccda70acbdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.943130 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b4138-6e0e-4e71-94b9-ccda70acbdf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.953411 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b4138-6e0e-4e71-94b9-ccda70acbdf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:06.954912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b4138-6e0e-4e71-94b9-ccda70acbdf8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:06.972445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-9a7b4138-6e0e-4e71-94b9-ccda70acbdf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:06.972445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:06.972445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:06.972445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:06.972445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:06.972445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:06.972445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:06.972445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:06.972445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:06.972445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:06.972445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:06.972445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:06.972445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:06.972445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:06.972445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:06.973451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:06.974501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:06.974501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:06.974501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:06.974501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:06.974903 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29c3ba-dca6-4326-9455-61f4aea536c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:06.974903 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29c3ba-dca6-4326-9455-61f4aea536c6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:06.974903 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29c3ba-dca6-4326-9455-61f4aea536c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:06.975156 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 254/513] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:06.975156 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b4138-6e0e-4e71-94b9-ccda70acbdf8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:06.978536 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29c3ba-dca6-4326-9455-61f4aea536c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:06.989715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29c3ba-dca6-4326-9455-61f4aea536c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:06.991497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29c3ba-dca6-4326-9455-61f4aea536c6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:07.004001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:07.009704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-6c29c3ba-dca6-4326-9455-61f4aea536c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:07.009704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:07.009704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:07.009704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:07.009704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:07.009704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:07.009704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:07.009704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:07.009704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:07.009704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:07.009704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:07.009704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:07.009704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:07.009704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:07.009704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:07.010730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:07.011868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:07.011868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:07.011868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:07.011868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:07.011868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 260/514] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:07.012348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29c3ba-dca6-4326-9455-61f4aea536c6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:07.020530 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:07.079223 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b4138-6e0e-4e71-94b9-ccda70acbdf8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:07.111634 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29c3ba-dca6-4326-9455-61f4aea536c6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:07.113792 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879709c0-a288-4ecd-be2d-b14f33f31531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:07.114468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879709c0-a288-4ecd-be2d-b14f33f31531 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:07.114754 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879709c0-a288-4ecd-be2d-b14f33f31531 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:07.115031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879709c0-a288-4ecd-be2d-b14f33f31531 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:07.116123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879709c0-a288-4ecd-be2d-b14f33f31531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:07.116436 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879709c0-a288-4ecd-be2d-b14f33f31531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:07.117948 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879709c0-a288-4ecd-be2d-b14f33f31531 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:07.129083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 255/515] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:07.129914 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879709c0-a288-4ecd-be2d-b14f33f31531 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:07.147785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d4e3e-6b86-4546-9423-286a1be3fb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:07.148534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d4e3e-6b86-4546-9423-286a1be3fb5b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:07.148823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d4e3e-6b86-4546-9423-286a1be3fb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:07.149098 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d4e3e-6b86-4546-9423-286a1be3fb5b None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:07.149854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d4e3e-6b86-4546-9423-286a1be3fb5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:07.150166 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d4e3e-6b86-4546-9423-286a1be3fb5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:07.151541 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d4e3e-6b86-4546-9423-286a1be3fb5b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:07.162893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 261/516] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:07.163668 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d4e3e-6b86-4546-9423-286a1be3fb5b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:07.218035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:07.227902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:07.228351 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879709c0-a288-4ecd-be2d-b14f33f31531 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:07.261441 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e1126-1555-4f55-80a6-97c2b91d6c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:07.262323 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e1126-1555-4f55-80a6-97c2b91d6c61 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:07.262459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d4e3e-6b86-4546-9423-286a1be3fb5b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:07.262598 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e1126-1555-4f55-80a6-97c2b91d6c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:07.262880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e1126-1555-4f55-80a6-97c2b91d6c61 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:07.270168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e1126-1555-4f55-80a6-97c2b91d6c61 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:07.271624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e1126-1555-4f55-80a6-97c2b91d6c61 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:07.285938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-821e1126-1555-4f55-80a6-97c2b91d6c61 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 00:22:07.285938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:07.285938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:07.285938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:07.285938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:07.285938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:07.285938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:07.285938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:07.285938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:07.285938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:07.285938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:07.285938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:07.285938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:07.285938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:07.285938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:07.285938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:07.286896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:07.287836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:07.287836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:07.287836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:07.287836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:07.287836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:07.287836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:07.287836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:07.287836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:07.287836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 00:22:07.287836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:07.287836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 256/517] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:07.288403 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e1126-1555-4f55-80a6-97c2b91d6c61 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:07.298838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbbaa4-4936-4a77-9f31-50fac905e340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:07.299501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbbaa4-4936-4a77-9f31-50fac905e340 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:07.299787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbbaa4-4936-4a77-9f31-50fac905e340 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:07.300050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbbaa4-4936-4a77-9f31-50fac905e340 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:07.300784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbbaa4-4936-4a77-9f31-50fac905e340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:07.301093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbbaa4-4936-4a77-9f31-50fac905e340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:07.302508 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbbaa4-4936-4a77-9f31-50fac905e340 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:07.313958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 262/518] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:07.314728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbbaa4-4936-4a77-9f31-50fac905e340 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:07.391412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e1126-1555-4f55-80a6-97c2b91d6c61 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:07.412742 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbbaa4-4936-4a77-9f31-50fac905e340 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:07.423784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79889109-91f2-43bf-a903-36b9a3851aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:07.424450 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79889109-91f2-43bf-a903-36b9a3851aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:07.424731 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79889109-91f2-43bf-a903-36b9a3851aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:07.425006 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79889109-91f2-43bf-a903-36b9a3851aa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:07.425767 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79889109-91f2-43bf-a903-36b9a3851aa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:07.426071 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79889109-91f2-43bf-a903-36b9a3851aa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:07.427451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79889109-91f2-43bf-a903-36b9a3851aa7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:07.438194 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:07.439227 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 257/519] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:07.439996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79889109-91f2-43bf-a903-36b9a3851aa7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:07.447594 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756b358-f861-4e83-9cd9-9df7def80039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:07.448436 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756b358-f861-4e83-9cd9-9df7def80039 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:07.448720 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756b358-f861-4e83-9cd9-9df7def80039 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:07.448995 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756b358-f861-4e83-9cd9-9df7def80039 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:07.452328 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:07.456369 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756b358-f861-4e83-9cd9-9df7def80039 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:07.457902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5756b358-f861-4e83-9cd9-9df7def80039 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:07.472497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5756b358-f861-4e83-9cd9-9df7def80039 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 00:22:07.472497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:07.472497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:07.472497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:07.472497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:07.472497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:07.472497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:07.472497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:07.472497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:07.472497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:07.472497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:07.472497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:07.472497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:07.472497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:07.472497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:07.472497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:07.473604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:07.479652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:07.479652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:07.479652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:07.479652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:07.479652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:07.479652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:07.479652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:07.479652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:07.479652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 00:22:07.479652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:07.479652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 263/520] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:07.479652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756b358-f861-4e83-9cd9-9df7def80039 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:07.539243 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79889109-91f2-43bf-a903-36b9a3851aa7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:07.571619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b453b-b5aa-4514-9c37-940f53cb633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:07.572291 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b453b-b5aa-4514-9c37-940f53cb633a None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:07.572571 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b453b-b5aa-4514-9c37-940f53cb633a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:07.572839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b453b-b5aa-4514-9c37-940f53cb633a None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:07.573574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b453b-b5aa-4514-9c37-940f53cb633a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:07.575019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b453b-b5aa-4514-9c37-940f53cb633a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:07.575890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5756b358-f861-4e83-9cd9-9df7def80039 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:07.594015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 258/521] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:22:07 2022] POST /identity/v3/users => generated 247 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:07.594807 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b453b-b5aa-4514-9c37-940f53cb633a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:07.627777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dfff5-9c9e-459d-9058-eb2b190ea1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:07.628515 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dfff5-9c9e-459d-9058-eb2b190ea1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:07.628811 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dfff5-9c9e-459d-9058-eb2b190ea1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:07.629081 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dfff5-9c9e-459d-9058-eb2b190ea1c3 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:07.629986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dfff5-9c9e-459d-9058-eb2b190ea1c3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:07.630299 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dfff5-9c9e-459d-9058-eb2b190ea1c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:07.631792 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dfff5-9c9e-459d-9058-eb2b190ea1c3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:07.653291 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 264/522] 10.222.0.36 () {56 vars in 1139 bytes} [Wed Jun 15 00:22:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:07.654330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dfff5-9c9e-459d-9058-eb2b190ea1c3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:07.677215 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:07.704846 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:07.720094 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b453b-b5aa-4514-9c37-940f53cb633a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:07.764756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447f8e3-15a1-4327-b70c-1d251bf82bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:07.765685 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447f8e3-15a1-4327-b70c-1d251bf82bcd None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:07.765797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447f8e3-15a1-4327-b70c-1d251bf82bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:07.766006 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447f8e3-15a1-4327-b70c-1d251bf82bcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:07.772010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dfff5-9c9e-459d-9058-eb2b190ea1c3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:07.775083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447f8e3-15a1-4327-b70c-1d251bf82bcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:07.776583 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447f8e3-15a1-4327-b70c-1d251bf82bcd None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:07.793592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-f447f8e3-15a1-4327-b70c-1d251bf82bcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:07.793592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:07.793592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:07.793592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:07.793592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:07.793592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:07.793592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:07.793592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:07.793592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:07.793592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:07.793592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:07.793592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:07.793592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:07.793592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:07.793592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:07.794827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:07.795893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:07.795893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:07.795893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:07.795893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:07.795893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:07.795893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:07.795893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:07.795893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:07.795893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 259/523] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:07.795893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447f8e3-15a1-4327-b70c-1d251bf82bcd None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:07.817157 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc3664-5135-4e2f-b126-13ea2fe57bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:07.818111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc3664-5135-4e2f-b126-13ea2fe57bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:07.818468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc3664-5135-4e2f-b126-13ea2fe57bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:07.818821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc3664-5135-4e2f-b126-13ea2fe57bf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:07.831147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc3664-5135-4e2f-b126-13ea2fe57bf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:07.832715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc3664-5135-4e2f-b126-13ea2fe57bf9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:07.857044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-59cc3664-5135-4e2f-b126-13ea2fe57bf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:07.857044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:07.857044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:07.857044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:07.857044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:07.857044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:07.857044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:07.857044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:07.857044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:07.857044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:07.857044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:07.857044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:07.857044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:07.857044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:07.857044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:07.858205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:07.859336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:07.859336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:07.859336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:07.859336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:07.859336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:07.859336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:07.859336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:07.859336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:07.863768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 265/524] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:07.864621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc3664-5135-4e2f-b126-13ea2fe57bf9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:07.913972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447f8e3-15a1-4327-b70c-1d251bf82bcd None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:07.940233 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:07.951774 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842cd6f-24ae-4b90-a285-0b823eaf0b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:07.952549 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842cd6f-24ae-4b90-a285-0b823eaf0b08 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:07.952898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842cd6f-24ae-4b90-a285-0b823eaf0b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:07.953222 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842cd6f-24ae-4b90-a285-0b823eaf0b08 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:07.954267 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842cd6f-24ae-4b90-a285-0b823eaf0b08 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:07.954652 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842cd6f-24ae-4b90-a285-0b823eaf0b08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:07.956204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842cd6f-24ae-4b90-a285-0b823eaf0b08 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:07.974582 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 260/525] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Jun 15 00:22:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:07.975311 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842cd6f-24ae-4b90-a285-0b823eaf0b08 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:07.977761 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc3664-5135-4e2f-b126-13ea2fe57bf9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:07.980799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:08.016375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f01ef7-b97d-4810-8fd7-abd33c0b809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:08.017977 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f01ef7-b97d-4810-8fd7-abd33c0b809b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.018357 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f01ef7-b97d-4810-8fd7-abd33c0b809b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.018727 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f01ef7-b97d-4810-8fd7-abd33c0b809b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.089828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842cd6f-24ae-4b90-a285-0b823eaf0b08 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:08.092461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f01ef7-b97d-4810-8fd7-abd33c0b809b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:08.094006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f01ef7-b97d-4810-8fd7-abd33c0b809b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:08.126388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e69e3-f526-47ab-8355-c731aacd946f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:08.127417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e69e3-f526-47ab-8355-c731aacd946f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.127888 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e69e3-f526-47ab-8355-c731aacd946f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.128372 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e69e3-f526-47ab-8355-c731aacd946f None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.129391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e69e3-f526-47ab-8355-c731aacd946f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:08.129907 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e69e3-f526-47ab-8355-c731aacd946f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:08.131407 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e69e3-f526-47ab-8355-c731aacd946f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:08.150182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 261/526] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:08.151111 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e69e3-f526-47ab-8355-c731aacd946f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:08.206817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:08.207617 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 266/527] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:08.208485 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f01ef7-b97d-4810-8fd7-abd33c0b809b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:08.212507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:08.272413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e69e3-f526-47ab-8355-c731aacd946f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:08.306647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796801d-c28f-40aa-be46-0889d2e17bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:08.307326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796801d-c28f-40aa-be46-0889d2e17bdb None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.307611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796801d-c28f-40aa-be46-0889d2e17bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.307892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796801d-c28f-40aa-be46-0889d2e17bdb None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.308688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796801d-c28f-40aa-be46-0889d2e17bdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:08.309005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796801d-c28f-40aa-be46-0889d2e17bdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:08.310490 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796801d-c28f-40aa-be46-0889d2e17bdb None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:08.314171 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f01ef7-b97d-4810-8fd7-abd33c0b809b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:08.323048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 262/528] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:08.323801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796801d-c28f-40aa-be46-0889d2e17bdb None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:08.353751 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d57bde-1fba-4a34-b169-c6e83f714193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:08.354791 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d57bde-1fba-4a34-b169-c6e83f714193 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.355363 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d57bde-1fba-4a34-b169-c6e83f714193 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.355642 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d57bde-1fba-4a34-b169-c6e83f714193 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.429798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796801d-c28f-40aa-be46-0889d2e17bdb None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:08.431612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d57bde-1fba-4a34-b169-c6e83f714193 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:08.432110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:08.433748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d57bde-1fba-4a34-b169-c6e83f714193 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:08.436587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:08.466874 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e7aa3-b094-41a6-a075-9136171a8b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:08.467797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e7aa3-b094-41a6-a075-9136171a8b9f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.468085 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e7aa3-b094-41a6-a075-9136171a8b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.468363 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e7aa3-b094-41a6-a075-9136171a8b9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.469208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e7aa3-b094-41a6-a075-9136171a8b9f None admin] RBAC: Adding query filter params (role.id=4afb8bd8c6354dd9b143ef4aaa8284fa, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=6d0ae1707c7041a0989889dbefeaf267) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:08.469556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e7aa3-b094-41a6-a075-9136171a8b9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:08.471018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e7aa3-b094-41a6-a075-9136171a8b9f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:08.476700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 263/529] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:08 2022] GET /identity/v3/role_assignments?user.id=6d0ae1707c7041a0989889dbefeaf267&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=4afb8bd8c6354dd9b143ef4aaa8284fa => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:08.477229 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e7aa3-b094-41a6-a075-9136171a8b9f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:08.572344 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 267/530] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:08.572344 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d57bde-1fba-4a34-b169-c6e83f714193 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:08.611644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e7aa3-b094-41a6-a075-9136171a8b9f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:08.664866 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6048eb-9091-486c-ad05-064afb3fbc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:08.666453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6048eb-9091-486c-ad05-064afb3fbc30 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.666453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6048eb-9091-486c-ad05-064afb3fbc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.666710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6048eb-9091-486c-ad05-064afb3fbc30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.681897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6048eb-9091-486c-ad05-064afb3fbc30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:08.683947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6048eb-9091-486c-ad05-064afb3fbc30 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:08.688857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d57bde-1fba-4a34-b169-c6e83f714193 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:08.691560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:08.705464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-2f6048eb-9091-486c-ad05-064afb3fbc30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:08.705464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:08.705464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:08.705464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:08.705464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:08.705464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:08.705464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:08.705464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:08.705464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:08.705464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:08.705464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:08.705464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:08.705464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:08.705464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:08.705464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:08.706419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:08.707289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:08.707289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:08.707289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:08.707289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:08.707289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 264/531] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:08.708117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6048eb-9091-486c-ad05-064afb3fbc30 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:08.733182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63f418-739e-4695-9fa1-4ce89aa59ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:08.734275 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63f418-739e-4695-9fa1-4ce89aa59ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.734758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63f418-739e-4695-9fa1-4ce89aa59ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.735335 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63f418-739e-4695-9fa1-4ce89aa59ac1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.736397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63f418-739e-4695-9fa1-4ce89aa59ac1 None admin] RBAC: Adding query filter params (role.id=4afb8bd8c6354dd9b143ef4aaa8284fa, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=a239897b9a0644ef9d2e0e2e333232fa) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:08.736935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63f418-739e-4695-9fa1-4ce89aa59ac1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:08.737037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:08.738753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63f418-739e-4695-9fa1-4ce89aa59ac1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:08.753681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 268/532] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:08 2022] GET /identity/v3/role_assignments?user.id=a239897b9a0644ef9d2e0e2e333232fa&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=4afb8bd8c6354dd9b143ef4aaa8284fa => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:08.755235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63f418-739e-4695-9fa1-4ce89aa59ac1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:08.833537 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6048eb-9091-486c-ad05-064afb3fbc30 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:08.907844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198250b8-9163-449a-abc2-b3f730a1b8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:08.908647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198250b8-9163-449a-abc2-b3f730a1b8fa None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:08.908939 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198250b8-9163-449a-abc2-b3f730a1b8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:08.909217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198250b8-9163-449a-abc2-b3f730a1b8fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:08.938377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198250b8-9163-449a-abc2-b3f730a1b8fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:08.939895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198250b8-9163-449a-abc2-b3f730a1b8fa None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:08.972794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-198250b8-9163-449a-abc2-b3f730a1b8fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:08.972794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:08.972794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:08.972794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:08.972794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:08.972794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:08.972794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:08.972794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:08.972794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:08.972794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:08.972794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:08.972794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:08.972794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:08.972794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:08.972794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:08.973776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:08.974631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:08.974631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:08.974631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:08.974631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:08.974852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63f418-739e-4695-9fa1-4ce89aa59ac1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:08.978769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 265/533] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:08.980239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198250b8-9163-449a-abc2-b3f730a1b8fa None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:09.012245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83e06b-9812-49e5-8132-fc0a4931d7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:09.012917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83e06b-9812-49e5-8132-fc0a4931d7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.013198 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83e06b-9812-49e5-8132-fc0a4931d7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.013507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83e06b-9812-49e5-8132-fc0a4931d7a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.014607 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83e06b-9812-49e5-8132-fc0a4931d7a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:09.014925 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83e06b-9812-49e5-8132-fc0a4931d7a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:09.016299 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83e06b-9812-49e5-8132-fc0a4931d7a5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:09.029028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 269/534] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:09.034498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83e06b-9812-49e5-8132-fc0a4931d7a5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:09.075650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:09.145166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:09.156736 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83e06b-9812-49e5-8132-fc0a4931d7a5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:09.193263 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbf304-7081-414a-b499-f709cfcb43e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:09.194033 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbf304-7081-414a-b499-f709cfcb43e8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.194317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbf304-7081-414a-b499-f709cfcb43e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.194596 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbf304-7081-414a-b499-f709cfcb43e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.202304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbf304-7081-414a-b499-f709cfcb43e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:09.203775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbf304-7081-414a-b499-f709cfcb43e8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:09.219360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-4cdbf304-7081-414a-b499-f709cfcb43e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:09.219360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:09.219360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:09.219360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:09.219360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:09.219360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:09.219360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:09.219360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:09.219360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:09.219360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:09.219360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:09.219360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:09.219360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:09.219360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:09.219360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:09.220248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:09.221640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:09.221640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:09.221640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:09.221640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:09.221640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:09.221640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:09.221640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:09.221640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:09.221640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 270/535] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:09.228972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbf304-7081-414a-b499-f709cfcb43e8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:09.237892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198250b8-9163-449a-abc2-b3f730a1b8fa None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:09.330632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1058c-1232-4f2a-bd10-c5f3f2b4bbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:09.331324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1058c-1232-4f2a-bd10-c5f3f2b4bbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.331609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1058c-1232-4f2a-bd10-c5f3f2b4bbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.331889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1058c-1232-4f2a-bd10-c5f3f2b4bbe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.332641 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1058c-1232-4f2a-bd10-c5f3f2b4bbe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:09.332955 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1058c-1232-4f2a-bd10-c5f3f2b4bbe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:09.334389 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1058c-1232-4f2a-bd10-c5f3f2b4bbe8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:09.352258 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:09.364053 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 266/536] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:09.366152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbf304-7081-414a-b499-f709cfcb43e8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:09.370406 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1058c-1232-4f2a-bd10-c5f3f2b4bbe8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:09.404911 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f7c92-549c-4b89-9ee3-45a89e0acae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:09.405988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f7c92-549c-4b89-9ee3-45a89e0acae4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.406280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f7c92-549c-4b89-9ee3-45a89e0acae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.406556 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f7c92-549c-4b89-9ee3-45a89e0acae4 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.413381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f7c92-549c-4b89-9ee3-45a89e0acae4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:09.413381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f7c92-549c-4b89-9ee3-45a89e0acae4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:09.413381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f7c92-549c-4b89-9ee3-45a89e0acae4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:09.430133 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 271/537] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:09.438470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f7c92-549c-4b89-9ee3-45a89e0acae4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:09.534933 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1058c-1232-4f2a-bd10-c5f3f2b4bbe8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:09.570675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ffff7-8593-436a-afd2-32d428a25f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:09.571603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ffff7-8593-436a-afd2-32d428a25f61 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.571972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ffff7-8593-436a-afd2-32d428a25f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.572332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ffff7-8593-436a-afd2-32d428a25f61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.579456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ffff7-8593-436a-afd2-32d428a25f61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:09.581015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ffff7-8593-436a-afd2-32d428a25f61 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:09.595427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-152ffff7-8593-436a-afd2-32d428a25f61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:09.595427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:09.595427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:09.595427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:09.595427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:09.595427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:09.595427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:09.595427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:09.595427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:09.595427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:09.595427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:09.595427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:09.595427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:09.595427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:09.595427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:09.596495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:09.597599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:09.597599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:09.597599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:09.597599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:09.597599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:09.597599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:09.597599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:09.597599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:09.598977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 267/538] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:09.599423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:09.605924 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ffff7-8593-436a-afd2-32d428a25f61 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:09.717113 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ffff7-8593-436a-afd2-32d428a25f61 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:09.755631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eb4b4-a512-4103-9348-a65f36d1e6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:09.756688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eb4b4-a512-4103-9348-a65f36d1e6cc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.757164 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eb4b4-a512-4103-9348-a65f36d1e6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.757722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eb4b4-a512-4103-9348-a65f36d1e6cc None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.759022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160eb4b4-a512-4103-9348-a65f36d1e6cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:09.759536 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160eb4b4-a512-4103-9348-a65f36d1e6cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:09.761280 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160eb4b4-a512-4103-9348-a65f36d1e6cc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:09.772098 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f7c92-549c-4b89-9ee3-45a89e0acae4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:09.777830 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 268/539] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:09.785475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eb4b4-a512-4103-9348-a65f36d1e6cc None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:09.850342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:09.858493 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de4cac-2782-4b82-9bb8-2938c54df96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:09.859157 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de4cac-2782-4b82-9bb8-2938c54df96b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.859436 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de4cac-2782-4b82-9bb8-2938c54df96b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.859707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de4cac-2782-4b82-9bb8-2938c54df96b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.860545 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de4cac-2782-4b82-9bb8-2938c54df96b None admin] RBAC: Adding query filter params (role.id=4afb8bd8c6354dd9b143ef4aaa8284fa, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=46c398ec4dcc438895f054f616fc9e41) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:09.860855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de4cac-2782-4b82-9bb8-2938c54df96b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:09.862351 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de4cac-2782-4b82-9bb8-2938c54df96b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:09.869012 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 272/540] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:09 2022] GET /identity/v3/role_assignments?user.id=46c398ec4dcc438895f054f616fc9e41&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=4afb8bd8c6354dd9b143ef4aaa8284fa => generated 259 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:09.870347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313c89d-ac18-4d94-91e1-6e474f30ca2b None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.870632 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313c89d-ac18-4d94-91e1-6e474f30ca2b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.870908 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313c89d-ac18-4d94-91e1-6e474f30ca2b None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.872144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 273/541] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:09.877867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac45dc-a2d9-442d-8f3c-74eb2715c6cb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.878157 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac45dc-a2d9-442d-8f3c-74eb2715c6cb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.878433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac45dc-a2d9-442d-8f3c-74eb2715c6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.896135 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-26ac45dc-a2d9-442d-8f3c-74eb2715c6cb None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:09.897366 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-26ac45dc-a2d9-442d-8f3c-74eb2715c6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:09.902785 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eb4b4-a512-4103-9348-a65f36d1e6cc None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:09.906318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:09.942403 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72976065-3ad8-4047-96bb-c7054fb8e440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:09.943450 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72976065-3ad8-4047-96bb-c7054fb8e440 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:09.944016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72976065-3ad8-4047-96bb-c7054fb8e440 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:09.944466 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72976065-3ad8-4047-96bb-c7054fb8e440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:09.945658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72976065-3ad8-4047-96bb-c7054fb8e440 None admin] RBAC: Adding query filter params (role.id=4afb8bd8c6354dd9b143ef4aaa8284fa, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=d41065b495234fd98552222fc32cc53e) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:09.946149 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72976065-3ad8-4047-96bb-c7054fb8e440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:09.947825 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72976065-3ad8-4047-96bb-c7054fb8e440 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:09.961652 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 269/542] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:09 2022] GET /identity/v3/role_assignments?user.id=d41065b495234fd98552222fc32cc53e&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=4afb8bd8c6354dd9b143ef4aaa8284fa => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:09.970741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 274/543] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:09.994456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72976065-3ad8-4047-96bb-c7054fb8e440 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:10.147058 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72976065-3ad8-4047-96bb-c7054fb8e440 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:10.175641 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:10.188122 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0774c-62fc-49fe-92c6-bf79cc449cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:10.188950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0774c-62fc-49fe-92c6-bf79cc449cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:10.189234 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0774c-62fc-49fe-92c6-bf79cc449cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:10.189544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0774c-62fc-49fe-92c6-bf79cc449cd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:10.205018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0774c-62fc-49fe-92c6-bf79cc449cd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:10.213061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-5da0774c-62fc-49fe-92c6-bf79cc449cd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:10.213061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:10.213061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:10.213061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:10.213061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:10.213061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:10.213061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:10.213061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:10.213061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:10.213061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:10.213061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:10.213061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:10.213061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:10.213061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:10.213061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:10.213061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:10.213958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:10.213958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:10.213958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:10.213958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:10.213958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:10.213958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:10.213958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:10.213958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:10.213958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:10.213958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:10.213958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:10.213958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:10.213958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:10.213958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:10.213958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:10.213958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:10.214787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:10.214787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:10.214787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:10.214787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:10.214787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:10.214787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:10.214787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:10.214787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:10.214787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:10.214787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:10.214787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:10.214787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:10.214787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 270/544] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:10.221700 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac45dc-a2d9-442d-8f3c-74eb2715c6cb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:10.341186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac45dc-a2d9-442d-8f3c-74eb2715c6cb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:10.376113 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498d9f5-170e-4e5b-879a-4db2b05f52c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:10.376897 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498d9f5-170e-4e5b-879a-4db2b05f52c8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:10.377081 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498d9f5-170e-4e5b-879a-4db2b05f52c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:10.377393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498d9f5-170e-4e5b-879a-4db2b05f52c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:10.378143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498d9f5-170e-4e5b-879a-4db2b05f52c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:10.378456 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498d9f5-170e-4e5b-879a-4db2b05f52c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:10.379839 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498d9f5-170e-4e5b-879a-4db2b05f52c8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:10.392376 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 275/545] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:10.398155 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0774c-62fc-49fe-92c6-bf79cc449cd3 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:10.552157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0774c-62fc-49fe-92c6-bf79cc449cd3 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:10.598980 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c2fbc-9e97-4225-a7f8-d2679af36512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:10.599726 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c2fbc-9e97-4225-a7f8-d2679af36512 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:10.600011 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c2fbc-9e97-4225-a7f8-d2679af36512 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:10.600286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c2fbc-9e97-4225-a7f8-d2679af36512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:10.615935 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c2fbc-9e97-4225-a7f8-d2679af36512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:10.617502 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c2fbc-9e97-4225-a7f8-d2679af36512 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:10.642692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-999c2fbc-9e97-4225-a7f8-d2679af36512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:10.642692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:10.642692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:10.642692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:10.642692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:10.642692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:10.642692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:10.642692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:10.642692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:10.642692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:10.642692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:10.642692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:10.642692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:10.642692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:10.642692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:10.643608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:10.644461 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:10.644461 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:10.644461 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:10.644461 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:10.644461 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 271/546] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:10.650881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498d9f5-170e-4e5b-879a-4db2b05f52c8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:10.660536 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:10.783978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498d9f5-170e-4e5b-879a-4db2b05f52c8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:10.838969 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05eb33d-a732-4187-9769-cddad2564571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:10.839660 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eb33d-a732-4187-9769-cddad2564571 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:10.839949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eb33d-a732-4187-9769-cddad2564571 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:10.840226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eb33d-a732-4187-9769-cddad2564571 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:10.840963 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05eb33d-a732-4187-9769-cddad2564571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:10.841273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05eb33d-a732-4187-9769-cddad2564571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:10.842807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05eb33d-a732-4187-9769-cddad2564571 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:10.867312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 276/547] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:10.874464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c2fbc-9e97-4225-a7f8-d2679af36512 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:10.928007 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:11.010615 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aafd6-f44c-43c3-be03-2374e1975976 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.010968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aafd6-f44c-43c3-be03-2374e1975976 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.011183 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aafd6-f44c-43c3-be03-2374e1975976 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.012855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 277/548] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:11.018025 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785bbc5-9348-448b-9916-6249134fcc39 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.018314 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785bbc5-9348-448b-9916-6249134fcc39 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.019085 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785bbc5-9348-448b-9916-6249134fcc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.039306 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d785bbc5-9348-448b-9916-6249134fcc39 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:11.040514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d785bbc5-9348-448b-9916-6249134fcc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:11.046083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c2fbc-9e97-4225-a7f8-d2679af36512 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:11.119643 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a247f8-6012-42ec-b872-01137792a115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:11.120388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a247f8-6012-42ec-b872-01137792a115 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.120672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a247f8-6012-42ec-b872-01137792a115 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.120952 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a247f8-6012-42ec-b872-01137792a115 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.135676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a247f8-6012-42ec-b872-01137792a115 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:11.137151 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a247f8-6012-42ec-b872-01137792a115 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:11.152687 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:11.153136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-97a247f8-6012-42ec-b872-01137792a115 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:22:11.153136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:11.153136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:11.153136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:11.153136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:11.153136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:11.153136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:11.153136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:11.153136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:11.153136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:11.153136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:11.153136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:11.153136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:11.153136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:11.153136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:11.153136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:11.154588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:11.155674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:11.155674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:11.155674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:11.155674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:11.155674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:11.155674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:11.155674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:11.155674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:11.155674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:22:11.155674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:11.155674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 272/549] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:11.156285 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8822f7-2e24-49f9-92a6-220a06a48bfe None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.156285 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8822f7-2e24-49f9-92a6-220a06a48bfe None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.157289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8822f7-2e24-49f9-92a6-220a06a48bfe None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.158129 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 273/550] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:11.162303 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8822f7-2e24-49f9-92a6-220a06a48bfe None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:11.175346 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 278/551] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:11.177283 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133df9-2dda-454e-adc9-ee579b357c4c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.177818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133df9-2dda-454e-adc9-ee579b357c4c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.178298 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05133df9-2dda-454e-adc9-ee579b357c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.208819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-05133df9-2dda-454e-adc9-ee579b357c4c None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:11.210513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-05133df9-2dda-454e-adc9-ee579b357c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:11.251524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:11.264811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8822f7-2e24-49f9-92a6-220a06a48bfe None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:11.293755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 279/552] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:11.295049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05133df9-2dda-454e-adc9-ee579b357c4c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:11.299165 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cf541-ce07-40db-9fa5-d0c9d5dce1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:11.299659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cf541-ce07-40db-9fa5-d0c9d5dce1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.299946 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cf541-ce07-40db-9fa5-d0c9d5dce1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.300226 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cf541-ce07-40db-9fa5-d0c9d5dce1f1 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.301074 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cf541-ce07-40db-9fa5-d0c9d5dce1f1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:11.301416 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cf541-ce07-40db-9fa5-d0c9d5dce1f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:11.302870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cf541-ce07-40db-9fa5-d0c9d5dce1f1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:11.329237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 274/553] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Jun 15 00:22:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:11.329237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cf541-ce07-40db-9fa5-d0c9d5dce1f1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:11.432750 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05133df9-2dda-454e-adc9-ee579b357c4c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:11.463031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cf541-ce07-40db-9fa5-d0c9d5dce1f1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:11.465652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:11.479594 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d0ff0-f194-4b37-98e2-7394b3bdfbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:11.480759 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d0ff0-f194-4b37-98e2-7394b3bdfbbf None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.481249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d0ff0-f194-4b37-98e2-7394b3bdfbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.481759 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d0ff0-f194-4b37-98e2-7394b3bdfbbf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.495178 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d0ff0-f194-4b37-98e2-7394b3bdfbbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:11.503300 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad18c7-dea0-4832-bd95-ff685c17ca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:11.503968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad18c7-dea0-4832-bd95-ff685c17ca53 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.504257 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad18c7-dea0-4832-bd95-ff685c17ca53 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.504437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-df0d0ff0-f194-4b37-98e2-7394b3bdfbbf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:11.504437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:11.504437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:11.504437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:11.504437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:11.504437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:11.504437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:11.504437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:11.504437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:11.504437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:11.504437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:11.504437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:11.504437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:11.504437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:11.504437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:11.504437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:11.505482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:11.505482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:11.505482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:11.505482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:11.505482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:11.505482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:11.505482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:11.505482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:11.505482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:11.505482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:11.505482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:11.505482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:11.505482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:11.505482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:11.505482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:11.505482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:11.506328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:11.506328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:11.506328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:11.506328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:11.506328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:11.506328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:11.506328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:11.506328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:11.506328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:11.506328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:11.506328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:11.506328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:11.506992 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad18c7-dea0-4832-bd95-ff685c17ca53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.514032 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 280/554] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:11.515203 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d0ff0-f194-4b37-98e2-7394b3bdfbbf None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:11.520947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:11.575291 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad18c7-dea0-4832-bd95-ff685c17ca53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:11.577625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad18c7-dea0-4832-bd95-ff685c17ca53 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:11.628663 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d0ff0-f194-4b37-98e2-7394b3bdfbbf None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:11.665665 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46c47a-c129-4230-8c57-0690435d4cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:11.666306 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46c47a-c129-4230-8c57-0690435d4cbc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.666593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46c47a-c129-4230-8c57-0690435d4cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.666870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46c47a-c129-4230-8c57-0690435d4cbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.678014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46c47a-c129-4230-8c57-0690435d4cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:11.679092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 275/555] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 00:22:11.680183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad18c7-dea0-4832-bd95-ff685c17ca53 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:11.686718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7b46c47a-c129-4230-8c57-0690435d4cbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:11.686718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:11.686718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:11.686718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:11.686718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:11.686718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:11.686718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:11.686718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:11.686718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:11.686718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:11.686718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:11.686718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:11.686718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:11.686718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:11.686718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:11.686718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:11.687724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:11.687724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:11.687724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:11.687724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:11.687724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:11.687724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:11.687724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:11.687724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:11.687724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:11.687724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:11.687724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:11.687724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:11.687724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:11.687724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:11.687724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:11.687724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:11.688553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:11.688553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:11.688553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:11.688553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:11.688553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:11.688553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:11.688553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:11.688553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:11.688553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:11.688553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:11.688553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:11.688553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:11.688553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 281/556] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:11.689228 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46c47a-c129-4230-8c57-0690435d4cbc None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:11.729537 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:11.745762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:11.785049 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad18c7-dea0-4832-bd95-ff685c17ca53 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:11.806318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46c47a-c129-4230-8c57-0690435d4cbc None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:11.819914 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae065d51-7ff0-4242-a87a-388fe539eb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:11.820776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae065d51-7ff0-4242-a87a-388fe539eb77 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.821182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae065d51-7ff0-4242-a87a-388fe539eb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.821587 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae065d51-7ff0-4242-a87a-388fe539eb77 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.822442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae065d51-7ff0-4242-a87a-388fe539eb77 None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:11.822850 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae065d51-7ff0-4242-a87a-388fe539eb77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:11.824324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae065d51-7ff0-4242-a87a-388fe539eb77 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:11.837263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 276/557] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:11.837263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae065d51-7ff0-4242-a87a-388fe539eb77 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:11.849381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c5880-bdc4-40bb-b6c0-b9f850ee16c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:11.850488 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c5880-bdc4-40bb-b6c0-b9f850ee16c1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.850919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c5880-bdc4-40bb-b6c0-b9f850ee16c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.851399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c5880-bdc4-40bb-b6c0-b9f850ee16c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.863620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c5880-bdc4-40bb-b6c0-b9f850ee16c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:11.865728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c5880-bdc4-40bb-b6c0-b9f850ee16c1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:11.884716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-820c5880-bdc4-40bb-b6c0-b9f850ee16c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:11.884716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:11.884716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:11.884716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:11.884716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:11.884716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:11.884716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:11.884716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:11.884716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:11.884716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:11.884716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:11.884716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:11.884716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:11.884716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:11.884716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:11.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:11.887531 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:11.887531 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:11.887531 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:11.887531 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:11.889550 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 282/558] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:11.890605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c5880-bdc4-40bb-b6c0-b9f850ee16c1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:11.942375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae065d51-7ff0-4242-a87a-388fe539eb77 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:11.951604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:11.978868 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d25256-3747-4fa9-8d84-59448424c203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:11.979467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d25256-3747-4fa9-8d84-59448424c203 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:11.979761 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d25256-3747-4fa9-8d84-59448424c203 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:11.980045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d25256-3747-4fa9-8d84-59448424c203 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:11.980808 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d25256-3747-4fa9-8d84-59448424c203 None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:11.981120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d25256-3747-4fa9-8d84-59448424c203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:11.982555 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d25256-3747-4fa9-8d84-59448424c203 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:11.992433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 277/559] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:11.993380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d25256-3747-4fa9-8d84-59448424c203 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:11.997878 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:12.004889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c5880-bdc4-40bb-b6c0-b9f850ee16c1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:12.041954 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa9781-7db0-4354-a484-f0f42f0b91ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:12.043133 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa9781-7db0-4354-a484-f0f42f0b91ec None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.043601 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa9781-7db0-4354-a484-f0f42f0b91ec None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.044065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa9781-7db0-4354-a484-f0f42f0b91ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.056895 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa9781-7db0-4354-a484-f0f42f0b91ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:12.058795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa9781-7db0-4354-a484-f0f42f0b91ec None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:12.077957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-a9fa9781-7db0-4354-a484-f0f42f0b91ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:12.077957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:12.077957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:12.077957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:12.077957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:12.077957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:12.077957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:12.077957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:12.077957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:12.077957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:12.077957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:12.077957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:12.077957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:12.077957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:12.077957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:12.078946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:12.079875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:12.079875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:12.079875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:12.079875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:12.086705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 283/560] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:12.087892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa9781-7db0-4354-a484-f0f42f0b91ec None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:12.117370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d25256-3747-4fa9-8d84-59448424c203 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:12.152996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72435265-a5b0-4fe3-8060-084c54c5e285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:12.153806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72435265-a5b0-4fe3-8060-084c54c5e285 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.154111 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72435265-a5b0-4fe3-8060-084c54c5e285 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.154364 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72435265-a5b0-4fe3-8060-084c54c5e285 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.155311 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72435265-a5b0-4fe3-8060-084c54c5e285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:12.155622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72435265-a5b0-4fe3-8060-084c54c5e285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:12.157083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72435265-a5b0-4fe3-8060-084c54c5e285 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:12.175613 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 278/561] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:12.176781 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72435265-a5b0-4fe3-8060-084c54c5e285 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:12.201235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa9781-7db0-4354-a484-f0f42f0b91ec None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:12.210065 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:12.237226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ede33-aaf1-4114-92b1-73a4641ed91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:12.238408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ede33-aaf1-4114-92b1-73a4641ed91f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.238937 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ede33-aaf1-4114-92b1-73a4641ed91f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.239438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ede33-aaf1-4114-92b1-73a4641ed91f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.251616 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ede33-aaf1-4114-92b1-73a4641ed91f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:12.253440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ede33-aaf1-4114-92b1-73a4641ed91f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:12.262602 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:12.274741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-a97ede33-aaf1-4114-92b1-73a4641ed91f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:12.274741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:12.274741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:12.274741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:12.274741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:12.274741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:12.274741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:12.274741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:12.274741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:12.274741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:12.274741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:12.274741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:12.274741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:12.274741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:12.274741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:12.275777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:12.276726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:12.276726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:12.276726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:12.276726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:12.279261 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 284/562] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:12.280262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ede33-aaf1-4114-92b1-73a4641ed91f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:12.289482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72435265-a5b0-4fe3-8060-084c54c5e285 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:12.324463 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c554ac-54e6-4ebc-88de-7ef70f2d3450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:12.325143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c554ac-54e6-4ebc-88de-7ef70f2d3450 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.325451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c554ac-54e6-4ebc-88de-7ef70f2d3450 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.325728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c554ac-54e6-4ebc-88de-7ef70f2d3450 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.326457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c554ac-54e6-4ebc-88de-7ef70f2d3450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:12.326777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c554ac-54e6-4ebc-88de-7ef70f2d3450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:12.328233 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c554ac-54e6-4ebc-88de-7ef70f2d3450 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:12.345001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 279/563] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:12.345923 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c554ac-54e6-4ebc-88de-7ef70f2d3450 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:12.395345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ede33-aaf1-4114-92b1-73a4641ed91f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:12.433774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a227ba-3eda-49e8-b8bc-af2f447e7d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:12.435500 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a227ba-3eda-49e8-b8bc-af2f447e7d6f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.435989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a227ba-3eda-49e8-b8bc-af2f447e7d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.436468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a227ba-3eda-49e8-b8bc-af2f447e7d6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.443382 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:12.446154 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a227ba-3eda-49e8-b8bc-af2f447e7d6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:12.447869 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a227ba-3eda-49e8-b8bc-af2f447e7d6f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:12.453531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c554ac-54e6-4ebc-88de-7ef70f2d3450 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:12.463540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d8a227ba-3eda-49e8-b8bc-af2f447e7d6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:12.463540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:12.463540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:12.463540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:12.463540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:12.463540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:12.463540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:12.463540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:12.463540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:12.463540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:12.463540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:12.463540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:12.463540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:12.463540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:12.463540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:12.464551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:12.465657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:12.465657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:12.465657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:12.465657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:12.465657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:12.465657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:12.465657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:12.465657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:12.467811 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 285/564] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:12.468651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a227ba-3eda-49e8-b8bc-af2f447e7d6f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:12.492438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacc5e4-276f-490d-8948-cb6ac8bccd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:12.493135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacc5e4-276f-490d-8948-cb6ac8bccd7a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.493451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacc5e4-276f-490d-8948-cb6ac8bccd7a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.493730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacc5e4-276f-490d-8948-cb6ac8bccd7a None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.494477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacc5e4-276f-490d-8948-cb6ac8bccd7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:12.494790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacc5e4-276f-490d-8948-cb6ac8bccd7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:12.496212 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dacc5e4-276f-490d-8948-cb6ac8bccd7a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:12.509324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 280/565] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:12.510755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21089c3c-d983-4512-a535-1efa987c00f3 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.511040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21089c3c-d983-4512-a535-1efa987c00f3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.511315 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21089c3c-d983-4512-a535-1efa987c00f3 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.512756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 281/566] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:12.513269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21089c3c-d983-4512-a535-1efa987c00f3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:12.546624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:12.589530 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a227ba-3eda-49e8-b8bc-af2f447e7d6f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:12.613958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21089c3c-d983-4512-a535-1efa987c00f3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:12.623706 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54e287-2d8e-4e57-bbcd-951ab5378b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:12.624498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54e287-2d8e-4e57-bbcd-951ab5378b04 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.624786 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54e287-2d8e-4e57-bbcd-951ab5378b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.625057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54e287-2d8e-4e57-bbcd-951ab5378b04 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.632316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54e287-2d8e-4e57-bbcd-951ab5378b04 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:12.633899 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54e287-2d8e-4e57-bbcd-951ab5378b04 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:12.646879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a8bf2-78ec-4bec-8246-3a195c3ab63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:12.647541 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a8bf2-78ec-4bec-8246-3a195c3ab63c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.647820 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a8bf2-78ec-4bec-8246-3a195c3ab63c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.648123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a8bf2-78ec-4bec-8246-3a195c3ab63c None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.648219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ea54e287-2d8e-4e57-bbcd-951ab5378b04 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:22:12.648219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:12.648219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:12.648219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:12.648219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:12.648219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:12.648219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:12.648219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:12.648219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:12.648219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:12.648219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:12.648219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:12.648219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:12.648219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:12.648219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:12.648219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:12.649075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:12.650048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:12.650048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:12.650048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:12.650048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:12.650048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:12.650048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:12.650048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:12.650048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:12.650048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:22:12.650048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:12.650584 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a8bf2-78ec-4bec-8246-3a195c3ab63c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:12.650584 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a8bf2-78ec-4bec-8246-3a195c3ab63c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:12.650719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 286/567] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 15 00:22:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:12.650719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54e287-2d8e-4e57-bbcd-951ab5378b04 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:12.650848 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a8bf2-78ec-4bec-8246-3a195c3ab63c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:12.662457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 282/568] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:12.663720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7731954-6dca-45df-a69e-497c0c3a6f2d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.664070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7731954-6dca-45df-a69e-497c0c3a6f2d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.665589 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7731954-6dca-45df-a69e-497c0c3a6f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.681608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-f7731954-6dca-45df-a69e-497c0c3a6f2d None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:12.682854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f7731954-6dca-45df-a69e-497c0c3a6f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:12.685683 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:12.749220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 283/569] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:12.750474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2bdcc-ed36-49d6-99b5-6d9687e9b4df None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.750761 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2bdcc-ed36-49d6-99b5-6d9687e9b4df None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.751057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2bdcc-ed36-49d6-99b5-6d9687e9b4df None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.752574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 284/570] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:12.753271 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2bdcc-ed36-49d6-99b5-6d9687e9b4df None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:12.760597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54e287-2d8e-4e57-bbcd-951ab5378b04 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:12.783910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:12.797721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b83dc-a62b-4fab-91ff-cc2b4f84c394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:12.798526 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b83dc-a62b-4fab-91ff-cc2b4f84c394 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.798807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b83dc-a62b-4fab-91ff-cc2b4f84c394 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.799079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b83dc-a62b-4fab-91ff-cc2b4f84c394 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.806192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b83dc-a62b-4fab-91ff-cc2b4f84c394 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:12.807669 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b83dc-a62b-4fab-91ff-cc2b4f84c394 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:12.822040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-432b83dc-a62b-4fab-91ff-cc2b4f84c394 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 00:22:12.822040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:12.822040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:12.822040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:12.822040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:12.822040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:12.822040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:12.822040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:12.822040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:12.822040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:12.822040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:12.822040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:12.822040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:12.822040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:12.822040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:12.822040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:12.823044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:12.823989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:12.823989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:12.823989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:12.823989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:12.823989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:12.823989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:12.823989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:12.823989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:12.823989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 00:22:12.823989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:12.823989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 287/571] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:12.823989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b83dc-a62b-4fab-91ff-cc2b4f84c394 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:12.864664 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2bdcc-ed36-49d6-99b5-6d9687e9b4df None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:12.898484 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e6bd1-527e-4643-b071-6db3d737996a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:12.899166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e6bd1-527e-4643-b071-6db3d737996a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.899449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e6bd1-527e-4643-b071-6db3d737996a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.899728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e6bd1-527e-4643-b071-6db3d737996a None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.900571 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e6bd1-527e-4643-b071-6db3d737996a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:12.900880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e6bd1-527e-4643-b071-6db3d737996a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:12.902376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e6bd1-527e-4643-b071-6db3d737996a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:12.910855 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:12.920578 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 285/572] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 15 00:22:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:12.921965 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323caf4-f09b-4e06-82a8-6ba4abb7ca24 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.922160 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b83dc-a62b-4fab-91ff-cc2b4f84c394 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:12.922264 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323caf4-f09b-4e06-82a8-6ba4abb7ca24 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.922513 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323caf4-f09b-4e06-82a8-6ba4abb7ca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.938069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c323caf4-f09b-4e06-82a8-6ba4abb7ca24 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:12.939258 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c323caf4-f09b-4e06-82a8-6ba4abb7ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:12.957237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41225869-12a9-41ec-a090-fea15c2f1f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:12.957923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41225869-12a9-41ec-a090-fea15c2f1f03 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:12.958206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41225869-12a9-41ec-a090-fea15c2f1f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:12.958479 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41225869-12a9-41ec-a090-fea15c2f1f03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:12.959296 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41225869-12a9-41ec-a090-fea15c2f1f03 None admin] RBAC: Adding query filter params (role.id=4afb8bd8c6354dd9b143ef4aaa8284fa, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=ff27c57c1d1b4f4ab1a030995db2e63a) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:12.959606 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41225869-12a9-41ec-a090-fea15c2f1f03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:12.961154 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41225869-12a9-41ec-a090-fea15c2f1f03 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:12.966596 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 288/573] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:12 2022] GET /identity/v3/role_assignments?user.id=ff27c57c1d1b4f4ab1a030995db2e63a&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=4afb8bd8c6354dd9b143ef4aaa8284fa => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:12.967352 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41225869-12a9-41ec-a090-fea15c2f1f03 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.033006 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 286/574] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:13.033006 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323caf4-f09b-4e06-82a8-6ba4abb7ca24 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.033284 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:13.089604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41225869-12a9-41ec-a090-fea15c2f1f03 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.131385 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374668d8-f36b-44bd-a8ac-52cff32cbe28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.132647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374668d8-f36b-44bd-a8ac-52cff32cbe28 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.133209 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374668d8-f36b-44bd-a8ac-52cff32cbe28 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.133722 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374668d8-f36b-44bd-a8ac-52cff32cbe28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.147199 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374668d8-f36b-44bd-a8ac-52cff32cbe28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:13.155420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-374668d8-f36b-44bd-a8ac-52cff32cbe28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:13.155420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:13.155420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:13.155420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:13.155420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:13.155420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:13.155420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:13.155420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:13.155420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:13.155420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:13.155420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:13.155420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:13.155420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:13.155420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:13.155420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:13.155420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:13.156367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:13.156367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:13.156367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:13.156367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:13.156367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:13.156367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:13.156367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:13.156367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:13.156367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:13.156367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:13.156367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:13.156367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:13.156367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:13.156367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:13.156367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:13.156367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:13.157206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:13.157206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:13.157206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:13.157206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:13.157206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:13.157206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:13.157206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:13.157206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:13.157206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:13.157206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:13.157206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:13.157206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:13.158593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323caf4-f09b-4e06-82a8-6ba4abb7ca24 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.161936 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 289/575] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:13.162606 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374668d8-f36b-44bd-a8ac-52cff32cbe28 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.194032 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6256a-a416-4589-858a-12baae60aee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.194827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6256a-a416-4589-858a-12baae60aee4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.195206 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6256a-a416-4589-858a-12baae60aee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.195553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6256a-a416-4589-858a-12baae60aee4 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.196414 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6256a-a416-4589-858a-12baae60aee4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:13.196706 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6256a-a416-4589-858a-12baae60aee4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:13.198178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6256a-a416-4589-858a-12baae60aee4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:13.206798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:13.217498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 287/576] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:13.217498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6256a-a416-4589-858a-12baae60aee4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.274824 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374668d8-f36b-44bd-a8ac-52cff32cbe28 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.277217 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:13.314114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4a7ec-683a-444d-92e0-6ca4c7d29ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.314848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4a7ec-683a-444d-92e0-6ca4c7d29ebd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.315134 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4a7ec-683a-444d-92e0-6ca4c7d29ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.315414 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4a7ec-683a-444d-92e0-6ca4c7d29ebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.326968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6256a-a416-4589-858a-12baae60aee4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.327741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4a7ec-683a-444d-92e0-6ca4c7d29ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:13.331127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4a7ec-683a-444d-92e0-6ca4c7d29ebd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:13.351399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-f4a4a7ec-683a-444d-92e0-6ca4c7d29ebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:13.351399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:13.351399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:13.351399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:13.351399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:13.351399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:13.351399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:13.351399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:13.351399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:13.351399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:13.351399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:13.351399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:13.351399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:13.351399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:13.351399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:13.352513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:13.353450 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:13.353450 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:13.353450 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:13.353450 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:13.353450 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 290/577] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:13.353450 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4a7ec-683a-444d-92e0-6ca4c7d29ebd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.371454 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0b51b-3e04-4a6d-b6c3-baa41395b16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.372588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0b51b-3e04-4a6d-b6c3-baa41395b16b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.372849 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0b51b-3e04-4a6d-b6c3-baa41395b16b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.373130 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e0b51b-3e04-4a6d-b6c3-baa41395b16b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.384739 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e0b51b-3e04-4a6d-b6c3-baa41395b16b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:13.395349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-95e0b51b-3e04-4a6d-b6c3-baa41395b16b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:13.395349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:13.395349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:13.395349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:13.395349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:13.395349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:13.395349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:13.395349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:13.395349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:13.395349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:13.395349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:13.395349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:13.395349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:13.395349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:13.395349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:13.395349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:13.396370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:13.396370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:13.396370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:13.396370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:13.396370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:13.396370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:13.396370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:13.396370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:13.396370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:13.396370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:13.396370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:13.396370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:13.396370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:13.396370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:13.396370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:13.396370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:13.397256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:13.397256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:13.397256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:13.397256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:13.397256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:13.397256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:13.397256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:13.397256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:13.397256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:13.397256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:13.397256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:13.397256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:13.397256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 288/578] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:13.398408 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0b51b-3e04-4a6d-b6c3-baa41395b16b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.450885 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:13.477511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4a7ec-683a-444d-92e0-6ca4c7d29ebd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.511737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e0b51b-3e04-4a6d-b6c3-baa41395b16b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.513645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878e5de-3bc2-4da0-89fb-30e118c43a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.514348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878e5de-3bc2-4da0-89fb-30e118c43a31 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.514608 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878e5de-3bc2-4da0-89fb-30e118c43a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.514879 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878e5de-3bc2-4da0-89fb-30e118c43a31 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.515634 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878e5de-3bc2-4da0-89fb-30e118c43a31 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:13.515940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878e5de-3bc2-4da0-89fb-30e118c43a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:13.517414 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878e5de-3bc2-4da0-89fb-30e118c43a31 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:13.527318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 291/579] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:13.528164 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878e5de-3bc2-4da0-89fb-30e118c43a31 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.549989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:13.563753 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6039c88-78c7-428c-a8a3-ea050bfdb21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.564737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6039c88-78c7-428c-a8a3-ea050bfdb21e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.565264 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6039c88-78c7-428c-a8a3-ea050bfdb21e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.565582 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6039c88-78c7-428c-a8a3-ea050bfdb21e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.579798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6039c88-78c7-428c-a8a3-ea050bfdb21e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:13.581666 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6039c88-78c7-428c-a8a3-ea050bfdb21e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:13.600836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-b6039c88-78c7-428c-a8a3-ea050bfdb21e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:13.600836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:13.600836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:13.600836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:13.600836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:13.600836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:13.600836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:13.600836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:13.600836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:13.600836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:13.600836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:13.600836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:13.600836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:13.600836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:13.600836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:13.601877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:13.602762 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:13.602762 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:13.602762 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:13.602762 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:13.602762 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 289/580] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:13.603535 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6039c88-78c7-428c-a8a3-ea050bfdb21e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.643236 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878e5de-3bc2-4da0-89fb-30e118c43a31 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.682616 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f080e-eaf2-456f-8bb9-7b2ee7ff2b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.683287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f080e-eaf2-456f-8bb9-7b2ee7ff2b4d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.683567 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f080e-eaf2-456f-8bb9-7b2ee7ff2b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.683894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f080e-eaf2-456f-8bb9-7b2ee7ff2b4d None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.684615 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f080e-eaf2-456f-8bb9-7b2ee7ff2b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:13.684968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f080e-eaf2-456f-8bb9-7b2ee7ff2b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:13.686401 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f080e-eaf2-456f-8bb9-7b2ee7ff2b4d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:13.703507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 292/581] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:13.704418 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f080e-eaf2-456f-8bb9-7b2ee7ff2b4d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.708157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:13.713152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6039c88-78c7-428c-a8a3-ea050bfdb21e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.751056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700ef88-a2aa-45d4-b040-a79be4da8319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.751844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700ef88-a2aa-45d4-b040-a79be4da8319 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.752125 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700ef88-a2aa-45d4-b040-a79be4da8319 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.752407 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700ef88-a2aa-45d4-b040-a79be4da8319 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.753161 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700ef88-a2aa-45d4-b040-a79be4da8319 None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:13.753504 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700ef88-a2aa-45d4-b040-a79be4da8319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:13.755125 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700ef88-a2aa-45d4-b040-a79be4da8319 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:13.764877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 290/582] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:13.765506 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700ef88-a2aa-45d4-b040-a79be4da8319 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.789680 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:13.814111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f080e-eaf2-456f-8bb9-7b2ee7ff2b4d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.849879 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab425b-e84f-44bf-93d6-35ee0512feeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.850613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab425b-e84f-44bf-93d6-35ee0512feeb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.850898 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab425b-e84f-44bf-93d6-35ee0512feeb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.851198 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab425b-e84f-44bf-93d6-35ee0512feeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.863062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab425b-e84f-44bf-93d6-35ee0512feeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:13.864518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab425b-e84f-44bf-93d6-35ee0512feeb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:13.877661 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700ef88-a2aa-45d4-b040-a79be4da8319 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:13.883677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-e9ab425b-e84f-44bf-93d6-35ee0512feeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:13.883677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:13.883677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:13.883677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:13.883677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:13.883677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:13.883677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:13.883677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:13.883677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:13.883677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:13.883677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:13.883677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:13.883677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:13.883677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:13.883677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:13.884654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:13.890704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:13.890704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:13.890704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:13.890704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:13.890704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 293/583] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:13.890704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab425b-e84f-44bf-93d6-35ee0512feeb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.922021 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9dfbd-2193-433f-865b-7222866db799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:13.922694 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9dfbd-2193-433f-865b-7222866db799 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:13.922971 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9dfbd-2193-433f-865b-7222866db799 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:13.923247 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9dfbd-2193-433f-865b-7222866db799 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:13.923990 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9dfbd-2193-433f-865b-7222866db799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:13.924298 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9dfbd-2193-433f-865b-7222866db799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:13.925715 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9dfbd-2193-433f-865b-7222866db799 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:13.942548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 291/584] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:13.942548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9dfbd-2193-433f-865b-7222866db799 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:13.962834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:14.007377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab425b-e84f-44bf-93d6-35ee0512feeb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.043369 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:14.051011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65b577-d51c-4058-b184-55e80c21976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.051838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65b577-d51c-4058-b184-55e80c21976d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.051968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9dfbd-2193-433f-865b-7222866db799 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.052151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65b577-d51c-4058-b184-55e80c21976d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.052381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65b577-d51c-4058-b184-55e80c21976d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.060409 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65b577-d51c-4058-b184-55e80c21976d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.061900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65b577-d51c-4058-b184-55e80c21976d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:14.077066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ec65b577-d51c-4058-b184-55e80c21976d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:14.077066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:14.077066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:14.077066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:14.077066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:14.077066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:14.077066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:14.077066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:14.077066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:14.077066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:14.077066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:14.077066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:14.077066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:14.077066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:14.077066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:14.077991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:14.078900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:14.078900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:14.078900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:14.078900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:14.078900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:14.078900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:14.078900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:14.078900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:14.078900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 294/585] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:14.080306 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65b577-d51c-4058-b184-55e80c21976d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:14.101559 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da07a29-fcf1-4d6c-a2e4-b10cd2263f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.102800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da07a29-fcf1-4d6c-a2e4-b10cd2263f41 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.103101 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da07a29-fcf1-4d6c-a2e4-b10cd2263f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.103380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da07a29-fcf1-4d6c-a2e4-b10cd2263f41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.113819 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da07a29-fcf1-4d6c-a2e4-b10cd2263f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.115658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da07a29-fcf1-4d6c-a2e4-b10cd2263f41 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:14.136263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-3da07a29-fcf1-4d6c-a2e4-b10cd2263f41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:14.136263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:14.136263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:14.136263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:14.136263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:14.136263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:14.136263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:14.136263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:14.136263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:14.136263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:14.136263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:14.136263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:14.136263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:14.136263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:14.136263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:14.137216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:14.138160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:14.138160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:14.138160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:14.138160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:14.139231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 292/586] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:14.139476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da07a29-fcf1-4d6c-a2e4-b10cd2263f41 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:14.193358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65b577-d51c-4058-b184-55e80c21976d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.214573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:14.227666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51d8e4-d9a0-4747-93c0-85f1da49119c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.228442 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51d8e4-d9a0-4747-93c0-85f1da49119c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.228750 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51d8e4-d9a0-4747-93c0-85f1da49119c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.229022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51d8e4-d9a0-4747-93c0-85f1da49119c None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.229797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51d8e4-d9a0-4747-93c0-85f1da49119c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:14.230105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51d8e4-d9a0-4747-93c0-85f1da49119c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.231685 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f51d8e4-d9a0-4747-93c0-85f1da49119c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:14.245281 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 295/587] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:14.246165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51d8e4-d9a0-4747-93c0-85f1da49119c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:14.252269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da07a29-fcf1-4d6c-a2e4-b10cd2263f41 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.289252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb58c4-85a4-4799-88a8-d25332f9ac8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.290464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb58c4-85a4-4799-88a8-d25332f9ac8d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.290769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb58c4-85a4-4799-88a8-d25332f9ac8d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.291051 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb58c4-85a4-4799-88a8-d25332f9ac8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.298069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:14.298192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb58c4-85a4-4799-88a8-d25332f9ac8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.299526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb58c4-85a4-4799-88a8-d25332f9ac8d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:14.314066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a1cb58c4-85a4-4799-88a8-d25332f9ac8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:14.314066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:14.314066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:14.314066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:14.314066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:14.314066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:14.314066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:14.314066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:14.314066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:14.314066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:14.314066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:14.314066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:14.314066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:14.314066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:14.314066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:14.314964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:14.315844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:14.315844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:14.315844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:14.315844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:14.315844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:14.315844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:14.315844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:14.315844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:14.315844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 293/588] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:14.316349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb58c4-85a4-4799-88a8-d25332f9ac8d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:14.356430 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51d8e4-d9a0-4747-93c0-85f1da49119c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.393210 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1370e62-c397-41c8-bb2a-c25ba0f8db85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.394298 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370e62-c397-41c8-bb2a-c25ba0f8db85 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.394589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370e62-c397-41c8-bb2a-c25ba0f8db85 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.394867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370e62-c397-41c8-bb2a-c25ba0f8db85 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.396020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1370e62-c397-41c8-bb2a-c25ba0f8db85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:14.396336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1370e62-c397-41c8-bb2a-c25ba0f8db85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.398459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1370e62-c397-41c8-bb2a-c25ba0f8db85 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:14.412111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 296/589] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:14.413069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1370e62-c397-41c8-bb2a-c25ba0f8db85 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:14.423517 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb58c4-85a4-4799-88a8-d25332f9ac8d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.454619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:14.460333 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d5c7c-7b9b-4cda-a2c8-3a59ca747e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.461158 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d5c7c-7b9b-4cda-a2c8-3a59ca747e1f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.461397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d5c7c-7b9b-4cda-a2c8-3a59ca747e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.461677 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d5c7c-7b9b-4cda-a2c8-3a59ca747e1f None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.462423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d5c7c-7b9b-4cda-a2c8-3a59ca747e1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:14.462741 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d5c7c-7b9b-4cda-a2c8-3a59ca747e1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.464131 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d5c7c-7b9b-4cda-a2c8-3a59ca747e1f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:14.476275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 294/590] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:14.477015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d5c7c-7b9b-4cda-a2c8-3a59ca747e1f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:14.524998 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1370e62-c397-41c8-bb2a-c25ba0f8db85 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.535596 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:14.564846 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75d2be-4a75-4649-96db-3b70e3ef0b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.565707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75d2be-4a75-4649-96db-3b70e3ef0b9b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.565972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75d2be-4a75-4649-96db-3b70e3ef0b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.566248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75d2be-4a75-4649-96db-3b70e3ef0b9b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.575382 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75d2be-4a75-4649-96db-3b70e3ef0b9b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.577477 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75d2be-4a75-4649-96db-3b70e3ef0b9b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:14.587445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d5c7c-7b9b-4cda-a2c8-3a59ca747e1f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.597220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-fb75d2be-4a75-4649-96db-3b70e3ef0b9b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 00:22:14.597220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:14.597220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:14.597220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:14.597220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:14.597220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:14.597220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:14.597220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:14.597220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:14.597220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:14.597220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:14.597220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:14.597220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:14.597220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:14.597220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:14.597220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:14.598417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:14.599575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:14.599575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:14.599575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:14.599575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:14.599575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:14.599575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:14.599575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:14.599575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:14.599575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 00:22:14.599575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:14.603008 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 297/591] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:14.603816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75d2be-4a75-4649-96db-3b70e3ef0b9b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:14.629845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95607ae-27da-483c-ac69-2ef2ce6d7a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.630445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95607ae-27da-483c-ac69-2ef2ce6d7a1d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.630726 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95607ae-27da-483c-ac69-2ef2ce6d7a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.630996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95607ae-27da-483c-ac69-2ef2ce6d7a1d None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.631794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95607ae-27da-483c-ac69-2ef2ce6d7a1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:14.632193 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95607ae-27da-483c-ac69-2ef2ce6d7a1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.633723 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95607ae-27da-483c-ac69-2ef2ce6d7a1d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:14.645726 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 295/592] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:14.646567 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95607ae-27da-483c-ac69-2ef2ce6d7a1d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:14.708242 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:14.716111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75d2be-4a75-4649-96db-3b70e3ef0b9b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.754173 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50ccbb-00d5-4614-b86f-1d1f7e5a8007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.755078 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50ccbb-00d5-4614-b86f-1d1f7e5a8007 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.755447 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50ccbb-00d5-4614-b86f-1d1f7e5a8007 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.755622 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50ccbb-00d5-4614-b86f-1d1f7e5a8007 None admin] PATH_INFO: `/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/6d0ae1707c7041a0989889dbefeaf267/roles/4afb8bd8c6354dd9b143ef4aaa8284fa` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.757736 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95607ae-27da-483c-ac69-2ef2ce6d7a1d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.771061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50ccbb-00d5-4614-b86f-1d1f7e5a8007 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc0f2a3e075946f1ad06146dfa252aa6, user_id=6d0ae1707c7041a0989889dbefeaf267, role_id=4afb8bd8c6354dd9b143ef4aaa8284fa)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.772697 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50ccbb-00d5-4614-b86f-1d1f7e5a8007 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:14.792785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 298/593] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:14 2022] PUT /identity/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/6d0ae1707c7041a0989889dbefeaf267/roles/4afb8bd8c6354dd9b143ef4aaa8284fa => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:14.792785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50ccbb-00d5-4614-b86f-1d1f7e5a8007 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:14.802241 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfeab53-3606-4350-b851-b1e158ef9db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.803373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfeab53-3606-4350-b851-b1e158ef9db5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.803834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfeab53-3606-4350-b851-b1e158ef9db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.804284 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfeab53-3606-4350-b851-b1e158ef9db5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.813731 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfeab53-3606-4350-b851-b1e158ef9db5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.815720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfeab53-3606-4350-b851-b1e158ef9db5 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:14.824155 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:14.835286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-7dfeab53-3606-4350-b851-b1e158ef9db5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 00:22:14.835286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:14.835286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:14.835286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:14.835286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:14.835286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:14.835286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:14.835286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:14.835286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:14.835286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:14.835286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:14.835286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:14.835286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:14.835286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:14.835286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:14.835286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:14.836547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:14.837737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:14.837737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:14.837737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:14.837737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:14.837737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:14.837737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:14.837737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:14.837737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:14.837737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 00:22:14.837737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:14.845150 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 296/594] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:14.846309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfeab53-3606-4350-b851-b1e158ef9db5 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:14.936268 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50ccbb-00d5-4614-b86f-1d1f7e5a8007 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.967103 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfeab53-3606-4350-b851-b1e158ef9db5 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:14.982426 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:14.985654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df79c14-5d6b-4499-a4b5-1ca61e1c04b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:14.986519 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df79c14-5d6b-4499-a4b5-1ca61e1c04b7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:14.986903 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df79c14-5d6b-4499-a4b5-1ca61e1c04b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:14.987329 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df79c14-5d6b-4499-a4b5-1ca61e1c04b7 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:14.993405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df79c14-5d6b-4499-a4b5-1ca61e1c04b7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:14.993405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df79c14-5d6b-4499-a4b5-1ca61e1c04b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:14.993405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df79c14-5d6b-4499-a4b5-1ca61e1c04b7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:15.014923 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a3f6c-fb73-46d4-b9a8-b9fb5dcf117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:15.015851 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a3f6c-fb73-46d4-b9a8-b9fb5dcf117d None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.016138 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a3f6c-fb73-46d4-b9a8-b9fb5dcf117d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.016419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a3f6c-fb73-46d4-b9a8-b9fb5dcf117d None admin] PATH_INFO: `/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/a239897b9a0644ef9d2e0e2e333232fa/roles/4afb8bd8c6354dd9b143ef4aaa8284fa` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.016811 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 299/595] 10.222.0.36 () {56 vars in 1139 bytes} [Wed Jun 15 00:22:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:15.018024 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df79c14-5d6b-4499-a4b5-1ca61e1c04b7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:15.036872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a3f6c-fb73-46d4-b9a8-b9fb5dcf117d None admin] RBAC: Authorizing `identity:create_grant(project_id=fc0f2a3e075946f1ad06146dfa252aa6, user_id=a239897b9a0644ef9d2e0e2e333232fa, role_id=4afb8bd8c6354dd9b143ef4aaa8284fa)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:15.039263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a3f6c-fb73-46d4-b9a8-b9fb5dcf117d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:15.061179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 297/596] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:14 2022] PUT /identity/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/a239897b9a0644ef9d2e0e2e333232fa/roles/4afb8bd8c6354dd9b143ef4aaa8284fa => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:15.061915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a3f6c-fb73-46d4-b9a8-b9fb5dcf117d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:15.169301 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df79c14-5d6b-4499-a4b5-1ca61e1c04b7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:15.173737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:15.212615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a3f6c-fb73-46d4-b9a8-b9fb5dcf117d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:15.217999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d08a9a-f5bd-4c1c-a5de-088950302095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:15.218696 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d08a9a-f5bd-4c1c-a5de-088950302095 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.218980 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d08a9a-f5bd-4c1c-a5de-088950302095 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.223715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d08a9a-f5bd-4c1c-a5de-088950302095 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.223715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d08a9a-f5bd-4c1c-a5de-088950302095 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:15.223715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d08a9a-f5bd-4c1c-a5de-088950302095 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:15.223715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d08a9a-f5bd-4c1c-a5de-088950302095 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:15.246526 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 300/597] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Jun 15 00:22:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:15.248263 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2190d1-d41c-4570-91e9-d7ca6b827d79 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.248553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2190d1-d41c-4570-91e9-d7ca6b827d79 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.248833 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2190d1-d41c-4570-91e9-d7ca6b827d79 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.255144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 301/598] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:15.256177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2190d1-d41c-4570-91e9-d7ca6b827d79 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:15.269619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3decad1-a5ce-44ce-90e4-17dd20f17e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:15.270465 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3decad1-a5ce-44ce-90e4-17dd20f17e52 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.270781 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3decad1-a5ce-44ce-90e4-17dd20f17e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.271066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3decad1-a5ce-44ce-90e4-17dd20f17e52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.284482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3decad1-a5ce-44ce-90e4-17dd20f17e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:15.286057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3decad1-a5ce-44ce-90e4-17dd20f17e52 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:15.306969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-d3decad1-a5ce-44ce-90e4-17dd20f17e52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:15.306969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:15.306969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:15.306969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:15.306969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:15.306969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:15.306969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:15.306969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:15.306969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:15.306969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:15.306969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:15.306969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:15.306969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:15.306969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:15.306969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:15.307970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:15.309548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:15.309548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:15.309548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:15.309548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:15.309548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 298/599] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:15.309548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70de90-daac-4ee7-acaa-7224cc53b272 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.309997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70de90-daac-4ee7-acaa-7224cc53b272 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.309997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70de90-daac-4ee7-acaa-7224cc53b272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.331713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4d70de90-daac-4ee7-acaa-7224cc53b272 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:15.334097 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4d70de90-daac-4ee7-acaa-7224cc53b272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:15.347501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:15.385387 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2190d1-d41c-4570-91e9-d7ca6b827d79 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:15.417897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 299/600] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:15.421455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70de90-daac-4ee7-acaa-7224cc53b272 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:15.444151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc69611-7e73-460d-87c0-d34bd4405f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:15.445038 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc69611-7e73-460d-87c0-d34bd4405f3a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.445322 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc69611-7e73-460d-87c0-d34bd4405f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.445624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc69611-7e73-460d-87c0-d34bd4405f3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.448955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:15.458414 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc69611-7e73-460d-87c0-d34bd4405f3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:15.459878 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc69611-7e73-460d-87c0-d34bd4405f3a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:15.479287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-cbc69611-7e73-460d-87c0-d34bd4405f3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:15.479287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:15.479287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:15.479287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:15.479287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:15.479287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:15.479287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:15.479287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:15.479287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:15.479287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:15.479287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:15.479287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:15.479287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:15.479287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:15.479287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:15.480243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:15.481145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:15.481145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:15.481145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:15.481145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:15.481145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 302/601] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:15.481928 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc69611-7e73-460d-87c0-d34bd4405f3a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:15.580417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70de90-daac-4ee7-acaa-7224cc53b272 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:15.611882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc69611-7e73-460d-87c0-d34bd4405f3a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:15.617453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843a5d8-3324-429c-9b41-64875a39770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:15.618253 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843a5d8-3324-429c-9b41-64875a39770a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.618642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843a5d8-3324-429c-9b41-64875a39770a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.619053 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843a5d8-3324-429c-9b41-64875a39770a None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.619894 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843a5d8-3324-429c-9b41-64875a39770a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:15.620308 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843a5d8-3324-429c-9b41-64875a39770a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:15.621835 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6843a5d8-3324-429c-9b41-64875a39770a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:15.634367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 300/602] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:15.635345 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843a5d8-3324-429c-9b41-64875a39770a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:15.640377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:15.658640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e65358-15c8-4f62-8dd6-4fb2364de940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:15.659723 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e65358-15c8-4f62-8dd6-4fb2364de940 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.660570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e65358-15c8-4f62-8dd6-4fb2364de940 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.661014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e65358-15c8-4f62-8dd6-4fb2364de940 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.675186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e65358-15c8-4f62-8dd6-4fb2364de940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:15.684563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b6e65358-15c8-4f62-8dd6-4fb2364de940 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:15.684563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:15.684563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:15.684563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:15.684563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:15.684563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:15.684563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:15.684563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:15.684563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:15.684563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:15.684563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:15.684563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:15.684563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:15.684563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:15.684563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:15.684563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:15.685766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:15.685766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:15.685766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:15.685766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:15.685766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:15.685766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:15.685766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:15.685766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:15.685766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:15.685766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:15.685766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:15.685766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:15.685766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:15.685766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:15.685766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:15.685766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:15.686809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:15.686809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:15.686809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:15.686809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:15.686809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:15.686809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:15.686809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:15.686809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:15.686809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:15.686809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:15.686809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:15.686809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:15.693656 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 303/603] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:15.695263 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e65358-15c8-4f62-8dd6-4fb2364de940 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:15.756251 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6843a5d8-3324-429c-9b41-64875a39770a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:15.757808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:15.797927 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9f47c-823c-46dd-af45-91d448596c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:15.798986 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9f47c-823c-46dd-af45-91d448596c1b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.799490 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9f47c-823c-46dd-af45-91d448596c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.799990 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9f47c-823c-46dd-af45-91d448596c1b None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.800916 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9f47c-823c-46dd-af45-91d448596c1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:15.801442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9f47c-823c-46dd-af45-91d448596c1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:15.803014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9f47c-823c-46dd-af45-91d448596c1b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:15.808597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e65358-15c8-4f62-8dd6-4fb2364de940 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:15.815826 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 301/604] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:15.816950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9f47c-823c-46dd-af45-91d448596c1b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:15.845215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eca160-25f3-4241-839e-574fe804805d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:15.846038 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eca160-25f3-4241-839e-574fe804805d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.846324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eca160-25f3-4241-839e-574fe804805d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.846600 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eca160-25f3-4241-839e-574fe804805d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.854450 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eca160-25f3-4241-839e-574fe804805d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:15.855570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eca160-25f3-4241-839e-574fe804805d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:15.871838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-26eca160-25f3-4241-839e-574fe804805d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:15.871838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:15.871838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:15.871838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:15.871838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:15.871838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:15.871838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:15.871838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:15.871838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:15.871838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:15.871838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:15.871838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:15.871838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:15.871838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:15.871838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:15.872790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:15.873698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:15.873698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:15.873698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:15.873698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:15.873698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:15.873698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:15.873698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:15.873698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:15.873698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 304/605] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:15.874190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eca160-25f3-4241-839e-574fe804805d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:15.887359 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:15.930893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9f47c-823c-46dd-af45-91d448596c1b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:15.972504 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f3cc9-01fe-4fb8-9388-05c8ac2f5b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:15.973675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f3cc9-01fe-4fb8-9388-05c8ac2f5b5e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:15.974161 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f3cc9-01fe-4fb8-9388-05c8ac2f5b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:15.974662 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f3cc9-01fe-4fb8-9388-05c8ac2f5b5e None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:15.975798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f3cc9-01fe-4fb8-9388-05c8ac2f5b5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:15.976416 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f3cc9-01fe-4fb8-9388-05c8ac2f5b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:15.978027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f3cc9-01fe-4fb8-9388-05c8ac2f5b5e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:15.978670 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eca160-25f3-4241-839e-574fe804805d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:15.992806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 302/606] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:15.993672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:15.995352 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f3cc9-01fe-4fb8-9388-05c8ac2f5b5e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.014990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e8c9f-3c1b-4244-88fb-029cc1e76513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.015727 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e8c9f-3c1b-4244-88fb-029cc1e76513 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.016014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e8c9f-3c1b-4244-88fb-029cc1e76513 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.016290 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e8c9f-3c1b-4244-88fb-029cc1e76513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.023371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e8c9f-3c1b-4244-88fb-029cc1e76513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:16.024833 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e8c9f-3c1b-4244-88fb-029cc1e76513 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:16.038870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-729e8c9f-3c1b-4244-88fb-029cc1e76513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:16.038870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:16.038870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:16.038870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:16.038870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:16.038870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:16.038870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:16.038870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:16.038870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:16.038870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:16.038870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:16.038870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:16.038870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:16.038870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:16.038870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:16.039794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:16.040672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:16.040672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:16.040672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:16.040672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:16.040672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:16.040672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:16.040672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:16.040672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:16.040672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 305/607] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:16.041742 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e8c9f-3c1b-4244-88fb-029cc1e76513 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.112685 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f3cc9-01fe-4fb8-9388-05c8ac2f5b5e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:16.140968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:16.149190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e8c9f-3c1b-4244-88fb-029cc1e76513 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:16.151341 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e950327-46f4-421b-add8-d287b6bb0c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.152459 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e950327-46f4-421b-add8-d287b6bb0c43 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.152995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e950327-46f4-421b-add8-d287b6bb0c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.153495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e950327-46f4-421b-add8-d287b6bb0c43 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.154535 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e950327-46f4-421b-add8-d287b6bb0c43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:16.155040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e950327-46f4-421b-add8-d287b6bb0c43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:16.156688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e950327-46f4-421b-add8-d287b6bb0c43 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:16.170923 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 303/608] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:16.172056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e950327-46f4-421b-add8-d287b6bb0c43 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.185795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951d3fd-f6e1-4988-86b2-857dcd11c4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.186611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951d3fd-f6e1-4988-86b2-857dcd11c4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.186901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951d3fd-f6e1-4988-86b2-857dcd11c4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.187236 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951d3fd-f6e1-4988-86b2-857dcd11c4c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.200648 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951d3fd-f6e1-4988-86b2-857dcd11c4c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:16.202151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951d3fd-f6e1-4988-86b2-857dcd11c4c5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:16.220850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7951d3fd-f6e1-4988-86b2-857dcd11c4c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:16.220850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:16.220850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:16.220850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:16.220850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:16.220850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:16.220850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:16.220850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:16.220850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:16.220850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:16.220850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:16.220850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:16.220850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:16.220850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:16.220850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:16.221924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:16.222888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:16.222888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:16.222888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:16.222888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:16.227653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 306/609] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:16.228387 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951d3fd-f6e1-4988-86b2-857dcd11c4c5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.255601 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:16.296024 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e950327-46f4-421b-add8-d287b6bb0c43 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:16.333044 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e49ac2-0902-428a-887c-ed7025d63f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.334279 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e49ac2-0902-428a-887c-ed7025d63f55 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.334776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e49ac2-0902-428a-887c-ed7025d63f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.335360 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e49ac2-0902-428a-887c-ed7025d63f55 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.336488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e49ac2-0902-428a-887c-ed7025d63f55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:16.337026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e49ac2-0902-428a-887c-ed7025d63f55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:16.338897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e49ac2-0902-428a-887c-ed7025d63f55 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:16.345083 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951d3fd-f6e1-4988-86b2-857dcd11c4c5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:16.352486 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 304/610] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:16.353643 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e49ac2-0902-428a-887c-ed7025d63f55 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.382005 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e008507-a0df-4c5a-8f63-41a130d55535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.383109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e008507-a0df-4c5a-8f63-41a130d55535 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.383395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e008507-a0df-4c5a-8f63-41a130d55535 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.383673 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e008507-a0df-4c5a-8f63-41a130d55535 None admin] PATH_INFO: `/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/46c398ec4dcc438895f054f616fc9e41/roles/4afb8bd8c6354dd9b143ef4aaa8284fa` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.399723 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e008507-a0df-4c5a-8f63-41a130d55535 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc0f2a3e075946f1ad06146dfa252aa6, user_id=46c398ec4dcc438895f054f616fc9e41, role_id=4afb8bd8c6354dd9b143ef4aaa8284fa)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:16.401312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e008507-a0df-4c5a-8f63-41a130d55535 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:16.406656 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:16.420051 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 307/611] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:16 2022] PUT /identity/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/46c398ec4dcc438895f054f616fc9e41/roles/4afb8bd8c6354dd9b143ef4aaa8284fa => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:16.421127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e008507-a0df-4c5a-8f63-41a130d55535 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.469124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e49ac2-0902-428a-887c-ed7025d63f55 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:16.505314 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:16.505850 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83deb3e7-0890-4eb4-a93d-7e9cd7fe6051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.506636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83deb3e7-0890-4eb4-a93d-7e9cd7fe6051 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.507028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83deb3e7-0890-4eb4-a93d-7e9cd7fe6051 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.507524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83deb3e7-0890-4eb4-a93d-7e9cd7fe6051 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.508974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83deb3e7-0890-4eb4-a93d-7e9cd7fe6051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:16.508974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83deb3e7-0890-4eb4-a93d-7e9cd7fe6051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:16.510554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83deb3e7-0890-4eb4-a93d-7e9cd7fe6051 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:16.524478 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 305/612] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:16.531480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83deb3e7-0890-4eb4-a93d-7e9cd7fe6051 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.551413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e008507-a0df-4c5a-8f63-41a130d55535 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:16.596993 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120741a-410b-4b2a-9e2e-de72c5ea619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.598270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120741a-410b-4b2a-9e2e-de72c5ea619f None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.598929 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120741a-410b-4b2a-9e2e-de72c5ea619f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.600081 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120741a-410b-4b2a-9e2e-de72c5ea619f None admin] PATH_INFO: `/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/d41065b495234fd98552222fc32cc53e/roles/4afb8bd8c6354dd9b143ef4aaa8284fa` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.633558 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120741a-410b-4b2a-9e2e-de72c5ea619f None admin] RBAC: Authorizing `identity:create_grant(project_id=fc0f2a3e075946f1ad06146dfa252aa6, user_id=d41065b495234fd98552222fc32cc53e, role_id=4afb8bd8c6354dd9b143ef4aaa8284fa)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:16.639437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120741a-410b-4b2a-9e2e-de72c5ea619f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:16.657065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 308/613] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:16 2022] PUT /identity/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/d41065b495234fd98552222fc32cc53e/roles/4afb8bd8c6354dd9b143ef4aaa8284fa => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:16.698069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83deb3e7-0890-4eb4-a93d-7e9cd7fe6051 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:16.706854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:16.744577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2722a8-c1b6-49fe-a14d-4a84c6e8f2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.745669 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2722a8-c1b6-49fe-a14d-4a84c6e8f2ca None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.746052 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2722a8-c1b6-49fe-a14d-4a84c6e8f2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.746446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2722a8-c1b6-49fe-a14d-4a84c6e8f2ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.758261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2722a8-c1b6-49fe-a14d-4a84c6e8f2ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:16.759907 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2722a8-c1b6-49fe-a14d-4a84c6e8f2ca None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:16.781998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-8d2722a8-c1b6-49fe-a14d-4a84c6e8f2ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:22:16.781998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:16.781998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:16.781998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:16.781998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:16.781998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:16.781998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:16.781998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:16.781998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:16.781998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:16.781998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:16.781998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:16.781998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:16.781998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:16.781998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:16.781998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:16.783248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:16.784442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:16.784442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:16.784442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:16.784442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:16.784442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:16.784442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:16.784442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:16.784442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:16.784442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:22:16.784442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:16.786546 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 306/614] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:16.792369 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120741a-410b-4b2a-9e2e-de72c5ea619f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:16.919102 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120741a-410b-4b2a-9e2e-de72c5ea619f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:16.940431 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:16.959946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccaebc-756c-4543-93ab-1d3e589c153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:16.960783 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccaebc-756c-4543-93ab-1d3e589c153b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:16.961079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccaebc-756c-4543-93ab-1d3e589c153b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:16.961617 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccaebc-756c-4543-93ab-1d3e589c153b None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:16.962677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccaebc-756c-4543-93ab-1d3e589c153b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:16.963269 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccaebc-756c-4543-93ab-1d3e589c153b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:16.964775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccaebc-756c-4543-93ab-1d3e589c153b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:16.983327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 309/615] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Jun 15 00:22:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:16.988823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2722a8-c1b6-49fe-a14d-4a84c6e8f2ca None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:17.114355 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14433f5e-e0c4-42f5-86cf-2c487aee45f6 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.114814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14433f5e-e0c4-42f5-86cf-2c487aee45f6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.115552 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14433f5e-e0c4-42f5-86cf-2c487aee45f6 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.117094 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 310/616] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:17.122761 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce85e86-ece9-45ae-a6ed-9387476f952f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.123152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce85e86-ece9-45ae-a6ed-9387476f952f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.123527 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce85e86-ece9-45ae-a6ed-9387476f952f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.154437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8ce85e86-ece9-45ae-a6ed-9387476f952f None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:17.155641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8ce85e86-ece9-45ae-a6ed-9387476f952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:17.179625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2722a8-c1b6-49fe-a14d-4a84c6e8f2ca None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:17.247219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11db60-b259-4404-8253-552acd41fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:17.248045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11db60-b259-4404-8253-552acd41fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.248329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11db60-b259-4404-8253-552acd41fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.248606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11db60-b259-4404-8253-552acd41fdb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.268310 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11db60-b259-4404-8253-552acd41fdb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:17.270676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11db60-b259-4404-8253-552acd41fdb7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:17.294358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 311/617] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:17.302524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-2f11db60-b259-4404-8253-552acd41fdb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:17.302524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:17.302524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:17.302524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:17.302524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:17.302524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:17.302524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:17.302524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:17.302524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:17.302524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:17.302524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:17.302524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:17.302524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:17.302524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:17.302524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:17.304544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:17.306658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:17.306658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:17.306658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:17.306658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:17.306658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 307/618] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:17.313189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce85e86-ece9-45ae-a6ed-9387476f952f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:17.355181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11db60-b259-4404-8253-552acd41fdb7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:17.395588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:17.464531 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce85e86-ece9-45ae-a6ed-9387476f952f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:17.474032 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:17.500571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbcf0f-226d-4e98-a898-36cd1021f759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:17.501187 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11db60-b259-4404-8253-552acd41fdb7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:17.501309 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbcf0f-226d-4e98-a898-36cd1021f759 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.501637 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbcf0f-226d-4e98-a898-36cd1021f759 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.501916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbcf0f-226d-4e98-a898-36cd1021f759 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.502645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbcf0f-226d-4e98-a898-36cd1021f759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:17.502955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbcf0f-226d-4e98-a898-36cd1021f759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:17.504353 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbcf0f-226d-4e98-a898-36cd1021f759 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:17.520377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 312/619] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:17.520377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501fb2f-60e2-4372-b0ed-dcd035cf6789 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.520377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501fb2f-60e2-4372-b0ed-dcd035cf6789 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.520377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501fb2f-60e2-4372-b0ed-dcd035cf6789 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.523591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 313/620] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:17.524335 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501fb2f-60e2-4372-b0ed-dcd035cf6789 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:17.544809 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b42d44-0f7a-47a3-929c-603e6fd080d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:17.545980 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b42d44-0f7a-47a3-929c-603e6fd080d8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.546461 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b42d44-0f7a-47a3-929c-603e6fd080d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.546926 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b42d44-0f7a-47a3-929c-603e6fd080d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.558029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b42d44-0f7a-47a3-929c-603e6fd080d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:17.568322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-55b42d44-0f7a-47a3-929c-603e6fd080d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:17.568322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:17.568322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:17.568322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:17.568322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:17.568322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:17.568322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:17.568322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:17.568322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:17.568322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:17.568322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:17.568322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:17.568322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:17.568322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:17.568322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:17.568322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:17.569305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:17.569305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:17.569305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:17.569305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:17.569305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:17.569305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:17.569305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:17.569305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:17.569305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:17.569305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:17.569305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:17.569305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:17.569305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:17.569305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:17.569305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:17.569305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:17.570250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:17.570250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:17.570250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:17.570250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:17.570250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:17.570250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:17.570250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:17.570250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:17.570250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:17.570250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:17.570250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:17.570250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:17.577433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 308/621] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:17.578952 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f45b5-e041-4104-8797-25d7527c76c6 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.579398 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f45b5-e041-4104-8797-25d7527c76c6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.579836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f45b5-e041-4104-8797-25d7527c76c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.597462 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d04f45b5-e041-4104-8797-25d7527c76c6 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:17.598950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d04f45b5-e041-4104-8797-25d7527c76c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:17.631827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501fb2f-60e2-4372-b0ed-dcd035cf6789 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:17.666405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a052c-a6ec-4066-9ab0-6a7fdf37d411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:17.667331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a052c-a6ec-4066-9ab0-6a7fdf37d411 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.667744 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a052c-a6ec-4066-9ab0-6a7fdf37d411 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.668120 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a052c-a6ec-4066-9ab0-6a7fdf37d411 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.673482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 309/622] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:17.674636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f45b5-e041-4104-8797-25d7527c76c6 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:17.684312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a052c-a6ec-4066-9ab0-6a7fdf37d411 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:17.685942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a052c-a6ec-4066-9ab0-6a7fdf37d411 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:17.686760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:17.709766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-497a052c-a6ec-4066-9ab0-6a7fdf37d411 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:17.709766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:17.709766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:17.709766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:17.709766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:17.709766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:17.709766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:17.709766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:17.709766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:17.709766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:17.709766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:17.709766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:17.709766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:17.709766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:17.709766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:17.710944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:17.711854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:17.711854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:17.711854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:17.711854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:17.711854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:17.711854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:17.711854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:17.711854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:17.717043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 314/623] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:17.718065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a052c-a6ec-4066-9ab0-6a7fdf37d411 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:17.752103 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:17.793837 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f45b5-e041-4104-8797-25d7527c76c6 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:17.829561 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b056c4e-93ee-456f-b1a0-847d2f246842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:17.830255 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b056c4e-93ee-456f-b1a0-847d2f246842 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.830545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b056c4e-93ee-456f-b1a0-847d2f246842 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.830827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b056c4e-93ee-456f-b1a0-847d2f246842 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.831287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a052c-a6ec-4066-9ab0-6a7fdf37d411 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:17.831588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b056c4e-93ee-456f-b1a0-847d2f246842 None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:17.831899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b056c4e-93ee-456f-b1a0-847d2f246842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:17.833586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b056c4e-93ee-456f-b1a0-847d2f246842 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:17.842582 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 310/624] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:17.843417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b056c4e-93ee-456f-b1a0-847d2f246842 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:17.869535 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6c929-3f1a-4561-9e7d-b1c6bc18c2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:17.870717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6c929-3f1a-4561-9e7d-b1c6bc18c2ae None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.871232 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6c929-3f1a-4561-9e7d-b1c6bc18c2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.871714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6c929-3f1a-4561-9e7d-b1c6bc18c2ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.882808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6c929-3f1a-4561-9e7d-b1c6bc18c2ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:17.891138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b6e6c929-3f1a-4561-9e7d-b1c6bc18c2ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:17.891138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:17.891138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:17.891138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:17.891138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:17.891138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:17.891138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:17.891138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:17.891138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:17.891138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:17.891138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:17.891138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:17.891138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:17.891138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:17.891138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:17.891138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:17.892088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:17.892088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:17.892088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:17.892088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:17.892088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:17.892088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:17.892088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:17.892088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:17.892088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:17.892088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:17.892088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:17.892088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:17.892088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:17.892088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:17.892088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:17.892088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:17.892947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:17.892947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:17.892947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:17.892947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:17.892947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:17.892947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:17.892947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:17.892947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:17.892947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:17.892947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:17.892947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:17.892947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:17.900200 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 315/625] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:17.901264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6c929-3f1a-4561-9e7d-b1c6bc18c2ae None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:17.922129 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:17.955969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b056c4e-93ee-456f-b1a0-847d2f246842 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:17.991558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d3871-b006-4bbe-a03a-df6577b4b128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:17.992195 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d3871-b006-4bbe-a03a-df6577b4b128 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:17.992485 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d3871-b006-4bbe-a03a-df6577b4b128 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:17.992769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d3871-b006-4bbe-a03a-df6577b4b128 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:17.993595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d3871-b006-4bbe-a03a-df6577b4b128 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:17.993916 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d3871-b006-4bbe-a03a-df6577b4b128 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:17.994625 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:17.995389 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d3871-b006-4bbe-a03a-df6577b4b128 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:18.008784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6c929-3f1a-4561-9e7d-b1c6bc18c2ae None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:18.014202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 311/626] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:18.015227 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d3871-b006-4bbe-a03a-df6577b4b128 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:18.051073 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5985d-e83e-4553-8626-cce6c4fc741d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:18.052263 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5985d-e83e-4553-8626-cce6c4fc741d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:18.052776 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5985d-e83e-4553-8626-cce6c4fc741d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:18.053263 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5985d-e83e-4553-8626-cce6c4fc741d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:18.065196 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5985d-e83e-4553-8626-cce6c4fc741d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:18.066994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5985d-e83e-4553-8626-cce6c4fc741d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:18.085939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-fbf5985d-e83e-4553-8626-cce6c4fc741d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:18.085939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:18.085939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:18.085939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:18.085939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:18.085939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:18.085939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:18.085939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:18.085939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:18.085939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:18.085939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:18.085939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:18.085939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:18.085939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:18.085939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:18.087043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:18.088062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:18.088062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:18.088062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:18.088062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:18.089949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 316/627] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:18.090840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5985d-e83e-4553-8626-cce6c4fc741d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:18.134322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d3871-b006-4bbe-a03a-df6577b4b128 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:18.171494 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:18.179957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16305030-a172-4ba6-b396-52fd0e0014bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:18.180818 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16305030-a172-4ba6-b396-52fd0e0014bc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:18.181247 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16305030-a172-4ba6-b396-52fd0e0014bc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:18.181916 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16305030-a172-4ba6-b396-52fd0e0014bc None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:18.183672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16305030-a172-4ba6-b396-52fd0e0014bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:18.184195 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16305030-a172-4ba6-b396-52fd0e0014bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:18.186282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16305030-a172-4ba6-b396-52fd0e0014bc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:18.196771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 312/628] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:18.198062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16305030-a172-4ba6-b396-52fd0e0014bc None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:18.226160 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5985d-e83e-4553-8626-cce6c4fc741d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:18.270852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ce735-563e-485e-a444-f7d072b27d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:18.272184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ce735-563e-485e-a444-f7d072b27d4b None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:18.272590 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ce735-563e-485e-a444-f7d072b27d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:18.273062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ce735-563e-485e-a444-f7d072b27d4b None admin] PATH_INFO: `/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/ff27c57c1d1b4f4ab1a030995db2e63a/roles/4afb8bd8c6354dd9b143ef4aaa8284fa` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:18.288124 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:18.296636 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ce735-563e-485e-a444-f7d072b27d4b None admin] RBAC: Authorizing `identity:create_grant(project_id=fc0f2a3e075946f1ad06146dfa252aa6, user_id=ff27c57c1d1b4f4ab1a030995db2e63a, role_id=4afb8bd8c6354dd9b143ef4aaa8284fa)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:18.299103 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ce735-563e-485e-a444-f7d072b27d4b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:18.316955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 317/629] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:18 2022] PUT /identity/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/ff27c57c1d1b4f4ab1a030995db2e63a/roles/4afb8bd8c6354dd9b143ef4aaa8284fa => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:18.318280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ce735-563e-485e-a444-f7d072b27d4b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:18.337666 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16305030-a172-4ba6-b396-52fd0e0014bc None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:18.417387 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b590ba0-cbda-45e8-805e-4265af1b6a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:18.418354 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b590ba0-cbda-45e8-805e-4265af1b6a82 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:18.418787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b590ba0-cbda-45e8-805e-4265af1b6a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:18.419213 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b590ba0-cbda-45e8-805e-4265af1b6a82 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:18.420160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b590ba0-cbda-45e8-805e-4265af1b6a82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:18.420640 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b590ba0-cbda-45e8-805e-4265af1b6a82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:18.422446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b590ba0-cbda-45e8-805e-4265af1b6a82 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:18.448261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 313/630] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:18.455269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b590ba0-cbda-45e8-805e-4265af1b6a82 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:18.530072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ce735-563e-485e-a444-f7d072b27d4b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:18.559420 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:18.587804 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce53bc-8a12-4d11-8fbc-30504d0982b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:18.588930 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce53bc-8a12-4d11-8fbc-30504d0982b5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:18.589397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce53bc-8a12-4d11-8fbc-30504d0982b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:18.589823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce53bc-8a12-4d11-8fbc-30504d0982b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:18.603704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce53bc-8a12-4d11-8fbc-30504d0982b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:18.605918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce53bc-8a12-4d11-8fbc-30504d0982b5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:18.630854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-96ce53bc-8a12-4d11-8fbc-30504d0982b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:18.630854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:18.630854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:18.630854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:18.630854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:18.630854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:18.630854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:18.630854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:18.630854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:18.630854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:18.630854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:18.630854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:18.630854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:18.630854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:18.630854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:18.632034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:18.633119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:18.633119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:18.633119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:18.633119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:18.633912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b590ba0-cbda-45e8-805e-4265af1b6a82 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:18.635775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 318/631] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:18.643952 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce53bc-8a12-4d11-8fbc-30504d0982b5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:18.687794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5916bc1-29b9-4660-b087-1eb47e4a78b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:18.688618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5916bc1-29b9-4660-b087-1eb47e4a78b1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:18.688893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5916bc1-29b9-4660-b087-1eb47e4a78b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:18.689162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5916bc1-29b9-4660-b087-1eb47e4a78b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:18.702544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5916bc1-29b9-4660-b087-1eb47e4a78b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:18.704011 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5916bc1-29b9-4660-b087-1eb47e4a78b1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:18.719310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:18.728581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-f5916bc1-29b9-4660-b087-1eb47e4a78b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:22:18.728581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:18.728581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:18.728581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:18.728581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:18.728581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:18.728581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:18.728581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:18.728581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:18.728581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:18.728581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:18.728581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:18.728581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:18.728581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:18.728581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:18.728581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:18.729670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:18.730633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:18.730633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:18.730633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:18.730633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:18.730633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:18.730633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:18.730633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:18.730633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:18.730633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:22:18.730633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:18.733289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 314/632] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 15 00:22:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:18.739477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5916bc1-29b9-4660-b087-1eb47e4a78b1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:18.841689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce53bc-8a12-4d11-8fbc-30504d0982b5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:18.884011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489d121-29e0-4913-93bf-1b95a10bd0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:18.885196 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489d121-29e0-4913-93bf-1b95a10bd0fb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:18.885619 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489d121-29e0-4913-93bf-1b95a10bd0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:18.885895 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489d121-29e0-4913-93bf-1b95a10bd0fb None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:18.886872 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489d121-29e0-4913-93bf-1b95a10bd0fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:18.887187 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489d121-29e0-4913-93bf-1b95a10bd0fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:18.889241 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489d121-29e0-4913-93bf-1b95a10bd0fb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:18.890689 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5916bc1-29b9-4660-b087-1eb47e4a78b1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:18.903592 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 319/633] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:18.904913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c54c2c-7345-4b65-a2e8-a9ce04049d73 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:18.905785 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:18.909510 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c54c2c-7345-4b65-a2e8-a9ce04049d73 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:18.909804 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c54c2c-7345-4b65-a2e8-a9ce04049d73 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:18.911434 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 320/634] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:18.912169 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c54c2c-7345-4b65-a2e8-a9ce04049d73 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:18.933613 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d5964-3748-4cc1-8b8a-5cdb6aaffe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:18.934413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d5964-3748-4cc1-8b8a-5cdb6aaffe00 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:18.934861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d5964-3748-4cc1-8b8a-5cdb6aaffe00 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:18.935151 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d5964-3748-4cc1-8b8a-5cdb6aaffe00 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:18.936057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d5964-3748-4cc1-8b8a-5cdb6aaffe00 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:18.936366 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d5964-3748-4cc1-8b8a-5cdb6aaffe00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:18.938017 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d5964-3748-4cc1-8b8a-5cdb6aaffe00 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:18.957412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 315/635] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 15 00:22:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:18.958732 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab74a3-4737-48e8-8691-72c24524a241 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:18.959022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab74a3-4737-48e8-8691-72c24524a241 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:18.959304 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab74a3-4737-48e8-8691-72c24524a241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:18.977237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-24ab74a3-4737-48e8-8691-72c24524a241 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:18.978677 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-24ab74a3-4737-48e8-8691-72c24524a241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:19.034157 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c54c2c-7345-4b65-a2e8-a9ce04049d73 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:19.036201 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:19.065715 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 316/636] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:19.067085 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab74a3-4737-48e8-8691-72c24524a241 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:19.076464 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecfc8d-6b16-49f8-8c17-92c515b055ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:19.077399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecfc8d-6b16-49f8-8c17-92c515b055ce None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.077698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecfc8d-6b16-49f8-8c17-92c515b055ce None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.077982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ecfc8d-6b16-49f8-8c17-92c515b055ce None admin] PATH_INFO: `/v3/users/glance` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.087097 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecfc8d-6b16-49f8-8c17-92c515b055ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:19.089154 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ecfc8d-6b16-49f8-8c17-92c515b055ce None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:19.106122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-99ecfc8d-6b16-49f8-8c17-92c515b055ce None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 15 00:22:19.106122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:19.106122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:19.106122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:19.106122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:19.106122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:19.106122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:19.106122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:19.106122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:19.106122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:19.106122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:19.106122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:19.106122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:19.106122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:19.106122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:19.106122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:19.107326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:19.108371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:19.108371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:19.108371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:19.108371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:19.108371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:19.108371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:19.108371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:19.108371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:19.108371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 15 00:22:19.108371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:19.108371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 321/637] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:19.112921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecfc8d-6b16-49f8-8c17-92c515b055ce None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:19.192331 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:19.196207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab74a3-4737-48e8-8691-72c24524a241 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:19.219451 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ecfc8d-6b16-49f8-8c17-92c515b055ce None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:19.233562 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b611df-79f7-4491-9795-f3398475ce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:19.234221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b611df-79f7-4491-9795-f3398475ce5f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.234501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b611df-79f7-4491-9795-f3398475ce5f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.234784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b611df-79f7-4491-9795-f3398475ce5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.253228 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa816c74-470f-47c4-8ec2-47f5b91c37f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:19.253942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816c74-470f-47c4-8ec2-47f5b91c37f8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.254228 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816c74-470f-47c4-8ec2-47f5b91c37f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.254504 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816c74-470f-47c4-8ec2-47f5b91c37f8 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.255339 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa816c74-470f-47c4-8ec2-47f5b91c37f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:19.255648 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa816c74-470f-47c4-8ec2-47f5b91c37f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:19.257086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa816c74-470f-47c4-8ec2-47f5b91c37f8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:19.274362 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 322/638] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Jun 15 00:22:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:19.275231 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa816c74-470f-47c4-8ec2-47f5b91c37f8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:19.301000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:19.312002 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b611df-79f7-4491-9795-f3398475ce5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:19.313708 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b611df-79f7-4491-9795-f3398475ce5f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:19.382184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa816c74-470f-47c4-8ec2-47f5b91c37f8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:19.415976 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:19.419690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb9d48-4446-4cc0-b329-6a9a688e12ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:19.420506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb9d48-4446-4cc0-b329-6a9a688e12ca None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.420783 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb9d48-4446-4cc0-b329-6a9a688e12ca None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.421058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb9d48-4446-4cc0-b329-6a9a688e12ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.425503 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 317/639] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:19.427071 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98534687-3cbc-4efe-aae5-b84e928c9f04 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.427548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98534687-3cbc-4efe-aae5-b84e928c9f04 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.427831 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98534687-3cbc-4efe-aae5-b84e928c9f04 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.429247 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 318/640] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:19.429972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98534687-3cbc-4efe-aae5-b84e928c9f04 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:19.439636 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb9d48-4446-4cc0-b329-6a9a688e12ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:19.447593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ccbb9d48-4446-4cc0-b329-6a9a688e12ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:19.447593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:19.447593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:19.447593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:19.447593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:19.447593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:19.447593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:19.447593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:19.447593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:19.447593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:19.447593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:19.447593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:19.447593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:19.447593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:19.447593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:19.447593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:19.448729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:19.448729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:19.448729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:19.448729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:19.448729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:19.448729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:19.448729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:19.448729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:19.448729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:19.448729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:19.448729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:19.448729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:19.448729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:19.448729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:19.448729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:19.448729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:19.449752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:19.449752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:19.449752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:19.449752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:19.449752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:19.449752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:19.449752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:19.449752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:19.449752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:19.449752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:19.449752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:19.449752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:19.450967 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 323/641] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:19.451625 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb9d48-4446-4cc0-b329-6a9a688e12ca None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:19.536029 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:19.541812 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98534687-3cbc-4efe-aae5-b84e928c9f04 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:19.557176 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb9d48-4446-4cc0-b329-6a9a688e12ca None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:19.578737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef669d2-50f4-4ac7-8d3d-0776077f5c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:19.579464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef669d2-50f4-4ac7-8d3d-0776077f5c90 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.579750 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef669d2-50f4-4ac7-8d3d-0776077f5c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.580079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef669d2-50f4-4ac7-8d3d-0776077f5c90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.594486 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355dc3a0-8dde-4482-b23a-20d48113c359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:19.595293 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dc3a0-8dde-4482-b23a-20d48113c359 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.595573 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dc3a0-8dde-4482-b23a-20d48113c359 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.595841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dc3a0-8dde-4482-b23a-20d48113c359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.606691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355dc3a0-8dde-4482-b23a-20d48113c359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:19.608142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355dc3a0-8dde-4482-b23a-20d48113c359 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:19.625943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-355dc3a0-8dde-4482-b23a-20d48113c359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:19.625943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:19.625943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:19.625943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:19.625943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:19.625943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:19.625943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:19.625943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:19.625943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:19.625943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:19.625943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:19.625943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:19.625943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:19.625943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:19.625943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:19.627181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:19.628096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:19.628096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:19.628096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:19.628096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:19.628096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 324/642] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:19.628503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5d03b-236e-45fc-9bd3-bad8451d0ce9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.628791 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5d03b-236e-45fc-9bd3-bad8451d0ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.629068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5d03b-236e-45fc-9bd3-bad8451d0ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.646205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0df5d03b-236e-45fc-9bd3-bad8451d0ce9 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:19.647299 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0df5d03b-236e-45fc-9bd3-bad8451d0ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:19.668998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:19.672736 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef669d2-50f4-4ac7-8d3d-0776077f5c90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:19.674930 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef669d2-50f4-4ac7-8d3d-0776077f5c90 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:19.715699 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 325/643] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:19.722715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5d03b-236e-45fc-9bd3-bad8451d0ce9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:19.785398 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 319/644] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:19.790937 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef669d2-50f4-4ac7-8d3d-0776077f5c90 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:19.792185 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:19.830814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5d03b-236e-45fc-9bd3-bad8451d0ce9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:19.867933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e79b3-6d53-4e7b-8957-fadfed9b01a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:19.868626 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e79b3-6d53-4e7b-8957-fadfed9b01a1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.868915 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e79b3-6d53-4e7b-8957-fadfed9b01a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.869190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e79b3-6d53-4e7b-8957-fadfed9b01a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.869986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e79b3-6d53-4e7b-8957-fadfed9b01a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:19.870306 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e79b3-6d53-4e7b-8957-fadfed9b01a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:19.871679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e79b3-6d53-4e7b-8957-fadfed9b01a1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:19.879819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 326/645] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:19.880601 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e79b3-6d53-4e7b-8957-fadfed9b01a1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:19.908286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:19.911440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef669d2-50f4-4ac7-8d3d-0776077f5c90 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:19.951867 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3390c0d-14e2-43ff-bba7-34bfc4112edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:19.952546 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3390c0d-14e2-43ff-bba7-34bfc4112edc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:19.952831 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3390c0d-14e2-43ff-bba7-34bfc4112edc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:19.953110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3390c0d-14e2-43ff-bba7-34bfc4112edc None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:19.953876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3390c0d-14e2-43ff-bba7-34bfc4112edc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:19.954180 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3390c0d-14e2-43ff-bba7-34bfc4112edc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:19.955561 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3390c0d-14e2-43ff-bba7-34bfc4112edc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:19.971965 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 320/646] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:19.971965 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3390c0d-14e2-43ff-bba7-34bfc4112edc None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:19.981266 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e79b3-6d53-4e7b-8957-fadfed9b01a1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.005146 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:20.016394 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee6e6c-85e9-44e3-a66d-510fd5158c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.017206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6e6c-85e9-44e3-a66d-510fd5158c0f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.017532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6e6c-85e9-44e3-a66d-510fd5158c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.017809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6e6c-85e9-44e3-a66d-510fd5158c0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.028475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee6e6c-85e9-44e3-a66d-510fd5158c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:20.036432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-04ee6e6c-85e9-44e3-a66d-510fd5158c0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:20.036432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:20.036432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:20.036432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:20.036432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:20.036432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:20.036432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:20.036432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:20.036432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:20.036432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:20.036432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:20.036432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:20.036432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:20.036432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:20.036432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:20.036432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:20.037468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:20.037468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:20.037468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:20.037468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:20.037468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:20.037468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:20.037468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:20.037468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:20.037468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:20.037468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:20.037468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:20.037468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:20.037468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:20.037468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:20.037468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:20.037468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:20.043548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:20.043548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:20.043548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:20.043548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:20.043548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:20.043548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:20.043548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:20.043548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:20.043548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:20.043548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:20.043548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:20.043548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:20.043548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 327/647] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:20.043548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee6e6c-85e9-44e3-a66d-510fd5158c0f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.088944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3390c0d-14e2-43ff-bba7-34bfc4112edc None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.123355 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bbac5-79de-4229-8545-55a1bd87531d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.124268 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bbac5-79de-4229-8545-55a1bd87531d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.124619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bbac5-79de-4229-8545-55a1bd87531d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.124908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bbac5-79de-4229-8545-55a1bd87531d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.136452 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bbac5-79de-4229-8545-55a1bd87531d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.138031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0bbac5-79de-4229-8545-55a1bd87531d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.150048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee6e6c-85e9-44e3-a66d-510fd5158c0f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.156182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-fa0bbac5-79de-4229-8545-55a1bd87531d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:20.156182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:20.156182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:20.156182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:20.156182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:20.156182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:20.156182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:20.156182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:20.156182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:20.156182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:20.156182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:20.156182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:20.156182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:20.156182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:20.156182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:20.157072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:20.158014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:20.158014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:20.158014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:20.158014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:20.158014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 321/648] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:20.158336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bbac5-79de-4229-8545-55a1bd87531d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.173916 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:20.190162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff7b42-3c04-405d-b2a0-a2bdb4f6b37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.190981 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff7b42-3c04-405d-b2a0-a2bdb4f6b37d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.191271 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff7b42-3c04-405d-b2a0-a2bdb4f6b37d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.191552 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff7b42-3c04-405d-b2a0-a2bdb4f6b37d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.203064 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff7b42-3c04-405d-b2a0-a2bdb4f6b37d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.204536 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff7b42-3c04-405d-b2a0-a2bdb4f6b37d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.221655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ffff7b42-3c04-405d-b2a0-a2bdb4f6b37d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:20.221655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:20.221655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:20.221655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:20.221655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:20.221655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:20.221655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:20.221655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:20.221655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:20.221655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:20.221655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:20.221655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:20.221655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:20.221655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:20.221655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:20.222559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:20.223478 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:20.223478 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:20.223478 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:20.223478 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:20.223478 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 328/649] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:20.223761 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff7b42-3c04-405d-b2a0-a2bdb4f6b37d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.262139 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:20.273300 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bbac5-79de-4229-8545-55a1bd87531d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.307554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2ef88-231d-43b0-9c94-55f8ad7310c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.308377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2ef88-231d-43b0-9c94-55f8ad7310c5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.308662 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2ef88-231d-43b0-9c94-55f8ad7310c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.308942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2ef88-231d-43b0-9c94-55f8ad7310c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.315878 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2ef88-231d-43b0-9c94-55f8ad7310c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.317356 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2ef88-231d-43b0-9c94-55f8ad7310c5 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.332014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff7b42-3c04-405d-b2a0-a2bdb4f6b37d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.335178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-4af2ef88-231d-43b0-9c94-55f8ad7310c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:20.335178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:20.335178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:20.335178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:20.335178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:20.335178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:20.335178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:20.335178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:20.335178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:20.335178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:20.335178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:20.335178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:20.335178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:20.335178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:20.335178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:20.336134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:20.337039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:20.337039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:20.337039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:20.337039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:20.337039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:20.337039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:20.337039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:20.337039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:20.341418 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 322/650] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:20.341862 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2ef88-231d-43b0-9c94-55f8ad7310c5 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.366838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0de4cd-8062-4c97-96c4-12cfdbef08e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.367525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0de4cd-8062-4c97-96c4-12cfdbef08e4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.367815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0de4cd-8062-4c97-96c4-12cfdbef08e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.368094 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0de4cd-8062-4c97-96c4-12cfdbef08e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.368857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0de4cd-8062-4c97-96c4-12cfdbef08e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:20.369247 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0de4cd-8062-4c97-96c4-12cfdbef08e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.370588 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0de4cd-8062-4c97-96c4-12cfdbef08e4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.381549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 329/651] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:20.382215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0de4cd-8062-4c97-96c4-12cfdbef08e4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.420574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:20.456410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2ef88-231d-43b0-9c94-55f8ad7310c5 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.491655 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08573c01-e01e-46a7-ac55-5db92e8482df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.491873 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:20.492345 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08573c01-e01e-46a7-ac55-5db92e8482df None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.492625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08573c01-e01e-46a7-ac55-5db92e8482df None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.492940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08573c01-e01e-46a7-ac55-5db92e8482df None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.493812 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08573c01-e01e-46a7-ac55-5db92e8482df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:20.494123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08573c01-e01e-46a7-ac55-5db92e8482df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.495519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08573c01-e01e-46a7-ac55-5db92e8482df None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.496677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0de4cd-8062-4c97-96c4-12cfdbef08e4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.511539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 323/652] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:20.511539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08573c01-e01e-46a7-ac55-5db92e8482df None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.539613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e0143-2a7e-4c56-945a-2122b4200a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.540297 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e0143-2a7e-4c56-945a-2122b4200a96 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.540585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e0143-2a7e-4c56-945a-2122b4200a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.540864 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e0143-2a7e-4c56-945a-2122b4200a96 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.541628 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e0143-2a7e-4c56-945a-2122b4200a96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:20.541945 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e0143-2a7e-4c56-945a-2122b4200a96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.543331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e0143-2a7e-4c56-945a-2122b4200a96 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.555902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 330/653] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:20.560872 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e0143-2a7e-4c56-945a-2122b4200a96 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.610703 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08573c01-e01e-46a7-ac55-5db92e8482df None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.647487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:20.654787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42b7d9-8e65-468c-8098-b114acf80438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.655935 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42b7d9-8e65-468c-8098-b114acf80438 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.656245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42b7d9-8e65-468c-8098-b114acf80438 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.656771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42b7d9-8e65-468c-8098-b114acf80438 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.657617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42b7d9-8e65-468c-8098-b114acf80438 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:20.658084 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42b7d9-8e65-468c-8098-b114acf80438 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.660140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42b7d9-8e65-468c-8098-b114acf80438 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.667125 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e0143-2a7e-4c56-945a-2122b4200a96 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.674209 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 324/654] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:20.674961 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42b7d9-8e65-468c-8098-b114acf80438 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.707365 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e64849-baa6-40ca-b49e-a1542bd76f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.708187 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e64849-baa6-40ca-b49e-a1542bd76f48 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.708474 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e64849-baa6-40ca-b49e-a1542bd76f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.708748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e64849-baa6-40ca-b49e-a1542bd76f48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.723311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e64849-baa6-40ca-b49e-a1542bd76f48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.724776 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e64849-baa6-40ca-b49e-a1542bd76f48 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.743127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-91e64849-baa6-40ca-b49e-a1542bd76f48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:20.743127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:20.743127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:20.743127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:20.743127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:20.743127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:20.743127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:20.743127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:20.743127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:20.743127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:20.743127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:20.743127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:20.743127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:20.743127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:20.743127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:20.744142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:20.745046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:20.745046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:20.745046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:20.745046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:20.745046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 331/655] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:20.745324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e64849-baa6-40ca-b49e-a1542bd76f48 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.757628 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:20.789424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42b7d9-8e65-468c-8098-b114acf80438 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.829639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96b702-d94d-43d0-9eda-ab0d54683825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.830453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96b702-d94d-43d0-9eda-ab0d54683825 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.830729 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96b702-d94d-43d0-9eda-ab0d54683825 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.830996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96b702-d94d-43d0-9eda-ab0d54683825 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.837813 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96b702-d94d-43d0-9eda-ab0d54683825 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.839262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96b702-d94d-43d0-9eda-ab0d54683825 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.853456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-6d96b702-d94d-43d0-9eda-ab0d54683825 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:20.853456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:20.853456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:20.853456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:20.853456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:20.853456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:20.853456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:20.853456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:20.853456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:20.853456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:20.853456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:20.853456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:20.853456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:20.853456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:20.853456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:20.854369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:20.855593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:20.855593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:20.855593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:20.855593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:20.855593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:20.855593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:20.855593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:20.855593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:20.855593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 325/656] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:20.855593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96b702-d94d-43d0-9eda-ab0d54683825 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.859323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e64849-baa6-40ca-b49e-a1542bd76f48 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.893100 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0327388-ff9f-4db8-b5f4-242cd86f4ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.893938 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0327388-ff9f-4db8-b5f4-242cd86f4ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.894226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0327388-ff9f-4db8-b5f4-242cd86f4ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.894501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0327388-ff9f-4db8-b5f4-242cd86f4ae1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.901532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0327388-ff9f-4db8-b5f4-242cd86f4ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.903002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0327388-ff9f-4db8-b5f4-242cd86f4ae1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:20.907419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:20.917966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-c0327388-ff9f-4db8-b5f4-242cd86f4ae1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 00:22:20.917966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:20.917966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:20.917966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:20.917966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:20.917966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:20.917966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:20.917966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:20.917966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:20.917966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:20.917966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:20.917966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:20.917966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:20.917966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:20.917966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:20.917966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:20.918976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:20.919932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:20.919932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:20.919932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:20.919932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:20.919932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:20.919932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:20.919932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:20.919932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:20.919932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 15 00:22:20.919932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:20.919932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 332/657] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:20.921177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833f4c0-3dab-4e7e-8991-1d6e9bbf2d57 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.921177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833f4c0-3dab-4e7e-8991-1d6e9bbf2d57 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.921177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833f4c0-3dab-4e7e-8991-1d6e9bbf2d57 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.925525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 333/658] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:20.925525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833f4c0-3dab-4e7e-8991-1d6e9bbf2d57 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:20.958692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96b702-d94d-43d0-9eda-ab0d54683825 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:20.991389 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a253a3-7a6d-4af6-9e61-138cbb221958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:20.992096 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a253a3-7a6d-4af6-9e61-138cbb221958 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:20.992374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a253a3-7a6d-4af6-9e61-138cbb221958 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:20.992649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a253a3-7a6d-4af6-9e61-138cbb221958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:20.993507 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a253a3-7a6d-4af6-9e61-138cbb221958 None admin] RBAC: Adding query filter params (role.id=4afb8bd8c6354dd9b143ef4aaa8284fa, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=6d0ae1707c7041a0989889dbefeaf267) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:20.993823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a253a3-7a6d-4af6-9e61-138cbb221958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:20.994607 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:20.995395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a253a3-7a6d-4af6-9e61-138cbb221958 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:21.001066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 326/659] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/role_assignments?user.id=6d0ae1707c7041a0989889dbefeaf267&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=4afb8bd8c6354dd9b143ef4aaa8284fa => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:21.001875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a253a3-7a6d-4af6-9e61-138cbb221958 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:21.039498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833f4c0-3dab-4e7e-8991-1d6e9bbf2d57 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:21.085891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742d8fe-418f-4616-9857-7a551ec64571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:21.086586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742d8fe-418f-4616-9857-7a551ec64571 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:21.086870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742d8fe-418f-4616-9857-7a551ec64571 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:21.087144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742d8fe-418f-4616-9857-7a551ec64571 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:21.087883 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742d8fe-418f-4616-9857-7a551ec64571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:21.088192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742d8fe-418f-4616-9857-7a551ec64571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:21.090203 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742d8fe-418f-4616-9857-7a551ec64571 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:21.102750 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 334/660] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:21.103692 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742d8fe-418f-4616-9857-7a551ec64571 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:21.122058 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a253a3-7a6d-4af6-9e61-138cbb221958 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:21.143935 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:21.168631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65203f-986f-47c6-b383-1428cf1d0063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:21.169324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65203f-986f-47c6-b383-1428cf1d0063 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:21.169653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65203f-986f-47c6-b383-1428cf1d0063 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:21.169942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65203f-986f-47c6-b383-1428cf1d0063 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:21.170956 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65203f-986f-47c6-b383-1428cf1d0063 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:21.171104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65203f-986f-47c6-b383-1428cf1d0063 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:21.172545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65203f-986f-47c6-b383-1428cf1d0063 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:21.187229 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 327/661] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:21.188568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ed816-57a6-4782-ac51-1754ed7c8f2f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:21.188862 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ed816-57a6-4782-ac51-1754ed7c8f2f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:21.189147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ed816-57a6-4782-ac51-1754ed7c8f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:21.205260 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-727ed816-57a6-4782-ac51-1754ed7c8f2f None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:21.206497 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-727ed816-57a6-4782-ac51-1754ed7c8f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:21.232630 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742d8fe-418f-4616-9857-7a551ec64571 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:21.268139 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:21.275090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def3100-521d-41d8-b9c8-e7d0ee8c8ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:21.275773 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def3100-521d-41d8-b9c8-e7d0ee8c8ffe None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:21.276055 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def3100-521d-41d8-b9c8-e7d0ee8c8ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:21.276527 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def3100-521d-41d8-b9c8-e7d0ee8c8ffe None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:21.277164 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def3100-521d-41d8-b9c8-e7d0ee8c8ffe None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:21.277566 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def3100-521d-41d8-b9c8-e7d0ee8c8ffe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:21.278994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def3100-521d-41d8-b9c8-e7d0ee8c8ffe None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:21.281510 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 328/662] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:21.282940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ed816-57a6-4782-ac51-1754ed7c8f2f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:21.296379 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 335/663] 10.222.0.36 () {56 vars in 1139 bytes} [Wed Jun 15 00:22:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:21.297109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def3100-521d-41d8-b9c8-e7d0ee8c8ffe None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:21.398002 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ed816-57a6-4782-ac51-1754ed7c8f2f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:21.402970 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def3100-521d-41d8-b9c8-e7d0ee8c8ffe None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:21.405066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:21.435660 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c00ec7-3110-4f8a-9fac-1dcf47bb70ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:21.436590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c00ec7-3110-4f8a-9fac-1dcf47bb70ba None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:21.436876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c00ec7-3110-4f8a-9fac-1dcf47bb70ba None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:21.437151 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c00ec7-3110-4f8a-9fac-1dcf47bb70ba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:21.439523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92fc15-b804-4252-8452-4cd65da6aff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:21.440144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92fc15-b804-4252-8452-4cd65da6aff4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:21.440427 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92fc15-b804-4252-8452-4cd65da6aff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:21.440702 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92fc15-b804-4252-8452-4cd65da6aff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:21.441566 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92fc15-b804-4252-8452-4cd65da6aff4 None admin] RBAC: Adding query filter params (role.id=4afb8bd8c6354dd9b143ef4aaa8284fa, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=a239897b9a0644ef9d2e0e2e333232fa) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:21.441884 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92fc15-b804-4252-8452-4cd65da6aff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:21.443327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92fc15-b804-4252-8452-4cd65da6aff4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:21.444483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c00ec7-3110-4f8a-9fac-1dcf47bb70ba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:21.446873 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c00ec7-3110-4f8a-9fac-1dcf47bb70ba None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:21.457514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 336/664] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:21 2022] GET /identity/v3/role_assignments?user.id=a239897b9a0644ef9d2e0e2e333232fa&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=4afb8bd8c6354dd9b143ef4aaa8284fa => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:21.457514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92fc15-b804-4252-8452-4cd65da6aff4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:21.464192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c6c00ec7-3110-4f8a-9fac-1dcf47bb70ba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 00:22:21.464192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:21.464192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:21.464192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:21.464192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:21.464192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:21.464192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:21.464192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:21.464192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:21.464192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:21.464192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:21.464192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:21.464192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:21.464192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:21.464192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:21.464192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:21.465230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:21.466208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:21.466208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:21.466208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:21.466208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:21.466208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:21.466208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:21.466208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:21.466208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:21.466208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 00:22:21.466208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:21.470291 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 329/665] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:21.471286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c00ec7-3110-4f8a-9fac-1dcf47bb70ba None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:21.530184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:21.587351 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92fc15-b804-4252-8452-4cd65da6aff4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:21.592742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c00ec7-3110-4f8a-9fac-1dcf47bb70ba None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:21.634764 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61092ba2-d34c-42c9-8d80-572c16791503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:21.635588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61092ba2-d34c-42c9-8d80-572c16791503 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:21.635785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8453d2a-cd84-40cc-84bc-422ba02d0a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:21.635899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61092ba2-d34c-42c9-8d80-572c16791503 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:21.636133 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61092ba2-d34c-42c9-8d80-572c16791503 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:21.636444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8453d2a-cd84-40cc-84bc-422ba02d0a23 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:21.636729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8453d2a-cd84-40cc-84bc-422ba02d0a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:21.637004 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8453d2a-cd84-40cc-84bc-422ba02d0a23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:21.654035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61092ba2-d34c-42c9-8d80-572c16791503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:21.661921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-61092ba2-d34c-42c9-8d80-572c16791503 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:21.661921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:21.661921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:21.661921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:21.661921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:21.661921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:21.661921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:21.661921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:21.661921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:21.661921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:21.661921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:21.661921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:21.661921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:21.661921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:21.661921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:21.661921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:21.662915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:21.662915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:21.662915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:21.662915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:21.662915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:21.662915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:21.662915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:21.662915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:21.662915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:21.662915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:21.662915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:21.662915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:21.662915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:21.662915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:21.662915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:21.662915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:21.663861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:21.663861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:21.663861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:21.663861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:21.663861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:21.663861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:21.663861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:21.663861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:21.663861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:21.663861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:21.663861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:21.663861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:21.663861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 330/666] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:21.664564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61092ba2-d34c-42c9-8d80-572c16791503 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:21.698877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:21.734057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8453d2a-cd84-40cc-84bc-422ba02d0a23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:21.734950 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8453d2a-cd84-40cc-84bc-422ba02d0a23 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:21.795498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61092ba2-d34c-42c9-8d80-572c16791503 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:21.804790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:21.832123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a32d4-d864-4ab1-99ca-34f760fded86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:21.832817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a32d4-d864-4ab1-99ca-34f760fded86 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:21.833292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a32d4-d864-4ab1-99ca-34f760fded86 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:21.833617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a32d4-d864-4ab1-99ca-34f760fded86 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:21.834467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a32d4-d864-4ab1-99ca-34f760fded86 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:21.834779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a32d4-d864-4ab1-99ca-34f760fded86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:21.836323 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a32d4-d864-4ab1-99ca-34f760fded86 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:21.859315 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 331/667] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Jun 15 00:22:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:21.860235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a32d4-d864-4ab1-99ca-34f760fded86 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:21.866412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 337/668] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:21.867603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8453d2a-cd84-40cc-84bc-422ba02d0a23 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:21.961294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:21.981535 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a32d4-d864-4ab1-99ca-34f760fded86 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:21.994475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8453d2a-cd84-40cc-84bc-422ba02d0a23 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:22.019460 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5780e46-94f5-4889-a5da-0c0648176f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:22.020409 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5780e46-94f5-4889-a5da-0c0648176f1c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.020869 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5780e46-94f5-4889-a5da-0c0648176f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.021373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5780e46-94f5-4889-a5da-0c0648176f1c None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:22.022452 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5780e46-94f5-4889-a5da-0c0648176f1c None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:22.022990 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5780e46-94f5-4889-a5da-0c0648176f1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:22.024553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5780e46-94f5-4889-a5da-0c0648176f1c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:22.034501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 332/669] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:22.034664 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89a653-a9ef-4a9c-8464-ab2778eeb10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:22.036312 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5780e46-94f5-4889-a5da-0c0648176f1c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:22.039742 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89a653-a9ef-4a9c-8464-ab2778eeb10d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.039962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89a653-a9ef-4a9c-8464-ab2778eeb10d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.040254 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89a653-a9ef-4a9c-8464-ab2778eeb10d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:22.072308 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:22.122891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89a653-a9ef-4a9c-8464-ab2778eeb10d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:22.125312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89a653-a9ef-4a9c-8464-ab2778eeb10d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:22.159290 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5780e46-94f5-4889-a5da-0c0648176f1c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:22.204740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f91419-143a-469e-9133-b6381fae3b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:22.205673 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f91419-143a-469e-9133-b6381fae3b1a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.205955 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f91419-143a-469e-9133-b6381fae3b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.206229 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f91419-143a-469e-9133-b6381fae3b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:22.220027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f91419-143a-469e-9133-b6381fae3b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:22.221470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f91419-143a-469e-9133-b6381fae3b1a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:22.230451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:22.238359 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 338/670] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:22.238359 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89a653-a9ef-4a9c-8464-ab2778eeb10d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:22.247050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-21f91419-143a-469e-9133-b6381fae3b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:22.247050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:22.247050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:22.247050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:22.247050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:22.247050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:22.247050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:22.247050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:22.247050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:22.247050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:22.247050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:22.247050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:22.247050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:22.247050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:22.247050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:22.247978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:22.249133 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:22.249133 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:22.249133 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:22.249133 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:22.249133 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 333/671] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:22.249460 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f91419-143a-469e-9133-b6381fae3b1a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:22.313715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:22.361597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f91419-143a-469e-9133-b6381fae3b1a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:22.372989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89a653-a9ef-4a9c-8464-ab2778eeb10d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:22.407013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25e4f5-6930-4e94-b568-b43eda4afc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:22.408116 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25e4f5-6930-4e94-b568-b43eda4afc6a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.408545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25e4f5-6930-4e94-b568-b43eda4afc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.408961 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25e4f5-6930-4e94-b568-b43eda4afc6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:22.410182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa7fff-203f-429c-85db-ec99506ec24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:22.411011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa7fff-203f-429c-85db-ec99506ec24e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.411393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa7fff-203f-429c-85db-ec99506ec24e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.411679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa7fff-203f-429c-85db-ec99506ec24e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:22.422593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25e4f5-6930-4e94-b568-b43eda4afc6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:22.422742 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa7fff-203f-429c-85db-ec99506ec24e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:22.424060 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa7fff-203f-429c-85db-ec99506ec24e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:22.424507 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25e4f5-6930-4e94-b568-b43eda4afc6a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:22.442578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-92aa7fff-203f-429c-85db-ec99506ec24e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:22.442578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:22.442578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:22.442578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:22.442578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:22.442578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:22.442578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:22.442578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:22.442578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:22.442578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:22.442578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:22.442578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:22.442578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:22.442578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:22.442578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:22.443659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:22.444910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:22.444910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:22.444910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:22.444910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:22.446219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-ac25e4f5-6930-4e94-b568-b43eda4afc6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:22.446219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:22.446219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:22.446219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:22.446219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:22.446219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:22.446219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:22.446219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:22.446219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:22.446219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:22.446219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:22.446219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:22.446219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:22.446219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:22.446219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:22.447054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:22.447967 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:22.447967 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:22.447967 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:22.447967 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:22.448762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 339/672] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:22.449659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa7fff-203f-429c-85db-ec99506ec24e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:22.454623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 334/673] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:22.454623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25e4f5-6930-4e94-b568-b43eda4afc6a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:22.506410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:22.560310 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25e4f5-6930-4e94-b568-b43eda4afc6a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:22.580741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa7fff-203f-429c-85db-ec99506ec24e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:22.584079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:22.595851 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3db9d-ceb9-405f-a87e-dbd43a325b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:22.596550 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3db9d-ceb9-405f-a87e-dbd43a325b7e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.596839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3db9d-ceb9-405f-a87e-dbd43a325b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.597120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3db9d-ceb9-405f-a87e-dbd43a325b7e None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:22.597888 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3db9d-ceb9-405f-a87e-dbd43a325b7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:22.598204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3db9d-ceb9-405f-a87e-dbd43a325b7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:22.599703 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3db9d-ceb9-405f-a87e-dbd43a325b7e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:22.617765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 335/674] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:22.618591 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3db9d-ceb9-405f-a87e-dbd43a325b7e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:22.626764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba268ec-dc75-4a1e-b66b-daaef7f73082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:22.627772 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba268ec-dc75-4a1e-b66b-daaef7f73082 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.628253 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba268ec-dc75-4a1e-b66b-daaef7f73082 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.628736 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba268ec-dc75-4a1e-b66b-daaef7f73082 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:22.630107 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba268ec-dc75-4a1e-b66b-daaef7f73082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:22.630621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba268ec-dc75-4a1e-b66b-daaef7f73082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:22.632612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba268ec-dc75-4a1e-b66b-daaef7f73082 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:22.652594 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 340/675] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:22.652594 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba268ec-dc75-4a1e-b66b-daaef7f73082 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:22.749529 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3db9d-ceb9-405f-a87e-dbd43a325b7e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:22.761485 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:22.770832 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba268ec-dc75-4a1e-b66b-daaef7f73082 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:22.792254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918965f4-16a1-449c-a4f2-1a67e6ca11a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:22.792945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918965f4-16a1-449c-a4f2-1a67e6ca11a8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.793558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918965f4-16a1-449c-a4f2-1a67e6ca11a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.793558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918965f4-16a1-449c-a4f2-1a67e6ca11a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:22.794265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918965f4-16a1-449c-a4f2-1a67e6ca11a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:22.794576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918965f4-16a1-449c-a4f2-1a67e6ca11a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:22.796142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918965f4-16a1-449c-a4f2-1a67e6ca11a8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:22.813224 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 336/676] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:22.814169 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918965f4-16a1-449c-a4f2-1a67e6ca11a8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:22.819193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4809e6-1a07-4378-a8ca-779d2df745de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:22.820319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4809e6-1a07-4378-a8ca-779d2df745de None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.820804 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4809e6-1a07-4378-a8ca-779d2df745de None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.821292 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4809e6-1a07-4378-a8ca-779d2df745de None admin] PATH_INFO: `/v3/users/swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:22.832832 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4809e6-1a07-4378-a8ca-779d2df745de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:22.835173 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4809e6-1a07-4378-a8ca-779d2df745de None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:22.855067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-9d4809e6-1a07-4378-a8ca-779d2df745de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:22:22.855067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:22.855067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:22.855067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:22.855067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:22.855067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:22.855067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:22.855067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:22.855067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:22.855067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:22.855067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:22.855067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:22.855067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:22.855067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:22.855067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:22.855067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:22.856044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:22.856999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:22.856999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:22.856999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:22.856999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:22.856999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:22.856999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:22.856999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:22.856999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:22.856999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:22:22.856999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:22.863910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 341/677] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:22.863910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4809e6-1a07-4378-a8ca-779d2df745de None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:22.890092 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:22.944846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918965f4-16a1-449c-a4f2-1a67e6ca11a8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:22.967929 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4809e6-1a07-4378-a8ca-779d2df745de None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:22.994617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49a2f3-e683-4b92-b3a0-81e7281983fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:22.996642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49a2f3-e683-4b92-b3a0-81e7281983fe None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:22.997102 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49a2f3-e683-4b92-b3a0-81e7281983fe None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:22.997552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49a2f3-e683-4b92-b3a0-81e7281983fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.006327 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49a2f3-e683-4b92-b3a0-81e7281983fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:23.006567 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217362d-9fa8-490a-ab71-dcf01077009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:23.007553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217362d-9fa8-490a-ab71-dcf01077009f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.007937 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217362d-9fa8-490a-ab71-dcf01077009f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.008316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217362d-9fa8-490a-ab71-dcf01077009f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.008716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49a2f3-e683-4b92-b3a0-81e7281983fe None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:23.015706 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217362d-9fa8-490a-ab71-dcf01077009f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:23.017194 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217362d-9fa8-490a-ab71-dcf01077009f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:23.025672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-3f49a2f3-e683-4b92-b3a0-81e7281983fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:23.025672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:23.025672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:23.025672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:23.025672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:23.025672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:23.025672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:23.025672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:23.025672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:23.025672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:23.025672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:23.025672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:23.025672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:23.025672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:23.025672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:23.026674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:23.027596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:23.027596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:23.027596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:23.027596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:23.027596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:23.027596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:23.027596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:23.027596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:23.034303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5217362d-9fa8-490a-ab71-dcf01077009f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:23.034303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:23.034303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:23.034303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:23.034303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:23.034303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:23.034303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:23.034303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:23.034303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:23.034303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:23.034303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:23.034303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:23.034303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:23.034303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:23.034303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:23.035184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:23.036090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:23.036090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:23.036090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:23.036090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:23.036090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:23.036090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:23.036090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:23.036090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:23.037118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 337/679] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:23.038127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49a2f3-e683-4b92-b3a0-81e7281983fe None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:23.039444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 342/679] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:23.040374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217362d-9fa8-490a-ab71-dcf01077009f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:23.078953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:23.135161 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:23.153545 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217362d-9fa8-490a-ab71-dcf01077009f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:23.179605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49a2f3-e683-4b92-b3a0-81e7281983fe None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:23.193422 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cdada-8d2c-46f0-8b0f-e261aa3d6a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:23.194243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cdada-8d2c-46f0-8b0f-e261aa3d6a99 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.194634 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cdada-8d2c-46f0-8b0f-e261aa3d6a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.195482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cdada-8d2c-46f0-8b0f-e261aa3d6a99 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.196412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cdada-8d2c-46f0-8b0f-e261aa3d6a99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:23.196944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cdada-8d2c-46f0-8b0f-e261aa3d6a99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:23.199277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cdada-8d2c-46f0-8b0f-e261aa3d6a99 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:23.219271 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 343/680] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:23.219271 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cdada-8d2c-46f0-8b0f-e261aa3d6a99 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:23.237647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d28d7-e2d6-45dd-8515-2bef73b8c601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:23.238670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d28d7-e2d6-45dd-8515-2bef73b8c601 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.239131 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d28d7-e2d6-45dd-8515-2bef73b8c601 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.239602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d28d7-e2d6-45dd-8515-2bef73b8c601 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.241610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d28d7-e2d6-45dd-8515-2bef73b8c601 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:23.242122 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d28d7-e2d6-45dd-8515-2bef73b8c601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:23.244256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d28d7-e2d6-45dd-8515-2bef73b8c601 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:23.264373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 338/681] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Jun 15 00:22:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:23.265508 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d28d7-e2d6-45dd-8515-2bef73b8c601 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:23.327748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cdada-8d2c-46f0-8b0f-e261aa3d6a99 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:23.359882 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:23.366354 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20adbd-128f-475d-8c32-039ce3cee97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:23.367266 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20adbd-128f-475d-8c32-039ce3cee97d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.367577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20adbd-128f-475d-8c32-039ce3cee97d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.368164 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20adbd-128f-475d-8c32-039ce3cee97d None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.368970 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20adbd-128f-475d-8c32-039ce3cee97d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:23.369285 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20adbd-128f-475d-8c32-039ce3cee97d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:23.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20adbd-128f-475d-8c32-039ce3cee97d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:23.374824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d28d7-e2d6-45dd-8515-2bef73b8c601 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:23.383751 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 344/682] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:23.385137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5f296-c254-426f-817e-6e61ec64e8c3 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.385566 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5f296-c254-426f-817e-6e61ec64e8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.385796 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5f296-c254-426f-817e-6e61ec64e8c3 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.387155 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 345/683] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:23.391899 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5f296-c254-426f-817e-6e61ec64e8c3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:23.395745 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:23.417861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1366e-8a1a-448e-80d9-2817a59daf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:23.418846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1366e-8a1a-448e-80d9-2817a59daf9a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.419160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1366e-8a1a-448e-80d9-2817a59daf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.419425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1366e-8a1a-448e-80d9-2817a59daf9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.420266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1366e-8a1a-448e-80d9-2817a59daf9a None admin] RBAC: Adding query filter params (role.id=4afb8bd8c6354dd9b143ef4aaa8284fa, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=46c398ec4dcc438895f054f616fc9e41) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:23.420585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1366e-8a1a-448e-80d9-2817a59daf9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:23.422134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1366e-8a1a-448e-80d9-2817a59daf9a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:23.428248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 339/684] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:23 2022] GET /identity/v3/role_assignments?user.id=46c398ec4dcc438895f054f616fc9e41&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=4afb8bd8c6354dd9b143ef4aaa8284fa => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:23.429088 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1366e-8a1a-448e-80d9-2817a59daf9a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:23.524526 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5f296-c254-426f-817e-6e61ec64e8c3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:23.569047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1366e-8a1a-448e-80d9-2817a59daf9a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:23.580225 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2d9ff-91fe-49dc-9b29-d9f5784d3fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:23.580827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2d9ff-91fe-49dc-9b29-d9f5784d3fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.581117 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2d9ff-91fe-49dc-9b29-d9f5784d3fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.581985 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2d9ff-91fe-49dc-9b29-d9f5784d3fa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.610802 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15863b8f-8506-419a-b6f6-6ccde4e19fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:23.611835 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863b8f-8506-419a-b6f6-6ccde4e19fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.612336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863b8f-8506-419a-b6f6-6ccde4e19fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.613500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15863b8f-8506-419a-b6f6-6ccde4e19fc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.617396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15863b8f-8506-419a-b6f6-6ccde4e19fc7 None admin] RBAC: Adding query filter params (role.id=4afb8bd8c6354dd9b143ef4aaa8284fa, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=d41065b495234fd98552222fc32cc53e) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:23.617396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15863b8f-8506-419a-b6f6-6ccde4e19fc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:23.618846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15863b8f-8506-419a-b6f6-6ccde4e19fc7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:23.627789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 340/685] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:23 2022] GET /identity/v3/role_assignments?user.id=d41065b495234fd98552222fc32cc53e&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=4afb8bd8c6354dd9b143ef4aaa8284fa => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:23.629069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1abb16-d0c9-476c-8943-90fa7883cbd0 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.629365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1abb16-d0c9-476c-8943-90fa7883cbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.629642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1abb16-d0c9-476c-8943-90fa7883cbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.653235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1e1abb16-d0c9-476c-8943-90fa7883cbd0 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:23.654569 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1e1abb16-d0c9-476c-8943-90fa7883cbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:23.674837 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:23.687272 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2d9ff-91fe-49dc-9b29-d9f5784d3fa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:23.688805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2d9ff-91fe-49dc-9b29-d9f5784d3fa7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:23.694329 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:23.773574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 341/686] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:23.776425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c70b8-3b69-4bd6-aca3-60c85017e053 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.776720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c70b8-3b69-4bd6-aca3-60c85017e053 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.777001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c70b8-3b69-4bd6-aca3-60c85017e053 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.778834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 342/687] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:23.786962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f6863-5d9d-4aff-a08a-0cbc226efe49 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:23.787258 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f6863-5d9d-4aff-a08a-0cbc226efe49 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:23.787543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f6863-5d9d-4aff-a08a-0cbc226efe49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:23.816587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 346/688] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:23.817485 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2d9ff-91fe-49dc-9b29-d9f5784d3fa7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:23.818999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-343f6863-5d9d-4aff-a08a-0cbc226efe49 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:23.820239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-343f6863-5d9d-4aff-a08a-0cbc226efe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:23.908970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 343/689] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:23.909815 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f6863-5d9d-4aff-a08a-0cbc226efe49 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:23.957222 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2d9ff-91fe-49dc-9b29-d9f5784d3fa7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:23.960673 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:23.992379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:24.004375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca66b25-5ab6-428e-8dd9-96f7673a584e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:24.005217 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca66b25-5ab6-428e-8dd9-96f7673a584e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:24.006856 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca66b25-5ab6-428e-8dd9-96f7673a584e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:24.007748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca66b25-5ab6-428e-8dd9-96f7673a584e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:24.019428 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f6863-5d9d-4aff-a08a-0cbc226efe49 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:24.023825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca66b25-5ab6-428e-8dd9-96f7673a584e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:24.033755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-eca66b25-5ab6-428e-8dd9-96f7673a584e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:24.033755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:24.033755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:24.033755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:24.033755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:24.033755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:24.033755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:24.033755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:24.033755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:24.033755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:24.033755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:24.033755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:24.033755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:24.033755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:24.033755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:24.033755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:24.034738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:24.034738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:24.034738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:24.034738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:24.034738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:24.034738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:24.034738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:24.034738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:24.034738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:24.034738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:24.034738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:24.034738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:24.034738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:24.034738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:24.034738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:24.034738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:24.035638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:24.035638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:24.035638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:24.035638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:24.035638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:24.035638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:24.035638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:24.035638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:24.035638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:24.035638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:24.035638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:24.035638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:24.038786 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 347/690] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:24.040067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca66b25-5ab6-428e-8dd9-96f7673a584e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:24.061305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4787ed-532e-41bc-ac0d-840996b4526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:24.064864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4787ed-532e-41bc-ac0d-840996b4526b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:24.064864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4787ed-532e-41bc-ac0d-840996b4526b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:24.064864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4787ed-532e-41bc-ac0d-840996b4526b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:24.079280 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4787ed-532e-41bc-ac0d-840996b4526b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:24.081074 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4787ed-532e-41bc-ac0d-840996b4526b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:24.100623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-ca4787ed-532e-41bc-ac0d-840996b4526b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:24.100623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:24.100623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:24.100623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:24.100623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:24.100623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:24.100623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:24.100623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:24.100623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:24.100623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:24.100623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:24.100623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:24.100623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:24.100623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:24.100623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:24.101844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:24.102968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:24.102968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:24.102968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:24.102968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:24.108656 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 344/691] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:24.108656 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4787ed-532e-41bc-ac0d-840996b4526b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:24.188857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca66b25-5ab6-428e-8dd9-96f7673a584e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:24.212305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4787ed-532e-41bc-ac0d-840996b4526b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:24.232881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b64ca-4832-4369-9a1f-8ce6a58edcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:24.234266 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b64ca-4832-4369-9a1f-8ce6a58edcc9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:24.234702 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b64ca-4832-4369-9a1f-8ce6a58edcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:24.235501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b64ca-4832-4369-9a1f-8ce6a58edcc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:24.245768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:24.250048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b64ca-4832-4369-9a1f-8ce6a58edcc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:24.251534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b64ca-4832-4369-9a1f-8ce6a58edcc9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:24.264369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf97aec-e651-4ed0-9f49-539be7a1db0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:24.265547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf97aec-e651-4ed0-9f49-539be7a1db0f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:24.266087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf97aec-e651-4ed0-9f49-539be7a1db0f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:24.266541 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf97aec-e651-4ed0-9f49-539be7a1db0f None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:24.267481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf97aec-e651-4ed0-9f49-539be7a1db0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:24.267963 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf97aec-e651-4ed0-9f49-539be7a1db0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:24.269565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf97aec-e651-4ed0-9f49-539be7a1db0f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:24.273383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-942b64ca-4832-4369-9a1f-8ce6a58edcc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:24.273383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:24.273383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:24.273383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:24.273383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:24.273383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:24.273383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:24.273383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:24.273383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:24.273383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:24.273383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:24.273383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:24.273383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:24.273383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:24.273383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:24.274277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:24.275324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:24.275324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:24.275324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:24.275324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:24.279664 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 348/692] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:24.280596 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b64ca-4832-4369-9a1f-8ce6a58edcc9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:24.283137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 345/693] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:24.285453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf97aec-e651-4ed0-9f49-539be7a1db0f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:24.305861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:24.399611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf97aec-e651-4ed0-9f49-539be7a1db0f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:24.403573 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b64ca-4832-4369-9a1f-8ce6a58edcc9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:24.439753 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c21470-7683-4e34-8a73-8e597372aa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:24.440417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c21470-7683-4e34-8a73-8e597372aa65 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:24.440678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c21470-7683-4e34-8a73-8e597372aa65 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:24.440957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c21470-7683-4e34-8a73-8e597372aa65 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:24.441731 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c21470-7683-4e34-8a73-8e597372aa65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:24.442038 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c21470-7683-4e34-8a73-8e597372aa65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:24.443473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c21470-7683-4e34-8a73-8e597372aa65 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:24.444651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73effcc2-c5c7-4596-a5d9-25cd52a6c8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:24.445806 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73effcc2-c5c7-4596-a5d9-25cd52a6c8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:24.446864 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73effcc2-c5c7-4596-a5d9-25cd52a6c8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:24.447347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73effcc2-c5c7-4596-a5d9-25cd52a6c8e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:24.448290 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73effcc2-c5c7-4596-a5d9-25cd52a6c8e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:24.448794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73effcc2-c5c7-4596-a5d9-25cd52a6c8e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:24.450395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73effcc2-c5c7-4596-a5d9-25cd52a6c8e2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:24.461682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 346/694] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:24.462334 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c21470-7683-4e34-8a73-8e597372aa65 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:24.470771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 349/695] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:24.470771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73effcc2-c5c7-4596-a5d9-25cd52a6c8e2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:24.520773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:24.570185 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:24.578688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c21470-7683-4e34-8a73-8e597372aa65 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:24.594815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73effcc2-c5c7-4596-a5d9-25cd52a6c8e2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:24.622580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ccf7d-3a7b-40f1-915d-77ef650f0ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:24.623705 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ccf7d-3a7b-40f1-915d-77ef650f0ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:24.624286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ccf7d-3a7b-40f1-915d-77ef650f0ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:24.624710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ccf7d-3a7b-40f1-915d-77ef650f0ee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:24.629839 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d91fc-c11d-4129-b96a-44be6006fa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:24.630613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d91fc-c11d-4129-b96a-44be6006fa9c None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:24.630993 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d91fc-c11d-4129-b96a-44be6006fa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:24.631410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d91fc-c11d-4129-b96a-44be6006fa9c None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:24.632273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d91fc-c11d-4129-b96a-44be6006fa9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:24.634059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d91fc-c11d-4129-b96a-44be6006fa9c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:24.637610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ccf7d-3a7b-40f1-915d-77ef650f0ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:24.639209 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ccf7d-3a7b-40f1-915d-77ef650f0ee1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:24.660557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-7c7ccf7d-3a7b-40f1-915d-77ef650f0ee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:24.660557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:24.660557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:24.660557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:24.660557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:24.660557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:24.660557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:24.660557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:24.660557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:24.660557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:24.660557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:24.660557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:24.660557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:24.660557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:24.660557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:24.661568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:24.662678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:24.662678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:24.662678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:24.662678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:24.662915 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 350/696] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:22:24 2022] POST /identity/v3/users => generated 254 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:24.663535 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d91fc-c11d-4129-b96a-44be6006fa9c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:24.665189 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 347/697] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:24.678486 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ccf7d-3a7b-40f1-915d-77ef650f0ee1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:24.793193 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ccf7d-3a7b-40f1-915d-77ef650f0ee1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:24.795468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:24.835679 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff484149-eec2-4612-b565-f9a1b74eb278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:24.836742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff484149-eec2-4612-b565-f9a1b74eb278 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:24.837227 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff484149-eec2-4612-b565-f9a1b74eb278 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:24.837737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff484149-eec2-4612-b565-f9a1b74eb278 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:24.838742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff484149-eec2-4612-b565-f9a1b74eb278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:24.839273 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff484149-eec2-4612-b565-f9a1b74eb278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:24.840890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff484149-eec2-4612-b565-f9a1b74eb278 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:24.854603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 348/698] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:24.866165 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff484149-eec2-4612-b565-f9a1b74eb278 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:24.912209 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d91fc-c11d-4129-b96a-44be6006fa9c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:24.943358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:24.952215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4cf8f-5d88-4710-8a8a-35c1fac6e957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:24.953617 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4cf8f-5d88-4710-8a8a-35c1fac6e957 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:24.953918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4cf8f-5d88-4710-8a8a-35c1fac6e957 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:24.954206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4cf8f-5d88-4710-8a8a-35c1fac6e957 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:24.961462 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4cf8f-5d88-4710-8a8a-35c1fac6e957 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:24.962911 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4cf8f-5d88-4710-8a8a-35c1fac6e957 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:24.977374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-2bf4cf8f-5d88-4710-8a8a-35c1fac6e957 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:24.977374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:24.977374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:24.977374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:24.977374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:24.977374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:24.977374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:24.977374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:24.977374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:24.977374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:24.977374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:24.977374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:24.977374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:24.977374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:24.977374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:24.978300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:24.979612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:24.979612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:24.979612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:24.979612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:24.979612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:24.979612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:24.979612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:24.979612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:24.979612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 351/699] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:24.984602 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4cf8f-5d88-4710-8a8a-35c1fac6e957 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:24.993104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff484149-eec2-4612-b565-f9a1b74eb278 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:25.028412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e783332-8e2a-479e-a819-3bee8577bd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:25.030048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e783332-8e2a-479e-a819-3bee8577bd21 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:25.030541 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e783332-8e2a-479e-a819-3bee8577bd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:25.031020 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e783332-8e2a-479e-a819-3bee8577bd21 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:25.039266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e783332-8e2a-479e-a819-3bee8577bd21 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:25.040982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e783332-8e2a-479e-a819-3bee8577bd21 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:25.055700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-0e783332-8e2a-479e-a819-3bee8577bd21 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:22:25.055700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:25.055700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:25.055700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:25.055700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:25.055700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:25.055700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:25.055700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:25.055700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:25.055700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:25.055700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:25.055700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:25.055700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:25.055700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:25.055700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:25.055700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:25.056636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:25.057633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:25.057633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:25.057633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:25.057633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:25.057633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:25.057633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:25.057633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:25.057633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:25.057633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:22:25.057633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:25.060291 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 349/700] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 15 00:22:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:25.070969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e783332-8e2a-479e-a819-3bee8577bd21 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:25.093220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4cf8f-5d88-4710-8a8a-35c1fac6e957 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:25.097109 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:25.129105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8efc1-9174-4388-b0e3-1665355d2758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:25.129817 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8efc1-9174-4388-b0e3-1665355d2758 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:25.130095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8efc1-9174-4388-b0e3-1665355d2758 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:25.130367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8efc1-9174-4388-b0e3-1665355d2758 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:25.131158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8efc1-9174-4388-b0e3-1665355d2758 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:25.131518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8efc1-9174-4388-b0e3-1665355d2758 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:25.133086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8efc1-9174-4388-b0e3-1665355d2758 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:25.145233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 352/701] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:25.151219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8efc1-9174-4388-b0e3-1665355d2758 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:25.181198 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e783332-8e2a-479e-a819-3bee8577bd21 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:25.206668 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:25.217064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f6018-c98e-4694-89e1-9af3165926c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:25.217939 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f6018-c98e-4694-89e1-9af3165926c9 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:25.218327 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f6018-c98e-4694-89e1-9af3165926c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:25.218912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f6018-c98e-4694-89e1-9af3165926c9 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:25.219650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f6018-c98e-4694-89e1-9af3165926c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:25.220065 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f6018-c98e-4694-89e1-9af3165926c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:25.221642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f6018-c98e-4694-89e1-9af3165926c9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:25.240844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 350/702] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 15 00:22:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:25.246033 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f6018-c98e-4694-89e1-9af3165926c9 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:25.261555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8efc1-9174-4388-b0e3-1665355d2758 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:25.298285 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a8af9-e101-46dd-b371-52b58498ad48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:25.299210 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a8af9-e101-46dd-b371-52b58498ad48 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:25.299659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a8af9-e101-46dd-b371-52b58498ad48 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:25.300064 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a8af9-e101-46dd-b371-52b58498ad48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:25.301097 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a8af9-e101-46dd-b371-52b58498ad48 None admin] RBAC: Adding query filter params (role.id=4afb8bd8c6354dd9b143ef4aaa8284fa, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=ff27c57c1d1b4f4ab1a030995db2e63a) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:25.301635 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a8af9-e101-46dd-b371-52b58498ad48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:25.303252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a8af9-e101-46dd-b371-52b58498ad48 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:25.310299 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 353/703] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:25 2022] GET /identity/v3/role_assignments?user.id=ff27c57c1d1b4f4ab1a030995db2e63a&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=4afb8bd8c6354dd9b143ef4aaa8284fa => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:25.347203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:25.369961 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f6018-c98e-4694-89e1-9af3165926c9 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:25.409041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb3cbe-b7d0-4666-acc4-6d57d420ee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:25.409915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb3cbe-b7d0-4666-acc4-6d57d420ee8d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:25.410304 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb3cbe-b7d0-4666-acc4-6d57d420ee8d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:25.410686 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb3cbe-b7d0-4666-acc4-6d57d420ee8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:25.483953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb3cbe-b7d0-4666-acc4-6d57d420ee8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:25.485497 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb3cbe-b7d0-4666-acc4-6d57d420ee8d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:25.572194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:25.592954 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 351/704] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 15 00:22:25.598224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a8af9-e101-46dd-b371-52b58498ad48 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:25.707735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a8af9-e101-46dd-b371-52b58498ad48 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:25.724934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:25.744515 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec7516-4948-45ba-8431-b7d3703482be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:25.745708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec7516-4948-45ba-8431-b7d3703482be None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:25.746215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec7516-4948-45ba-8431-b7d3703482be None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:25.746683 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec7516-4948-45ba-8431-b7d3703482be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:25.758175 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec7516-4948-45ba-8431-b7d3703482be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:25.759962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec7516-4948-45ba-8431-b7d3703482be None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:25.778349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-9eec7516-4948-45ba-8431-b7d3703482be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:25.778349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:25.778349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:25.778349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:25.778349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:25.778349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:25.778349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:25.778349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:25.778349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:25.778349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:25.778349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:25.778349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:25.778349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:25.778349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:25.778349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:25.779300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:25.780206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:25.780206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:25.780206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:25.780206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:25.782547 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 354/705] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:25.787865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb3cbe-b7d0-4666-acc4-6d57d420ee8d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:25.905231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb3cbe-b7d0-4666-acc4-6d57d420ee8d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:25.945447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff654c-3b17-410e-93e0-0fde53756bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:25.946503 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff654c-3b17-410e-93e0-0fde53756bda None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:25.946983 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff654c-3b17-410e-93e0-0fde53756bda None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:25.947453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff654c-3b17-410e-93e0-0fde53756bda None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:25.948400 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff654c-3b17-410e-93e0-0fde53756bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:25.948900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff654c-3b17-410e-93e0-0fde53756bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:25.950526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff654c-3b17-410e-93e0-0fde53756bda None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:25.965140 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45501b5-c8c0-4a6a-bfe6-a54c4368d0e9 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:25.966014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45501b5-c8c0-4a6a-bfe6-a54c4368d0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:25.966458 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45501b5-c8c0-4a6a-bfe6-a54c4368d0e9 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:25.967965 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 355/706] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:25.969087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 352/707] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:25.973397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7615d-8864-41df-b31b-f67816088909 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:25.973696 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7615d-8864-41df-b31b-f67816088909 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:25.973980 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7615d-8864-41df-b31b-f67816088909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:25.978345 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff654c-3b17-410e-93e0-0fde53756bda None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:25.997894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e7d7615d-8864-41df-b31b-f67816088909 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:25.999595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e7d7615d-8864-41df-b31b-f67816088909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:26.036763 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:26.116892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 356/708] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:26.119039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5eb91-8b5f-4d22-8d65-e9862fe8de85 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:26.119344 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5eb91-8b5f-4d22-8d65-e9862fe8de85 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:26.119900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5eb91-8b5f-4d22-8d65-e9862fe8de85 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:26.125570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 357/709] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:26.127391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f543c-5466-4ac3-84f5-d93b62486521 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:26.127690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f543c-5466-4ac3-84f5-d93b62486521 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:26.128075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f543c-5466-4ac3-84f5-d93b62486521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:26.131072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff654c-3b17-410e-93e0-0fde53756bda None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:26.154087 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c06f543c-5466-4ac3-84f5-d93b62486521 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:26.155435 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c06f543c-5466-4ac3-84f5-d93b62486521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:26.166158 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574255b-b655-4a26-85ec-f7d044283724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:26.167032 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574255b-b655-4a26-85ec-f7d044283724 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:26.167312 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574255b-b655-4a26-85ec-f7d044283724 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:26.167584 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574255b-b655-4a26-85ec-f7d044283724 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:26.174816 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574255b-b655-4a26-85ec-f7d044283724 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:26.176425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574255b-b655-4a26-85ec-f7d044283724 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:26.191228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-2574255b-b655-4a26-85ec-f7d044283724 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:26.191228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:26.191228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:26.191228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:26.191228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:26.191228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:26.191228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:26.191228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:26.191228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:26.191228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:26.191228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:26.191228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:26.191228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:26.191228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:26.191228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:26.192217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:26.193402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:26.193402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:26.193402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:26.193402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:26.193402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:26.193402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:26.193402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:26.193402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:26.193402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 353/710] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:26.194136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574255b-b655-4a26-85ec-f7d044283724 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:26.241520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 358/711] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 15 00:22:26.242939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f543c-5466-4ac3-84f5-d93b62486521 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:26.286249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:26.297015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:26.299772 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574255b-b655-4a26-85ec-f7d044283724 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:26.336212 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a3505-7697-46d1-b279-0944028fbf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:26.337167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a3505-7697-46d1-b279-0944028fbf1e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:26.337562 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a3505-7697-46d1-b279-0944028fbf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:26.337879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a3505-7697-46d1-b279-0944028fbf1e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:26.338624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a3505-7697-46d1-b279-0944028fbf1e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:26.340264 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a3505-7697-46d1-b279-0944028fbf1e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:26.366162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-188a3505-7697-46d1-b279-0944028fbf1e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:22:26.366162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:26.366162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:26.366162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:26.366162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:26.366162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:26.366162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:26.366162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:26.366162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:22:26.366162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:26.366162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:26.366162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:26.366162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:26.366162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:26.366162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:26.366162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:26.367570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:26.367570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:26.367570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:26.367570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:26.367570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:26.367570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:26.367570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:26.367570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:26.367570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:26.367570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:26.367570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:26.367570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:26.367570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:26.367570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:26.367570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:26.367570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:26.368695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:26.368695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:26.368695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:26.368695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:26.368695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:26.368695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:26.368695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:26.368695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:26.368695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:26.368695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:26.368695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:26.368695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:26.368695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:26.368695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:22:26.368695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:26.376628 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 354/712] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Jun 15 00:22:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:26.376628 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a3505-7697-46d1-b279-0944028fbf1e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:26.383364 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f543c-5466-4ac3-84f5-d93b62486521 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:26.422639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa8f6d-e891-42aa-842b-3ed8898267b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:26.423843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa8f6d-e891-42aa-842b-3ed8898267b1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:26.424670 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa8f6d-e891-42aa-842b-3ed8898267b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:26.425154 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa8f6d-e891-42aa-842b-3ed8898267b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:26.426318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa8f6d-e891-42aa-842b-3ed8898267b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:26.426927 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa8f6d-e891-42aa-842b-3ed8898267b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:26.428651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa8f6d-e891-42aa-842b-3ed8898267b1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:26.443388 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 359/713] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:26.444734 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa8f6d-e891-42aa-842b-3ed8898267b1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:26.482930 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a3505-7697-46d1-b279-0944028fbf1e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:26.517810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06861b5d-9f46-4169-a45b-7a2155ba92b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:26.518676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06861b5d-9f46-4169-a45b-7a2155ba92b1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:26.518963 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06861b5d-9f46-4169-a45b-7a2155ba92b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:26.519239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06861b5d-9f46-4169-a45b-7a2155ba92b1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:26.520202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06861b5d-9f46-4169-a45b-7a2155ba92b1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:26.521426 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06861b5d-9f46-4169-a45b-7a2155ba92b1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-06861b5d-9f46-4169-a45b-7a2155ba92b1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:26.533789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:26.534817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:26.534817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:26.534817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:26.534817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:26.534817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:26.534817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:26.534817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:26.534817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:26.534817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:26.534817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:26.534817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:26.534817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:26.534817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:26.534817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:26.534817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:26.534817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:26.535675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:26.535675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:26.535675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:26.535675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:26.535675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:26.535675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:26.535675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:26.535675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:26.535675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:26.535675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:26.535675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:26.535675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:26.535675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:22:26.535675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:26.539685 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 355/714] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:26 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:26.540532 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06861b5d-9f46-4169-a45b-7a2155ba92b1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:26.548732 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:26.564121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa8f6d-e891-42aa-842b-3ed8898267b1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:26.569567 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:26.601857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585a81e-039d-4248-af3d-632c19fc7d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:26.602919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585a81e-039d-4248-af3d-632c19fc7d2a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:26.603441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585a81e-039d-4248-af3d-632c19fc7d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:26.603931 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585a81e-039d-4248-af3d-632c19fc7d2a None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:26.604845 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585a81e-039d-4248-af3d-632c19fc7d2a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:26.605373 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585a81e-039d-4248-af3d-632c19fc7d2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:26.606953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585a81e-039d-4248-af3d-632c19fc7d2a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:26.617220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 360/715] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Jun 15 00:22:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:26.618370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585a81e-039d-4248-af3d-632c19fc7d2a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:26.643463 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06861b5d-9f46-4169-a45b-7a2155ba92b1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:26.678150 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cf12a-37d3-4083-83a1-6289504be1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:26.678720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cf12a-37d3-4083-83a1-6289504be1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:26.679104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cf12a-37d3-4083-83a1-6289504be1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:26.679379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cf12a-37d3-4083-83a1-6289504be1e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:26.680426 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cf12a-37d3-4083-83a1-6289504be1e2 None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=6d0ae1707c7041a0989889dbefeaf267) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:26.680555 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cf12a-37d3-4083-83a1-6289504be1e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:26.682027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cf12a-37d3-4083-83a1-6289504be1e2 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:26.688289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 356/716] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:26 2022] GET /identity/v3/role_assignments?user.id=6d0ae1707c7041a0989889dbefeaf267&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:26.689094 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cf12a-37d3-4083-83a1-6289504be1e2 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:26.730292 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585a81e-039d-4248-af3d-632c19fc7d2a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:26.769386 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfa60a-e58d-42a2-b2ff-4f8566b03e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:26.770685 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfa60a-e58d-42a2-b2ff-4f8566b03e8b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:26.771202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfa60a-e58d-42a2-b2ff-4f8566b03e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:26.771681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfa60a-e58d-42a2-b2ff-4f8566b03e8b None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:26.772700 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfa60a-e58d-42a2-b2ff-4f8566b03e8b None admin] RBAC: Adding query filter params (name=network) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:26.773319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfa60a-e58d-42a2-b2ff-4f8566b03e8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:26.775109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfa60a-e58d-42a2-b2ff-4f8566b03e8b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:26.780834 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 361/717] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 15 00:22:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:26.792784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfa60a-e58d-42a2-b2ff-4f8566b03e8b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:26.800897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:26.822933 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cf12a-37d3-4083-83a1-6289504be1e2 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:26.843500 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:26.886404 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ac87e-2f53-40f7-b88d-7bb47a7195b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:26.887098 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ac87e-2f53-40f7-b88d-7bb47a7195b1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:26.890061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ac87e-2f53-40f7-b88d-7bb47a7195b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:26.890061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ac87e-2f53-40f7-b88d-7bb47a7195b1 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:26.890741 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ac87e-2f53-40f7-b88d-7bb47a7195b1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:26.891048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ac87e-2f53-40f7-b88d-7bb47a7195b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:26.894494 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ac87e-2f53-40f7-b88d-7bb47a7195b1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:26.905660 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 357/718] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Jun 15 00:22:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:26.972752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfa60a-e58d-42a2-b2ff-4f8566b03e8b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:27.013571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd95d5-23ec-418a-b0c2-2ad321eb1934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:27.014684 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd95d5-23ec-418a-b0c2-2ad321eb1934 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.015176 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd95d5-23ec-418a-b0c2-2ad321eb1934 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.015675 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd95d5-23ec-418a-b0c2-2ad321eb1934 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.016608 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd95d5-23ec-418a-b0c2-2ad321eb1934 None admin] RBAC: Adding query filter params (type=network) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:27.017122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd95d5-23ec-418a-b0c2-2ad321eb1934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:27.018780 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd95d5-23ec-418a-b0c2-2ad321eb1934 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:27.026510 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 362/719] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 15 00:22:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:27.474487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760288cb-3beb-458c-9a62-4ad2ad35485d None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.475489 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760288cb-3beb-458c-9a62-4ad2ad35485d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.476140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760288cb-3beb-458c-9a62-4ad2ad35485d None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.478194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 358/720] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:27.483102 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863dfe6-96d8-4b4c-b07b-982cae1afad6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.483638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863dfe6-96d8-4b4c-b07b-982cae1afad6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.484118 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863dfe6-96d8-4b4c-b07b-982cae1afad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.506250 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3863dfe6-96d8-4b4c-b07b-982cae1afad6 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:27.507922 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3863dfe6-96d8-4b4c-b07b-982cae1afad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:27.598443 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 363/721] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:27.628984 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760288cb-3beb-458c-9a62-4ad2ad35485d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:27.759208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760288cb-3beb-458c-9a62-4ad2ad35485d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:27.801096 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900a08f-96b5-4a30-912d-0905bf77dccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:27.802366 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900a08f-96b5-4a30-912d-0905bf77dccf None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.802898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900a08f-96b5-4a30-912d-0905bf77dccf None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.803431 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900a08f-96b5-4a30-912d-0905bf77dccf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.819933 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900a08f-96b5-4a30-912d-0905bf77dccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:27.828175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-1900a08f-96b5-4a30-912d-0905bf77dccf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:27.828175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:27.828175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:27.828175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:27.828175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:27.828175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:27.828175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:27.828175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:27.828175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:27.828175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:27.828175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:27.828175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:27.828175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:27.828175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:27.828175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:27.828175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:27.829120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:27.829120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:27.829120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:27.829120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:27.829120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:27.829120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:27.829120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:27.829120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:27.829120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:27.829120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:27.829120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:27.829120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:27.829120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:27.829120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:27.829120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:27.829120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:27.830028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:27.830028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:27.830028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:27.830028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:27.830028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:27.830028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:27.830028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:27.830028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:27.830028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:27.830028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:27.830028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:27.830028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:27.837425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 359/722] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:27.842879 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863dfe6-96d8-4b4c-b07b-982cae1afad6 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:27.855549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:27.948520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863dfe6-96d8-4b4c-b07b-982cae1afad6 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:27.988871 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd212a1-33c9-4e64-93c6-403a39397010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:27.990811 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd212a1-33c9-4e64-93c6-403a39397010 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:27.991532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd212a1-33c9-4e64-93c6-403a39397010 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:27.992025 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd212a1-33c9-4e64-93c6-403a39397010 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:27.993017 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd212a1-33c9-4e64-93c6-403a39397010 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:27.993640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd212a1-33c9-4e64-93c6-403a39397010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:27.995244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd212a1-33c9-4e64-93c6-403a39397010 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:28.010007 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900a08f-96b5-4a30-912d-0905bf77dccf None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:28.010728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 364/723] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:28.032451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:28.167947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900a08f-96b5-4a30-912d-0905bf77dccf None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:28.216869 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc52ab-6e01-45f6-ad41-ab11f11f9581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:28.217716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc52ab-6e01-45f6-ad41-ab11f11f9581 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.217999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc52ab-6e01-45f6-ad41-ab11f11f9581 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.218283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc52ab-6e01-45f6-ad41-ab11f11f9581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.239298 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc52ab-6e01-45f6-ad41-ab11f11f9581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:28.241130 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc52ab-6e01-45f6-ad41-ab11f11f9581 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:28.264533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a2bc52ab-6e01-45f6-ad41-ab11f11f9581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:28.264533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:28.264533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:28.264533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:28.264533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:28.264533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:28.264533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:28.264533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:28.264533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:28.264533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:28.264533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:28.264533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:28.264533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:28.264533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:28.264533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:28.265487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:28.267068 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:28.267068 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:28.267068 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:28.267068 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:28.267068 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 360/724] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:28.271957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd212a1-33c9-4e64-93c6-403a39397010 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:28.377472 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:28.413920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097e9de-acc5-4554-8afc-d5ae22fc5139 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.414565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097e9de-acc5-4554-8afc-d5ae22fc5139 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.415037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097e9de-acc5-4554-8afc-d5ae22fc5139 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.416165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd212a1-33c9-4e64-93c6-403a39397010 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:28.417121 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 361/725] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:28.434831 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b04bf-6f67-44bf-a643-f9692d273ee6 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.435433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b04bf-6f67-44bf-a643-f9692d273ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.435905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b04bf-6f67-44bf-a643-f9692d273ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.454726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7840a1-4e3f-48d4-bbd6-17da93b539dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:28.455408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7840a1-4e3f-48d4-bbd6-17da93b539dd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.455696 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7840a1-4e3f-48d4-bbd6-17da93b539dd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.455978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7840a1-4e3f-48d4-bbd6-17da93b539dd None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.456706 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7840a1-4e3f-48d4-bbd6-17da93b539dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:28.457019 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7840a1-4e3f-48d4-bbd6-17da93b539dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:28.465364 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7840a1-4e3f-48d4-bbd6-17da93b539dd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:28.471060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a87b04bf-6f67-44bf-a643-f9692d273ee6 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:28.471186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 365/726] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:28.472564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a87b04bf-6f67-44bf-a643-f9692d273ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:28.481146 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7840a1-4e3f-48d4-bbd6-17da93b539dd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:28.590844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:28.594816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7840a1-4e3f-48d4-bbd6-17da93b539dd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:28.610497 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 362/727] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:28.642337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:28.648561 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912b4dc-c53a-41ba-8340-86e0d54bdc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:28.649055 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b04bf-6f67-44bf-a643-f9692d273ee6 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:28.649992 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912b4dc-c53a-41ba-8340-86e0d54bdc50 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.650470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912b4dc-c53a-41ba-8340-86e0d54bdc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.654572 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912b4dc-c53a-41ba-8340-86e0d54bdc50 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.665551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912b4dc-c53a-41ba-8340-86e0d54bdc50 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:28.667307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912b4dc-c53a-41ba-8340-86e0d54bdc50 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:28.687345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-2912b4dc-c53a-41ba-8340-86e0d54bdc50 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:22:28.687345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:28.687345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:28.687345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:28.687345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:28.687345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:28.687345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:28.687345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:28.687345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:28.687345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:28.687345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:28.687345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:28.687345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:28.687345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:28.687345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:28.687345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:28.688311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:28.689243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:28.689243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:28.689243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:28.689243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:28.689243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:28.689243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:28.689243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:28.689243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:28.689243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:22:28.689243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:28.695161 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 366/728] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 15 00:22:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:28.700896 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912b4dc-c53a-41ba-8340-86e0d54bdc50 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:28.756593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b04bf-6f67-44bf-a643-f9692d273ee6 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:28.794491 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f5cc7-3214-4b74-924c-719ac00f54ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:28.795837 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f5cc7-3214-4b74-924c-719ac00f54ab None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.797235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f5cc7-3214-4b74-924c-719ac00f54ab None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.797721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f5cc7-3214-4b74-924c-719ac00f54ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.809037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f5cc7-3214-4b74-924c-719ac00f54ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:28.818511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-381f5cc7-3214-4b74-924c-719ac00f54ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:28.818511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:28.818511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:28.818511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:28.818511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:28.818511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:28.818511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:28.818511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:28.818511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:28.818511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:28.818511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:28.818511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:28.818511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:28.818511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:28.818511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:28.818511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:28.819728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:28.819728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:28.819728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:28.819728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:28.819728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:28.819728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:28.819728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:28.819728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:28.819728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:28.819728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:28.819728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:28.819728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:28.819728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:28.819728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:28.819728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:28.819728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:28.820810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:28.820810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:28.820810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:28.820810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:28.820810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:28.820810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:28.820810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:28.820810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:28.820810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:28.820810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:28.820810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:28.820810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:28.823268 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 363/729] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:28.829140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f5cc7-3214-4b74-924c-719ac00f54ab None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:28.885894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912b4dc-c53a-41ba-8340-86e0d54bdc50 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:28.922866 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc971c8d-866f-4ac3-b76e-c4fae1f037f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:28.929372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc971c8d-866f-4ac3-b76e-c4fae1f037f5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:28.929372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc971c8d-866f-4ac3-b76e-c4fae1f037f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:28.929372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc971c8d-866f-4ac3-b76e-c4fae1f037f5 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:28.929372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc971c8d-866f-4ac3-b76e-c4fae1f037f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:28.929372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc971c8d-866f-4ac3-b76e-c4fae1f037f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:28.929372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc971c8d-866f-4ac3-b76e-c4fae1f037f5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:28.948506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 367/730] 10.222.0.36 () {56 vars in 1149 bytes} [Wed Jun 15 00:22:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:28.958564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc971c8d-866f-4ac3-b76e-c4fae1f037f5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:28.993749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:28.999752 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f5cc7-3214-4b74-924c-719ac00f54ab None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:29.050118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8c32a-cf5a-4c78-b64e-2e37b1ca3a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:29.050824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8c32a-cf5a-4c78-b64e-2e37b1ca3a8e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.051109 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8c32a-cf5a-4c78-b64e-2e37b1ca3a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.051388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8c32a-cf5a-4c78-b64e-2e37b1ca3a8e None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.052157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8c32a-cf5a-4c78-b64e-2e37b1ca3a8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:29.052470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8c32a-cf5a-4c78-b64e-2e37b1ca3a8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:29.053940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e8c32a-cf5a-4c78-b64e-2e37b1ca3a8e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:29.073808 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 364/731] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:29.074348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:29.080554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8c32a-cf5a-4c78-b64e-2e37b1ca3a8e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:29.132917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc971c8d-866f-4ac3-b76e-c4fae1f037f5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:29.201759 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c3b50-3435-4cf9-a01a-bf4c20d194eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:29.203167 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c3b50-3435-4cf9-a01a-bf4c20d194eb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.203834 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c3b50-3435-4cf9-a01a-bf4c20d194eb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.206651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c3b50-3435-4cf9-a01a-bf4c20d194eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.284364 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e8c32a-cf5a-4c78-b64e-2e37b1ca3a8e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:29.333738 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:29.341678 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c3b50-3435-4cf9-a01a-bf4c20d194eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:29.343303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c3b50-3435-4cf9-a01a-bf4c20d194eb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:29.348980 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e529da-ebb9-4e2a-a37c-56aa24537fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:29.350037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e529da-ebb9-4e2a-a37c-56aa24537fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.350460 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e529da-ebb9-4e2a-a37c-56aa24537fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.350904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e529da-ebb9-4e2a-a37c-56aa24537fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.365545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e529da-ebb9-4e2a-a37c-56aa24537fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:29.368090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e529da-ebb9-4e2a-a37c-56aa24537fd3 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:29.387028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-01e529da-ebb9-4e2a-a37c-56aa24537fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:29.387028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:29.387028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:29.387028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:29.387028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:29.387028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:29.387028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:29.387028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:29.387028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:29.387028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:29.387028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:29.387028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:29.387028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:29.387028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:29.387028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:29.388183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:29.389283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:29.389283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:29.389283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:29.389283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:29.390920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 365/732] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:29.392275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9157f7a-9b1a-45b1-ae9c-78789955d7f1 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.397079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9157f7a-9b1a-45b1-ae9c-78789955d7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.397559 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9157f7a-9b1a-45b1-ae9c-78789955d7f1 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.403156 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 366/733] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:29.403156 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9157f7a-9b1a-45b1-ae9c-78789955d7f1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:29.406559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:29.469786 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 368/734] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 15 00:22:29.471837 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb73786-4f4e-4dd5-bfba-f74f46102c58 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.472286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb73786-4f4e-4dd5-bfba-f74f46102c58 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.472721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb73786-4f4e-4dd5-bfba-f74f46102c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.491782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2fb73786-4f4e-4dd5-bfba-f74f46102c58 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:29.493509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2fb73786-4f4e-4dd5-bfba-f74f46102c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:29.535677 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9157f7a-9b1a-45b1-ae9c-78789955d7f1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:29.564067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 369/735] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:29.565239 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb73786-4f4e-4dd5-bfba-f74f46102c58 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:29.575010 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c809872-f105-41be-9135-73b88112d92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:29.575771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c809872-f105-41be-9135-73b88112d92c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.576121 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c809872-f105-41be-9135-73b88112d92c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.576467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c809872-f105-41be-9135-73b88112d92c None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.577281 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c809872-f105-41be-9135-73b88112d92c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:29.577682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c809872-f105-41be-9135-73b88112d92c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:29.579125 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c809872-f105-41be-9135-73b88112d92c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:29.592298 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 367/736] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:29.593844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badb796-f23e-4406-bced-86a127946f7f None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.594201 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badb796-f23e-4406-bced-86a127946f7f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.594541 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badb796-f23e-4406-bced-86a127946f7f None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.597393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 368/737] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:29.597393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badb796-f23e-4406-bced-86a127946f7f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:29.630664 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:29.663147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:29.686956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb73786-4f4e-4dd5-bfba-f74f46102c58 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:29.716421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badb796-f23e-4406-bced-86a127946f7f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:29.722532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70666a18-ed6e-4dca-a1ed-34b0b74a56d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:29.723282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70666a18-ed6e-4dca-a1ed-34b0b74a56d2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.723565 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70666a18-ed6e-4dca-a1ed-34b0b74a56d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.724238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70666a18-ed6e-4dca-a1ed-34b0b74a56d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.735448 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70666a18-ed6e-4dca-a1ed-34b0b74a56d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:29.736916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70666a18-ed6e-4dca-a1ed-34b0b74a56d2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:29.750833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec81bb-bae0-4dd9-9913-6a4574898964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:29.751642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec81bb-bae0-4dd9-9913-6a4574898964 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.751925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec81bb-bae0-4dd9-9913-6a4574898964 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.752202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec81bb-bae0-4dd9-9913-6a4574898964 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.754812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-70666a18-ed6e-4dca-a1ed-34b0b74a56d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:29.754812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:29.754812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:29.754812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:29.754812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:29.754812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:29.754812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:29.754812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:29.754812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:29.754812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:29.754812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:29.754812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:29.754812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:29.754812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:29.754812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:29.755875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:29.757215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:29.757215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:29.757215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:29.757215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:29.757215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 370/738] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:29.757215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70666a18-ed6e-4dca-a1ed-34b0b74a56d2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:29.767059 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec81bb-bae0-4dd9-9913-6a4574898964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:29.775451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-cfec81bb-bae0-4dd9-9913-6a4574898964 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:29.775451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:29.775451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:29.775451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:29.775451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:29.775451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:29.775451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:29.775451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:29.775451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:29.775451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:29.775451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:29.775451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:29.775451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:29.775451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:29.775451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:29.775451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:29.776593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:29.776593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:29.776593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:29.776593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:29.776593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:29.776593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:29.776593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:29.776593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:29.776593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:29.776593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:29.776593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:29.776593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:29.776593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:29.776593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:29.776593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:29.776593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:29.777721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:29.777721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:29.777721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:29.777721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:29.777721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:29.777721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:29.777721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:29.777721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:29.777721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:29.777721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:29.777721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:29.777721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:29.777721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 369/739] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:29.778622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b5929-e731-4470-84e2-d185ec63aea3 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.778622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b5929-e731-4470-84e2-d185ec63aea3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.778622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b5929-e731-4470-84e2-d185ec63aea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.794846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-964b5929-e731-4470-84e2-d185ec63aea3 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:29.796203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-964b5929-e731-4470-84e2-d185ec63aea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:29.860190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70666a18-ed6e-4dca-a1ed-34b0b74a56d2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:29.862582 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 370/740] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:29.863891 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ee953-7a41-4f05-b596-f0f502e3fd44 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.864181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ee953-7a41-4f05-b596-f0f502e3fd44 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.864459 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ee953-7a41-4f05-b596-f0f502e3fd44 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.866283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 371/741] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:29.866837 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ee953-7a41-4f05-b596-f0f502e3fd44 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:29.890553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:29.896905 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:29.902870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ce46a-6d24-42fa-81f2-6236a1e2605e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:29.903690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ce46a-6d24-42fa-81f2-6236a1e2605e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:29.903979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ce46a-6d24-42fa-81f2-6236a1e2605e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:29.904259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ce46a-6d24-42fa-81f2-6236a1e2605e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:29.911311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ce46a-6d24-42fa-81f2-6236a1e2605e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:29.912778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ce46a-6d24-42fa-81f2-6236a1e2605e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:29.926979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-983ce46a-6d24-42fa-81f2-6236a1e2605e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:22:29.926979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:29.926979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:29.926979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:29.926979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:29.926979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:29.926979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:29.926979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:29.926979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:29.926979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:29.926979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:29.926979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:29.926979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:29.926979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:29.926979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:29.926979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:29.927959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:29.928947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:29.928947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:29.928947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:29.928947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:29.928947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:29.928947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:29.928947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:29.928947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:29.928947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:22:29.928947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:29.928947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 371/742] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:29.929583 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ce46a-6d24-42fa-81f2-6236a1e2605e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:29.968680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ee953-7a41-4f05-b596-f0f502e3fd44 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:30.005005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc848ab-2780-4993-ac53-ba9d3ed31748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:30.005765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc848ab-2780-4993-ac53-ba9d3ed31748 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.006232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc848ab-2780-4993-ac53-ba9d3ed31748 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.006519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc848ab-2780-4993-ac53-ba9d3ed31748 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.007310 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc848ab-2780-4993-ac53-ba9d3ed31748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:30.007658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc848ab-2780-4993-ac53-ba9d3ed31748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:30.009520 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc848ab-2780-4993-ac53-ba9d3ed31748 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:30.021097 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 372/743] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:30.022465 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e367e-21b0-44a0-85b3-f718f6d64098 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.022760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e367e-21b0-44a0-85b3-f718f6d64098 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.023043 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e367e-21b0-44a0-85b3-f718f6d64098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.038973 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-824e367e-21b0-44a0-85b3-f718f6d64098 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:30.039158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ce46a-6d24-42fa-81f2-6236a1e2605e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:30.040174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-824e367e-21b0-44a0-85b3-f718f6d64098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:30.078216 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42557857-7317-4eae-be32-ef5d2a7a3caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:30.079396 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42557857-7317-4eae-be32-ef5d2a7a3caf None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.079560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42557857-7317-4eae-be32-ef5d2a7a3caf None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.079845 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42557857-7317-4eae-be32-ef5d2a7a3caf None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.080979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42557857-7317-4eae-be32-ef5d2a7a3caf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:30.081239 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42557857-7317-4eae-be32-ef5d2a7a3caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:30.083648 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42557857-7317-4eae-be32-ef5d2a7a3caf None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:30.093052 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 372/744] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:30.093895 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42557857-7317-4eae-be32-ef5d2a7a3caf None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:30.116651 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 373/745] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 15 00:22:30.117558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e367e-21b0-44a0-85b3-f718f6d64098 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:30.133907 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:30.165327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:30.214921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42557857-7317-4eae-be32-ef5d2a7a3caf None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:30.230514 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e367e-21b0-44a0-85b3-f718f6d64098 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:30.249328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcce9dd-759d-413a-831a-962650b50e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:30.250069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcce9dd-759d-413a-831a-962650b50e25 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.250356 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcce9dd-759d-413a-831a-962650b50e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.250603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcce9dd-759d-413a-831a-962650b50e25 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.251366 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcce9dd-759d-413a-831a-962650b50e25 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:30.252738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcce9dd-759d-413a-831a-962650b50e25 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:30.265065 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc1961-0c47-469a-91f1-231b675e5c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:30.265722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc1961-0c47-469a-91f1-231b675e5c8b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.266005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc1961-0c47-469a-91f1-231b675e5c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.266286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc1961-0c47-469a-91f1-231b675e5c8b None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.267142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc1961-0c47-469a-91f1-231b675e5c8b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:30.267454 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc1961-0c47-469a-91f1-231b675e5c8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:30.268298 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 373/746] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 15 00:22:30 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:30.269011 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc1961-0c47-469a-91f1-231b675e5c8b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:30.269207 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcce9dd-759d-413a-831a-962650b50e25 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:30.298499 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 374/747] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Jun 15 00:22:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:30.299691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc1961-0c47-469a-91f1-231b675e5c8b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:30.376009 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:30.402328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcce9dd-759d-413a-831a-962650b50e25 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:30.410609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc1961-0c47-469a-91f1-231b675e5c8b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:30.415603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:30.442734 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d584f-54e4-4b71-accc-e5a2a8b5fa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:30.443567 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d584f-54e4-4b71-accc-e5a2a8b5fa01 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.443856 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d584f-54e4-4b71-accc-e5a2a8b5fa01 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.444137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d584f-54e4-4b71-accc-e5a2a8b5fa01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.451132 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d584f-54e4-4b71-accc-e5a2a8b5fa01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:30.452589 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e0799-aaa0-4ee4-a9dc-4cb71d66e7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:30.452722 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d584f-54e4-4b71-accc-e5a2a8b5fa01 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:30.453436 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e0799-aaa0-4ee4-a9dc-4cb71d66e7ef None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.453722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e0799-aaa0-4ee4-a9dc-4cb71d66e7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.453999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e0799-aaa0-4ee4-a9dc-4cb71d66e7ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.464773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e0799-aaa0-4ee4-a9dc-4cb71d66e7ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:30.466274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e0799-aaa0-4ee4-a9dc-4cb71d66e7ef None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:30.466483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-8c8d584f-54e4-4b71-accc-e5a2a8b5fa01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:30.466483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:30.466483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:30.466483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:30.466483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:30.466483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:30.466483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:30.466483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:30.466483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:30.466483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:30.466483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:30.466483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:30.466483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:30.466483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:30.466483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:30.467318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:30.468218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:30.468218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:30.468218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:30.468218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:30.468218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:30.468218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:30.468218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:30.468218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:30.468218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 374/748] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:30.468707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d584f-54e4-4b71-accc-e5a2a8b5fa01 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:30.491262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-eb1e0799-aaa0-4ee4-a9dc-4cb71d66e7ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:30.491262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:30.491262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:30.491262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:30.491262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:30.491262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:30.491262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:30.491262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:30.491262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:30.491262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:30.491262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:30.491262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:30.491262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:30.491262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:30.491262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:30.492434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:30.493609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:30.493609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:30.493609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:30.493609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:30.493609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 375/749] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:30.493609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e0799-aaa0-4ee4-a9dc-4cb71d66e7ef None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:30.574644 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d584f-54e4-4b71-accc-e5a2a8b5fa01 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:30.603367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e0799-aaa0-4ee4-a9dc-4cb71d66e7ef None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:30.608764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48dc51-9dab-4778-9d6e-490e74b2422d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:30.609482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48dc51-9dab-4778-9d6e-490e74b2422d None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.609768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48dc51-9dab-4778-9d6e-490e74b2422d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.610044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48dc51-9dab-4778-9d6e-490e74b2422d None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.610762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48dc51-9dab-4778-9d6e-490e74b2422d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:30.612207 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48dc51-9dab-4778-9d6e-490e74b2422d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:30.627686 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 375/750] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 15 00:22:30 2022] POST /identity/v3/services => generated 251 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:30.629013 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48dc51-9dab-4778-9d6e-490e74b2422d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:30.637664 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:30.649046 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03833f-cdc2-400e-afee-01a127782916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:30.649922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03833f-cdc2-400e-afee-01a127782916 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.650206 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03833f-cdc2-400e-afee-01a127782916 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.650483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03833f-cdc2-400e-afee-01a127782916 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.674105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:30.742373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03833f-cdc2-400e-afee-01a127782916 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:30.743990 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03833f-cdc2-400e-afee-01a127782916 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:30.781677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48dc51-9dab-4778-9d6e-490e74b2422d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:30.832908 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2b0f5-3cb2-406d-92dd-4dfcbec658d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:30.834758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2b0f5-3cb2-406d-92dd-4dfcbec658d1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:30.834758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2b0f5-3cb2-406d-92dd-4dfcbec658d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:30.834758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2b0f5-3cb2-406d-92dd-4dfcbec658d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:30.835064 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2b0f5-3cb2-406d-92dd-4dfcbec658d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:30.835266 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2b0f5-3cb2-406d-92dd-4dfcbec658d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:30.836727 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2b0f5-3cb2-406d-92dd-4dfcbec658d1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:30.851139 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 376/751] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:30.852108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2b0f5-3cb2-406d-92dd-4dfcbec658d1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:30.868594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 376/752] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:22:30.869900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03833f-cdc2-400e-afee-01a127782916 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:30.890999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:30.969785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:30.981564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2b0f5-3cb2-406d-92dd-4dfcbec658d1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:30.990977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03833f-cdc2-400e-afee-01a127782916 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:31.023370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b18543-f2f9-47a3-bcbc-1c5e828a0af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:31.024189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b18543-f2f9-47a3-bcbc-1c5e828a0af4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:31.024574 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b18543-f2f9-47a3-bcbc-1c5e828a0af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:31.024964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b18543-f2f9-47a3-bcbc-1c5e828a0af4 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:31.025823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b18543-f2f9-47a3-bcbc-1c5e828a0af4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:31.026225 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b18543-f2f9-47a3-bcbc-1c5e828a0af4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:31.027701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b18543-f2f9-47a3-bcbc-1c5e828a0af4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:31.034905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb424d-ca3e-4548-b697-c06adbcb63cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:31.035589 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb424d-ca3e-4548-b697-c06adbcb63cc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:31.035880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb424d-ca3e-4548-b697-c06adbcb63cc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:31.036164 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb424d-ca3e-4548-b697-c06adbcb63cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:31.037118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb424d-ca3e-4548-b697-c06adbcb63cc None admin] RBAC: Adding query filter params (role.id=4afb8bd8c6354dd9b143ef4aaa8284fa, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=54123f8a9de7428bb7e34557aea23ebf) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:31.037486 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb424d-ca3e-4548-b697-c06adbcb63cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:31.038968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb424d-ca3e-4548-b697-c06adbcb63cc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:31.040828 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 377/753] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:31.041839 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b18543-f2f9-47a3-bcbc-1c5e828a0af4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:31.045522 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 377/754] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:30 2022] GET /identity/v3/role_assignments?user.id=54123f8a9de7428bb7e34557aea23ebf&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=4afb8bd8c6354dd9b143ef4aaa8284fa => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:31.046347 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb424d-ca3e-4548-b697-c06adbcb63cc None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:31.232725 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:31.264019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb424d-ca3e-4548-b697-c06adbcb63cc None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:31.268093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b18543-f2f9-47a3-bcbc-1c5e828a0af4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:31.327642 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dce00-eba0-49e8-b948-79a5a4d14469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:31.328467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dce00-eba0-49e8-b948-79a5a4d14469 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:31.328757 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dce00-eba0-49e8-b948-79a5a4d14469 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:31.329044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dce00-eba0-49e8-b948-79a5a4d14469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:31.330201 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dafdd1-4978-4016-9d87-f01e46cfbba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:31.331017 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dafdd1-4978-4016-9d87-f01e46cfbba4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:31.331301 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dafdd1-4978-4016-9d87-f01e46cfbba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:31.331575 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dafdd1-4978-4016-9d87-f01e46cfbba4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:31.348162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dafdd1-4978-4016-9d87-f01e46cfbba4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:31.349674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dafdd1-4978-4016-9d87-f01e46cfbba4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:31.351349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106dce00-eba0-49e8-b948-79a5a4d14469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:31.352781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106dce00-eba0-49e8-b948-79a5a4d14469 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:31.375734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c2dafdd1-4978-4016-9d87-f01e46cfbba4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:22:31.375734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:31.375734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:31.375734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:31.375734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:31.375734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:31.375734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:31.375734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:31.375734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:31.375734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:31.375734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:31.375734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:31.375734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:31.375734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:31.375734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:31.375734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:31.376895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:31.377993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:31.377993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:31.377993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:31.377993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:31.377993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:31.377993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:31.377993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:31.377993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:31.377993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:22:31.377993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:31.377993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 378/755] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 15 00:22:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:31.382980 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dafdd1-4978-4016-9d87-f01e46cfbba4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:31.387841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-106dce00-eba0-49e8-b948-79a5a4d14469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:31.387841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:31.387841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:31.387841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:31.387841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:31.387841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:31.387841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:31.387841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:31.387841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:31.387841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:31.387841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:31.387841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:31.387841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:31.387841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:31.387841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:31.388842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:31.389902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:31.389902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:31.389902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:31.389902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:31.397026 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 378/756] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:31.401805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dce00-eba0-49e8-b948-79a5a4d14469 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:31.413683 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:31.517543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dce00-eba0-49e8-b948-79a5a4d14469 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:31.552624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11006e31-0d53-449c-8a41-af882a788053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:31.553303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11006e31-0d53-449c-8a41-af882a788053 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:31.553646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11006e31-0d53-449c-8a41-af882a788053 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:31.553953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11006e31-0d53-449c-8a41-af882a788053 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:31.554687 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11006e31-0d53-449c-8a41-af882a788053 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:31.554998 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11006e31-0d53-449c-8a41-af882a788053 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:31.556400 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11006e31-0d53-449c-8a41-af882a788053 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:31.569851 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 379/757] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:31.578324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11006e31-0d53-449c-8a41-af882a788053 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:31.584375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dafdd1-4978-4016-9d87-f01e46cfbba4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:31.647009 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e9e11-5bb1-4b26-ba70-d2070cadf39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:31.648610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e9e11-5bb1-4b26-ba70-d2070cadf39e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:31.649046 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e9e11-5bb1-4b26-ba70-d2070cadf39e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:31.649499 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e9e11-5bb1-4b26-ba70-d2070cadf39e None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:31.650607 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e9e11-5bb1-4b26-ba70-d2070cadf39e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:31.651089 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e9e11-5bb1-4b26-ba70-d2070cadf39e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:31.652786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e9e11-5bb1-4b26-ba70-d2070cadf39e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:31.662594 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:31.687873 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:31.692104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 379/758] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 15 00:22:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:31.697416 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e9e11-5bb1-4b26-ba70-d2070cadf39e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:31.699731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11006e31-0d53-449c-8a41-af882a788053 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:31.747767 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef04e9-ab4f-4c14-9963-ea323f91565f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:31.748582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef04e9-ab4f-4c14-9963-ea323f91565f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:31.748860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef04e9-ab4f-4c14-9963-ea323f91565f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:31.749132 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef04e9-ab4f-4c14-9963-ea323f91565f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:31.762026 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef04e9-ab4f-4c14-9963-ea323f91565f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:31.763570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef04e9-ab4f-4c14-9963-ea323f91565f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:31.788084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-4eef04e9-ab4f-4c14-9963-ea323f91565f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:31.788084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:31.788084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:31.788084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:31.788084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:31.788084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:31.788084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:31.788084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:31.788084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:31.788084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:31.788084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:31.788084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:31.788084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:31.788084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:31.788084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:31.789158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:31.790138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:31.790138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:31.790138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:31.790138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:31.790138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:31.790138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:31.790138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:31.790138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:31.790138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 380/759] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:31.797151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef04e9-ab4f-4c14-9963-ea323f91565f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:31.871725 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e9e11-5bb1-4b26-ba70-d2070cadf39e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:31.917754 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82d3f8-c19b-45e4-af61-49a4300b5d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:31.919838 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82d3f8-c19b-45e4-af61-49a4300b5d7d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:31.922945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82d3f8-c19b-45e4-af61-49a4300b5d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:31.923438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82d3f8-c19b-45e4-af61-49a4300b5d7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:31.941455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82d3f8-c19b-45e4-af61-49a4300b5d7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:31.943901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82d3f8-c19b-45e4-af61-49a4300b5d7d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:31.982013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-8e82d3f8-c19b-45e4-af61-49a4300b5d7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:31.982013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:31.982013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:31.982013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:31.982013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:31.982013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:31.982013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:31.982013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:31.982013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:31.982013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:31.982013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:31.982013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:31.982013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:31.982013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:31.982013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:31.982997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:31.983905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:31.983905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:31.983905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:31.983905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:31.991229 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 380/760] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:31.997155 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82d3f8-c19b-45e4-af61-49a4300b5d7d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:32.038847 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef04e9-ab4f-4c14-9963-ea323f91565f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:32.090555 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:32.115639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:32.123297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82d3f8-c19b-45e4-af61-49a4300b5d7d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:32.154618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb3da1-422e-4c66-a95c-1935a3165693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:32.155307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb3da1-422e-4c66-a95c-1935a3165693 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:32.155692 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb3da1-422e-4c66-a95c-1935a3165693 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:32.155981 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb3da1-422e-4c66-a95c-1935a3165693 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:32.156769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb3da1-422e-4c66-a95c-1935a3165693 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:32.157080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb3da1-422e-4c66-a95c-1935a3165693 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:32.158726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb3da1-422e-4c66-a95c-1935a3165693 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:32.162996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519794c-d605-43d0-bdcf-24d75c528759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:32.163701 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519794c-d605-43d0-bdcf-24d75c528759 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:32.163977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519794c-d605-43d0-bdcf-24d75c528759 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:32.164252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519794c-d605-43d0-bdcf-24d75c528759 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:32.164979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519794c-d605-43d0-bdcf-24d75c528759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:32.165287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519794c-d605-43d0-bdcf-24d75c528759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:32.174430 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519794c-d605-43d0-bdcf-24d75c528759 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:32.177429 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 381/761] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:32.183103 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb3da1-422e-4c66-a95c-1935a3165693 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:32.194795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 381/762] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:32.201039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519794c-d605-43d0-bdcf-24d75c528759 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:32.324812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb3da1-422e-4c66-a95c-1935a3165693 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:32.360827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519794c-d605-43d0-bdcf-24d75c528759 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:32.379113 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:32.400901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0465d-df17-4044-a095-2c499974ada3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:32.401775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0465d-df17-4044-a095-2c499974ada3 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:32.402064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0465d-df17-4044-a095-2c499974ada3 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:32.402435 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0465d-df17-4044-a095-2c499974ada3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:32.410575 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0465d-df17-4044-a095-2c499974ada3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:32.412230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0465d-df17-4044-a095-2c499974ada3 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:32.413301 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95942aa-5ac1-45d5-a280-67411c050137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:32.414134 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95942aa-5ac1-45d5-a280-67411c050137 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:32.414542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95942aa-5ac1-45d5-a280-67411c050137 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:32.414913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95942aa-5ac1-45d5-a280-67411c050137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:32.415886 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95942aa-5ac1-45d5-a280-67411c050137 None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=ff27c57c1d1b4f4ab1a030995db2e63a) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:32.416311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95942aa-5ac1-45d5-a280-67411c050137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:32.417996 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95942aa-5ac1-45d5-a280-67411c050137 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:32.429605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-a9f0465d-df17-4044-a095-2c499974ada3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:32.429605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:32.429605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:32.429605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:32.429605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:32.429605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:32.429605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:32.429605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:32.429605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:32.429605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:32.429605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:32.429605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:32.429605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:32.429605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:32.429605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:32.430590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:32.431476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:32.431476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:32.431476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:32.431476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:32.431476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:32.431476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:32.431476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:32.431476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:32.431476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 382/763] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:32.437325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0465d-df17-4044-a095-2c499974ada3 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:32.443353 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 382/764] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:32 2022] GET /identity/v3/role_assignments?user.id=ff27c57c1d1b4f4ab1a030995db2e63a&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:32.490770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dadc6-64af-4398-a910-e2e86a7bf0e8 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:32.491561 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dadc6-64af-4398-a910-e2e86a7bf0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:32.492039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dadc6-64af-4398-a910-e2e86a7bf0e8 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:32.493986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 383/765] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:22:32.499331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c46f42-0fca-4887-b8a6-c12b583a187a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:32.499932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c46f42-0fca-4887-b8a6-c12b583a187a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:32.500513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c46f42-0fca-4887-b8a6-c12b583a187a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:32.519929 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-02c46f42-0fca-4887-b8a6-c12b583a187a None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:32.521223 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-02c46f42-0fca-4887-b8a6-c12b583a187a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:32.550739 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0465d-df17-4044-a095-2c499974ada3 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:32.586542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:32.588852 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ee75c-2f8b-412c-bfa6-ef85f2394321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:32.589831 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ee75c-2f8b-412c-bfa6-ef85f2394321 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:32.590318 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ee75c-2f8b-412c-bfa6-ef85f2394321 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:32.590855 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ee75c-2f8b-412c-bfa6-ef85f2394321 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:32.591949 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ee75c-2f8b-412c-bfa6-ef85f2394321 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:32.592353 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 384/766] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:22:32.592613 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ee75c-2f8b-412c-bfa6-ef85f2394321 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:32.602389 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ee75c-2f8b-412c-bfa6-ef85f2394321 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:32.620591 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 383/767] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:32.626438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c46f42-0fca-4887-b8a6-c12b583a187a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:32.632135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ee75c-2f8b-412c-bfa6-ef85f2394321 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:32.665678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:32.747736 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ee75c-2f8b-412c-bfa6-ef85f2394321 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:32.789601 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24acd1-dde9-4f79-a240-671dd7e359e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:32.790705 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24acd1-dde9-4f79-a240-671dd7e359e3 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:32.791170 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24acd1-dde9-4f79-a240-671dd7e359e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:32.791597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24acd1-dde9-4f79-a240-671dd7e359e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:32.792409 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24acd1-dde9-4f79-a240-671dd7e359e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:32.793958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24acd1-dde9-4f79-a240-671dd7e359e3 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:32.801388 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c46f42-0fca-4887-b8a6-c12b583a187a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-ab24acd1-dde9-4f79-a240-671dd7e359e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:32.807332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:32.808309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:32.808309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:32.808309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:32.808309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:32.808309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:32.808309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:32.808309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:32.808309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:32.808309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:32.808309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:32.808309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:32.808309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:32.808309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:32.808309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:32.808309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:32.808309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:32.809154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:32.809154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:32.809154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:32.809154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:32.809154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:32.809154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:32.809154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:32.809154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:32.809154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:32.809154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:32.809154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:32.809154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:32.809154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:22:32.809154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:32.811595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 384/768] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:32 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:32.818048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24acd1-dde9-4f79-a240-671dd7e359e3 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:32.857605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222f612-c0e2-4f88-a5d3-44a52ff25587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:32.859333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222f612-c0e2-4f88-a5d3-44a52ff25587 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:32.860727 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222f612-c0e2-4f88-a5d3-44a52ff25587 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:32.861680 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222f612-c0e2-4f88-a5d3-44a52ff25587 None admin] PATH_INFO: `/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/6d0ae1707c7041a0989889dbefeaf267/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:32.866118 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222f612-c0e2-4f88-a5d3-44a52ff25587 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc0f2a3e075946f1ad06146dfa252aa6, user_id=6d0ae1707c7041a0989889dbefeaf267, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:32.868026 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222f612-c0e2-4f88-a5d3-44a52ff25587 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:32.890419 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 385/769] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:32 2022] PUT /identity/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/6d0ae1707c7041a0989889dbefeaf267/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:32.959242 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:32.966880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24acd1-dde9-4f79-a240-671dd7e359e3 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:33.006994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05d168-6202-432e-9e36-aac5b8220e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:33.008184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05d168-6202-432e-9e36-aac5b8220e2b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.008658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05d168-6202-432e-9e36-aac5b8220e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.009122 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05d168-6202-432e-9e36-aac5b8220e2b None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.010069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05d168-6202-432e-9e36-aac5b8220e2b None admin] RBAC: Adding query filter params (name=network) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:33.010596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05d168-6202-432e-9e36-aac5b8220e2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:33.012483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05d168-6202-432e-9e36-aac5b8220e2b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:33.018738 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 385/770] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 15 00:22:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:33.024979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222f612-c0e2-4f88-a5d3-44a52ff25587 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:33.084463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:33.155805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222f612-c0e2-4f88-a5d3-44a52ff25587 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:33.194760 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979137fb-d893-45f7-96b3-1c7b22eff6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:33.195459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979137fb-d893-45f7-96b3-1c7b22eff6ac None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.195741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979137fb-d893-45f7-96b3-1c7b22eff6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.196015 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979137fb-d893-45f7-96b3-1c7b22eff6ac None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.196743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979137fb-d893-45f7-96b3-1c7b22eff6ac None admin] RBAC: Adding query filter params (type=network) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:33.197052 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979137fb-d893-45f7-96b3-1c7b22eff6ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:33.198516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979137fb-d893-45f7-96b3-1c7b22eff6ac None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:33.206782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 386/771] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 15 00:22:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:33.212975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05d168-6202-432e-9e36-aac5b8220e2b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:33.255920 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8259e-2c8a-4283-aa80-42daaf1a0435 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.256249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8259e-2c8a-4283-aa80-42daaf1a0435 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.256478 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8259e-2c8a-4283-aa80-42daaf1a0435 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.258398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 387/772] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:33.262962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905c597-f830-4f31-88d0-f86737e6f279 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.263253 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905c597-f830-4f31-88d0-f86737e6f279 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.263528 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905c597-f830-4f31-88d0-f86737e6f279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.288951 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5905c597-f830-4f31-88d0-f86737e6f279 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:33.290158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5905c597-f830-4f31-88d0-f86737e6f279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:33.397846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05d168-6202-432e-9e36-aac5b8220e2b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:33.418691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 388/773] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:33.440373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1496b76-5831-4eb4-b44f-b5ee77b9de45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:33.441047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1496b76-5831-4eb4-b44f-b5ee77b9de45 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.441409 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1496b76-5831-4eb4-b44f-b5ee77b9de45 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.441690 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1496b76-5831-4eb4-b44f-b5ee77b9de45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.442486 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1496b76-5831-4eb4-b44f-b5ee77b9de45 None admin] RBAC: Adding query filter params (interface=public, service_id=3285071b30b9449b9c0048a2d4927144, region_id=RegionOne) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:33.442798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1496b76-5831-4eb4-b44f-b5ee77b9de45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:33.444396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1496b76-5831-4eb4-b44f-b5ee77b9de45 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:33.448568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905c597-f830-4f31-88d0-f86737e6f279 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:33.455739 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 386/774] 10.222.0.36 () {56 vars in 1251 bytes} [Wed Jun 15 00:22:33 2022] GET /identity/v3/endpoints?service_id=3285071b30b9449b9c0048a2d4927144&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:33.461969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1496b76-5831-4eb4-b44f-b5ee77b9de45 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:33.487120 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:33.505712 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:33.602077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905c597-f830-4f31-88d0-f86737e6f279 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:33.642139 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679b6b3-e6dd-49dd-864c-630885dcd1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:33.643156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679b6b3-e6dd-49dd-864c-630885dcd1bc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.643438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679b6b3-e6dd-49dd-864c-630885dcd1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.643708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679b6b3-e6dd-49dd-864c-630885dcd1bc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.644369 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679b6b3-e6dd-49dd-864c-630885dcd1bc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:33.645967 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679b6b3-e6dd-49dd-864c-630885dcd1bc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:33.649557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1496b76-5831-4eb4-b44f-b5ee77b9de45 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:33.660725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-1679b6b3-e6dd-49dd-864c-630885dcd1bc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:22:33.660725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:33.660725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:33.660725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:33.660725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:33.660725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:33.660725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:33.660725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:33.660725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:22:33.660725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:33.660725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:33.660725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:33.660725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:33.660725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:33.660725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:33.660725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:33.661764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:33.661764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:33.661764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:33.661764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:33.661764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:33.661764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:33.661764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:33.661764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:33.661764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:33.661764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:33.661764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:33.661764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:33.661764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:33.661764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:33.661764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:33.661764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:33.662612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:33.662612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:33.662612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:33.662612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:33.662612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:33.662612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:33.662612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:33.662612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:33.662612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:33.662612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:33.662612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:33.662612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:33.662612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:33.662612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:22:33.662612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:33.662612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 389/775] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Jun 15 00:22:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:33.664056 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e43d9f-1f2e-4d97-9c65-b78990c56c05 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.664056 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e43d9f-1f2e-4d97-9c65-b78990c56c05 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.665380 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e43d9f-1f2e-4d97-9c65-b78990c56c05 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.665893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 390/776] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:33.667733 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e43d9f-1f2e-4d97-9c65-b78990c56c05 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:33.693309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382283f-5671-4337-872f-bccce68e74eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:33.695244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382283f-5671-4337-872f-bccce68e74eb None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.695244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382283f-5671-4337-872f-bccce68e74eb None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.695244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382283f-5671-4337-872f-bccce68e74eb None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.695763 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382283f-5671-4337-872f-bccce68e74eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:33.697433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382283f-5671-4337-872f-bccce68e74eb None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:33.704336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 387/777] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 15 00:22:33 2022] GET /identity/v3/services => generated 772 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:33.705683 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4587967-63d5-4d45-aef8-0aba87e06b73 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.705973 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4587967-63d5-4d45-aef8-0aba87e06b73 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.706255 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4587967-63d5-4d45-aef8-0aba87e06b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.725121 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b4587967-63d5-4d45-aef8-0aba87e06b73 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:33.726480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b4587967-63d5-4d45-aef8-0aba87e06b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:33.821514 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 388/778] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:33.840587 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4587967-63d5-4d45-aef8-0aba87e06b73 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:33.860233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:33.865731 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:33.888786 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e43d9f-1f2e-4d97-9c65-b78990c56c05 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:33.964001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f233c1-d87a-4b0c-8288-168d343dc3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:33.964696 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f233c1-d87a-4b0c-8288-168d343dc3ed None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:33.964984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f233c1-d87a-4b0c-8288-168d343dc3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:33.965263 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f233c1-d87a-4b0c-8288-168d343dc3ed None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:33.966023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f233c1-d87a-4b0c-8288-168d343dc3ed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:33.966335 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f233c1-d87a-4b0c-8288-168d343dc3ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:33.968326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f233c1-d87a-4b0c-8288-168d343dc3ed None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:33.980004 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 391/779] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Jun 15 00:22:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:33.981911 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f233c1-d87a-4b0c-8288-168d343dc3ed None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:34.006953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4587967-63d5-4d45-aef8-0aba87e06b73 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:34.055592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128e2bd-3f20-4c6e-8e8b-4d7d65bf0b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:34.056462 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128e2bd-3f20-4c6e-8e8b-4d7d65bf0b74 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.056743 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128e2bd-3f20-4c6e-8e8b-4d7d65bf0b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.057018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128e2bd-3f20-4c6e-8e8b-4d7d65bf0b74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.073550 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128e2bd-3f20-4c6e-8e8b-4d7d65bf0b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:34.085167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-4128e2bd-3f20-4c6e-8e8b-4d7d65bf0b74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:34.085167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:34.085167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:34.085167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:34.085167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:34.085167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:34.085167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:34.085167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:34.085167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:34.085167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:34.085167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:34.085167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:34.085167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:34.085167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:34.085167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:34.085167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:34.086166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:34.086166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:34.086166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:34.086166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:34.086166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:34.086166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:34.086166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:34.086166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:34.086166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:34.086166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:34.086166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:34.086166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:34.086166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:34.086166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:34.086166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:34.086166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:34.087022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:34.087022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:34.087022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:34.087022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:34.087022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:34.087022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:34.087022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:34.087022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:34.087022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:34.087022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:34.087022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:34.087022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:34.087022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 389/780] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:34.097397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128e2bd-3f20-4c6e-8e8b-4d7d65bf0b74 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:34.135184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f233c1-d87a-4b0c-8288-168d343dc3ed None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:34.202948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faf89d-46b3-46dc-b9e1-99d87bb68dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:34.204631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faf89d-46b3-46dc-b9e1-99d87bb68dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.204922 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faf89d-46b3-46dc-b9e1-99d87bb68dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.205196 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faf89d-46b3-46dc-b9e1-99d87bb68dc4 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.205932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faf89d-46b3-46dc-b9e1-99d87bb68dc4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:34.206239 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faf89d-46b3-46dc-b9e1-99d87bb68dc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:34.207622 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faf89d-46b3-46dc-b9e1-99d87bb68dc4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:34.220404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 392/781] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Jun 15 00:22:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:34.225836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:34.227892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faf89d-46b3-46dc-b9e1-99d87bb68dc4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:34.264115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:34.268230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128e2bd-3f20-4c6e-8e8b-4d7d65bf0b74 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:34.341528 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faf89d-46b3-46dc-b9e1-99d87bb68dc4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:34.376955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1670243-377f-4815-b0c5-76e60275afd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:34.377663 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1670243-377f-4815-b0c5-76e60275afd7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.377949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1670243-377f-4815-b0c5-76e60275afd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.378218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa63ce-0a89-439b-93ea-7801fd2a0b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:34.378378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1670243-377f-4815-b0c5-76e60275afd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.378917 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa63ce-0a89-439b-93ea-7801fd2a0b56 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.379030 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1670243-377f-4815-b0c5-76e60275afd7 None admin] RBAC: Adding query filter params (interface=public, service_id=91d6b60a42064256aad7d10c257877c3, region_id=RegionOne) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:34.379204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa63ce-0a89-439b-93ea-7801fd2a0b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.379301 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1670243-377f-4815-b0c5-76e60275afd7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:34.379478 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa63ce-0a89-439b-93ea-7801fd2a0b56 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.380238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa63ce-0a89-439b-93ea-7801fd2a0b56 None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:34.380544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa63ce-0a89-439b-93ea-7801fd2a0b56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:34.380710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1670243-377f-4815-b0c5-76e60275afd7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:34.381996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa63ce-0a89-439b-93ea-7801fd2a0b56 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:34.390389 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 393/782] 10.222.0.36 () {56 vars in 1251 bytes} [Wed Jun 15 00:22:34 2022] GET /identity/v3/endpoints?service_id=91d6b60a42064256aad7d10c257877c3&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:34.398377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1670243-377f-4815-b0c5-76e60275afd7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:34.409504 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 390/783] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:34.414574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa63ce-0a89-439b-93ea-7801fd2a0b56 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:34.502044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:34.510028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1670243-377f-4815-b0c5-76e60275afd7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:34.552619 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83827e09-dda9-4de0-ad68-60c285f9dc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:34.553298 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83827e09-dda9-4de0-ad68-60c285f9dc45 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.553713 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83827e09-dda9-4de0-ad68-60c285f9dc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.553995 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83827e09-dda9-4de0-ad68-60c285f9dc45 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.554687 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83827e09-dda9-4de0-ad68-60c285f9dc45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:34.556078 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83827e09-dda9-4de0-ad68-60c285f9dc45 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:34.562077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 394/784] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 15 00:22:34 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:34.628674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa63ce-0a89-439b-93ea-7801fd2a0b56 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:34.672912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0738d6-fa1a-4830-8103-b9fa4ab08305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:34.673777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0738d6-fa1a-4830-8103-b9fa4ab08305 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.674051 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0738d6-fa1a-4830-8103-b9fa4ab08305 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.674325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0738d6-fa1a-4830-8103-b9fa4ab08305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.689971 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:34.692404 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0738d6-fa1a-4830-8103-b9fa4ab08305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:34.693910 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0738d6-fa1a-4830-8103-b9fa4ab08305 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:34.718034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-9a0738d6-fa1a-4830-8103-b9fa4ab08305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:34.718034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:34.718034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:34.718034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:34.718034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:34.718034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:34.718034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:34.718034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:34.718034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:34.718034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:34.718034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:34.718034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:34.718034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:34.718034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:34.718034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:34.719035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:34.719945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:34.719945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:34.719945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:34.719945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:34.719945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 391/785] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:34.725382 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83827e09-dda9-4de0-ad68-60c285f9dc45 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:34.862504 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83827e09-dda9-4de0-ad68-60c285f9dc45 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:34.907476 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99e219-3c9a-4cec-9c0d-08cd4be3f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:34.908164 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99e219-3c9a-4cec-9c0d-08cd4be3f486 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:34.908445 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99e219-3c9a-4cec-9c0d-08cd4be3f486 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:34.908718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99e219-3c9a-4cec-9c0d-08cd4be3f486 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:34.909514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99e219-3c9a-4cec-9c0d-08cd4be3f486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:34.909824 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99e219-3c9a-4cec-9c0d-08cd4be3f486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:34.911209 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99e219-3c9a-4cec-9c0d-08cd4be3f486 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:34.933332 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 395/786] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:34.939195 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0738d6-fa1a-4830-8103-b9fa4ab08305 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:35.060777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0738d6-fa1a-4830-8103-b9fa4ab08305 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:35.131219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0e46e-7c52-482a-ac63-2c13f572eef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:35.132126 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0e46e-7c52-482a-ac63-2c13f572eef3 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.132442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0e46e-7c52-482a-ac63-2c13f572eef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.132732 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0e46e-7c52-482a-ac63-2c13f572eef3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.146754 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0e46e-7c52-482a-ac63-2c13f572eef3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:35.148440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0e46e-7c52-482a-ac63-2c13f572eef3 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:35.163277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc03a58-9734-4f21-aefb-3fb1bb4bb313 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.163602 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc03a58-9734-4f21-aefb-3fb1bb4bb313 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.163840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc03a58-9734-4f21-aefb-3fb1bb4bb313 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.165649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 396/787] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:22:35.170374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-2fa0e46e-7c52-482a-ac63-2c13f572eef3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:22:35.170374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:35.170374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:35.170374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:35.170374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:35.170374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:35.170374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:35.170374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:35.170374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:35.170374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:35.170374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:35.170374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:35.170374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:35.170374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:35.170374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:35.170374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:35.171305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:35.172248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:35.172248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:35.172248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:35.172248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:35.172248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:35.172248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:35.172248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:35.172248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:35.172248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:22:35.172248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:35.174438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 392/788] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 15 00:22:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:35.177541 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc03a58-9734-4f21-aefb-3fb1bb4bb313 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:35.178465 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a11ad-944e-4988-86e0-cbbf40b24620 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.178849 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a11ad-944e-4988-86e0-cbbf40b24620 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.179131 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a11ad-944e-4988-86e0-cbbf40b24620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.196800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-cb9a11ad-944e-4988-86e0-cbbf40b24620 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:35.198068 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-cb9a11ad-944e-4988-86e0-cbbf40b24620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:35.201244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:35.285233 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:35.324201 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 393/789] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:22:35.346643 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc03a58-9734-4f21-aefb-3fb1bb4bb313 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:35.375764 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a11ad-944e-4988-86e0-cbbf40b24620 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:35.397803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f6991-dac3-4102-af75-a3c5f3f378b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:35.398577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f6991-dac3-4102-af75-a3c5f3f378b8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.398860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f6991-dac3-4102-af75-a3c5f3f378b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.399136 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f6991-dac3-4102-af75-a3c5f3f378b8 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.399992 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f6991-dac3-4102-af75-a3c5f3f378b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:35.400301 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f6991-dac3-4102-af75-a3c5f3f378b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:35.401816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f6991-dac3-4102-af75-a3c5f3f378b8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:35.435354 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 397/790] 10.222.0.36 () {56 vars in 1149 bytes} [Wed Jun 15 00:22:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:35.441808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f6991-dac3-4102-af75-a3c5f3f378b8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:35.518206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:35.522574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a11ad-944e-4988-86e0-cbbf40b24620 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:35.554333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f6991-dac3-4102-af75-a3c5f3f378b8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:35.570697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85125d6a-5947-4f24-9e29-5b6c4a53b75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:35.571987 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85125d6a-5947-4f24-9e29-5b6c4a53b75e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.572415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85125d6a-5947-4f24-9e29-5b6c4a53b75e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.572834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85125d6a-5947-4f24-9e29-5b6c4a53b75e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.587799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85125d6a-5947-4f24-9e29-5b6c4a53b75e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:35.594193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43b787-eca5-46c9-83b8-3ad54a9ba0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:35.595430 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43b787-eca5-46c9-83b8-3ad54a9ba0dc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.595556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-85125d6a-5947-4f24-9e29-5b6c4a53b75e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:35.595556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:35.595556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:35.595556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:35.595556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:35.595556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:35.595556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:35.595556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:35.595556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:35.595556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:35.595556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:35.595556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:35.595556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:35.595556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:35.595556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:35.595556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:35.596434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:35.596434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:35.596434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:35.596434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:35.596434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:35.596434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:35.596434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:35.596434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:35.596434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:35.596434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:35.596434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:35.596434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:35.596434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:35.596434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:35.596434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:35.596434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:35.597270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:35.597270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:35.597270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:35.597270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:35.597270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:35.597270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:35.597270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:35.597270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:35.597270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:35.597270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:35.597270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:35.597270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:35.598760 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43b787-eca5-46c9-83b8-3ad54a9ba0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.599245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43b787-eca5-46c9-83b8-3ad54a9ba0dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.601845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 394/791] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:35.603220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aff46-bb0b-4c9c-a074-5a0c07355c77 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.603512 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aff46-bb0b-4c9c-a074-5a0c07355c77 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.603791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5aff46-bb0b-4c9c-a074-5a0c07355c77 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.605318 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 395/792] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:35.606026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5aff46-bb0b-4c9c-a074-5a0c07355c77 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:35.612083 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43b787-eca5-46c9-83b8-3ad54a9ba0dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:35.615392 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43b787-eca5-46c9-83b8-3ad54a9ba0dc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:35.638955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-6e43b787-eca5-46c9-83b8-3ad54a9ba0dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:35.638955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:35.638955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:35.638955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:35.638955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:35.638955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:35.638955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:35.638955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:35.638955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:35.638955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:35.638955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:35.638955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:35.638955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:35.638955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:35.638955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:35.639916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:35.640816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:35.640816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:35.640816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:35.640816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:35.643361 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 398/793] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:35.645680 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ca78b-e986-4d49-9a6b-fd0096fb58c3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.646225 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ca78b-e986-4d49-9a6b-fd0096fb58c3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.646661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ca78b-e986-4d49-9a6b-fd0096fb58c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.659140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:35.669600 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d49ca78b-e986-4d49-9a6b-fd0096fb58c3 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:35.671546 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d49ca78b-e986-4d49-9a6b-fd0096fb58c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:35.746183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5aff46-bb0b-4c9c-a074-5a0c07355c77 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:35.757611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 399/794] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:35.758905 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ca78b-e986-4d49-9a6b-fd0096fb58c3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:35.782571 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9469fae-8269-466a-a349-ead8d0c34a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:35.783061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9469fae-8269-466a-a349-ead8d0c34a32 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.783508 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9469fae-8269-466a-a349-ead8d0c34a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.783926 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9469fae-8269-466a-a349-ead8d0c34a32 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.784831 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9469fae-8269-466a-a349-ead8d0c34a32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:35.785265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9469fae-8269-466a-a349-ead8d0c34a32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:35.786806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9469fae-8269-466a-a349-ead8d0c34a32 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:35.797062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 396/795] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:35.798120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9469fae-8269-466a-a349-ead8d0c34a32 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:35.828883 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:35.883946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ca78b-e986-4d49-9a6b-fd0096fb58c3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:35.899015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9469fae-8269-466a-a349-ead8d0c34a32 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:35.901600 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:35.924900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e1362-32d7-4d54-a735-68a05c945291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:35.926062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1362-32d7-4d54-a735-68a05c945291 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.926751 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1362-32d7-4d54-a735-68a05c945291 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.927171 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e1362-32d7-4d54-a735-68a05c945291 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.928708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e1362-32d7-4d54-a735-68a05c945291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:35.929163 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e1362-32d7-4d54-a735-68a05c945291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:35.931356 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e1362-32d7-4d54-a735-68a05c945291 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:35.935858 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56525c25-cd66-4f44-8037-8117bd23b3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:35.936778 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56525c25-cd66-4f44-8037-8117bd23b3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:35.937154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56525c25-cd66-4f44-8037-8117bd23b3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:35.937564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56525c25-cd66-4f44-8037-8117bd23b3d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:35.947203 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 400/796] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:35.948271 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e1362-32d7-4d54-a735-68a05c945291 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:35.951469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56525c25-cd66-4f44-8037-8117bd23b3d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:35.961045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-56525c25-cd66-4f44-8037-8117bd23b3d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:35.961045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:35.961045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:35.961045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:35.961045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:35.961045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:35.961045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:35.961045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:35.961045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:35.961045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:35.961045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:35.961045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:35.961045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:35.961045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:35.961045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:35.961045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:35.962030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:35.962030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:35.962030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:35.962030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:35.962030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:35.962030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:35.962030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:35.962030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:35.962030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:35.962030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:35.962030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:35.962030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:35.962030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:35.962030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:35.962030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:35.962030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:35.962871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:35.962871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:35.962871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:35.962871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:35.962871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:35.962871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:35.962871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:35.962871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:35.962871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:35.962871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:35.962871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:35.962871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:35.965420 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 397/797] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:35.966457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56525c25-cd66-4f44-8037-8117bd23b3d8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:36.058808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e1362-32d7-4d54-a735-68a05c945291 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:36.079341 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:36.106393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56525c25-cd66-4f44-8037-8117bd23b3d8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:36.106641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea47139-0493-43b4-84c6-9ad59b918f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:36.107361 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea47139-0493-43b4-84c6-9ad59b918f3d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.107708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea47139-0493-43b4-84c6-9ad59b918f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.108055 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea47139-0493-43b4-84c6-9ad59b918f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.124006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea47139-0493-43b4-84c6-9ad59b918f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:36.126713 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea47139-0493-43b4-84c6-9ad59b918f3d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:36.147547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac5c53-d233-4ac4-a9ca-c7c216c651b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:36.148545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac5c53-d233-4ac4-a9ca-c7c216c651b1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.148925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac5c53-d233-4ac4-a9ca-c7c216c651b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.149330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac5c53-d233-4ac4-a9ca-c7c216c651b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.151289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-eea47139-0493-43b4-84c6-9ad59b918f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:36.151289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:36.151289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:36.151289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:36.151289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:36.151289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:36.151289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:36.151289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:36.151289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:36.151289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:36.151289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:36.151289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:36.151289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:36.151289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:36.151289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:36.152340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:36.153746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:36.153746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:36.153746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:36.153746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:36.156029 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 401/798] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:36.157090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea47139-0493-43b4-84c6-9ad59b918f3d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:36.160335 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac5c53-d233-4ac4-a9ca-c7c216c651b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:36.162667 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac5c53-d233-4ac4-a9ca-c7c216c651b1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:36.185563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-6cac5c53-d233-4ac4-a9ca-c7c216c651b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:36.185563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:36.185563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:36.185563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:36.185563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:36.185563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:36.185563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:36.185563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:36.185563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:36.185563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:36.185563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:36.185563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:36.185563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:36.185563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:36.185563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:36.186604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:36.187495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:36.187495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:36.187495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:36.187495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:36.187495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:36.187495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:36.187495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:36.187495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:36.190494 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 398/799] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:36.191487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac5c53-d233-4ac4-a9ca-c7c216c651b1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:36.222094 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:36.270177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea47139-0493-43b4-84c6-9ad59b918f3d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:36.301369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac5c53-d233-4ac4-a9ca-c7c216c651b1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:36.306565 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca3dfb-4613-4028-816b-5732908368b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:36.307241 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca3dfb-4613-4028-816b-5732908368b1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.307523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca3dfb-4613-4028-816b-5732908368b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.307798 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca3dfb-4613-4028-816b-5732908368b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.308561 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca3dfb-4613-4028-816b-5732908368b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:36.309070 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca3dfb-4613-4028-816b-5732908368b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:36.310255 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca3dfb-4613-4028-816b-5732908368b1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:36.324050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 402/800] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:36.324693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca3dfb-4613-4028-816b-5732908368b1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:36.336430 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c67588-e401-4228-944b-82232e842ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:36.337104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c67588-e401-4228-944b-82232e842ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.337414 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c67588-e401-4228-944b-82232e842ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.337692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c67588-e401-4228-944b-82232e842ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.338430 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c67588-e401-4228-944b-82232e842ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:36.338737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c67588-e401-4228-944b-82232e842ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:36.340117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c67588-e401-4228-944b-82232e842ad6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:36.351243 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 399/801] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:36.352459 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59d049-a08e-4e56-9ba2-8868b713823f None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.352745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59d049-a08e-4e56-9ba2-8868b713823f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.353027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59d049-a08e-4e56-9ba2-8868b713823f None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.354422 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 400/802] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:36.354945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59d049-a08e-4e56-9ba2-8868b713823f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:36.361231 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:36.441530 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca3dfb-4613-4028-816b-5732908368b1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:36.447014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:36.465211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59d049-a08e-4e56-9ba2-8868b713823f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:36.479961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c4acc-0d33-45b3-84c8-67e613231175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:36.480782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c4acc-0d33-45b3-84c8-67e613231175 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.481467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c4acc-0d33-45b3-84c8-67e613231175 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.481758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c4acc-0d33-45b3-84c8-67e613231175 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.482843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c4acc-0d33-45b3-84c8-67e613231175 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:36.483162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c4acc-0d33-45b3-84c8-67e613231175 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:36.485079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c4acc-0d33-45b3-84c8-67e613231175 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:36.506921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 403/803] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:36.506921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c4acc-0d33-45b3-84c8-67e613231175 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:36.508972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348cd1f-1d35-4b2a-aba9-6ab25e82f4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:36.509839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348cd1f-1d35-4b2a-aba9-6ab25e82f4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.510109 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348cd1f-1d35-4b2a-aba9-6ab25e82f4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.510383 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348cd1f-1d35-4b2a-aba9-6ab25e82f4a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.522237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348cd1f-1d35-4b2a-aba9-6ab25e82f4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:36.524369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348cd1f-1d35-4b2a-aba9-6ab25e82f4a8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:36.542123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-5348cd1f-1d35-4b2a-aba9-6ab25e82f4a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:36.542123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:36.542123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:36.542123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:36.542123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:36.542123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:36.542123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:36.542123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:36.542123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:36.542123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:36.542123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:36.542123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:36.542123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:36.542123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:36.542123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:36.543081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:36.544016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:36.544016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:36.544016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:36.544016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:36.544016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 401/804] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:36.544936 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d805e-6656-4227-bfad-aac30fc301ab None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.545287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d805e-6656-4227-bfad-aac30fc301ab None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.545650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d805e-6656-4227-bfad-aac30fc301ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.562107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-504d805e-6656-4227-bfad-aac30fc301ab None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:36.563280 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-504d805e-6656-4227-bfad-aac30fc301ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:36.605040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:36.623182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c4acc-0d33-45b3-84c8-67e613231175 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:36.635572 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 402/805] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:36.638208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d805e-6656-4227-bfad-aac30fc301ab None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:36.661516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb552e20-b95b-4e14-ab94-8dac89dedd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:36.662228 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb552e20-b95b-4e14-ab94-8dac89dedd11 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.662515 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb552e20-b95b-4e14-ab94-8dac89dedd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.662794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb552e20-b95b-4e14-ab94-8dac89dedd11 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.670297 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb552e20-b95b-4e14-ab94-8dac89dedd11 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:36.671743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb552e20-b95b-4e14-ab94-8dac89dedd11 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:36.686226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-eb552e20-b95b-4e14-ab94-8dac89dedd11 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:22:36.686226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:36.686226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:36.686226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:36.686226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:36.686226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:36.686226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:36.686226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:36.686226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:36.686226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:36.686226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:36.686226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:36.686226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:36.686226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:36.686226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:36.686226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:36.687193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:36.688151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:36.688151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:36.688151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:36.688151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:36.688151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:36.688151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:36.688151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:36.688151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:36.688151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:22:36.688151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:36.688151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 404/806] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:36.688734 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb552e20-b95b-4e14-ab94-8dac89dedd11 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:36.723602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:36.760696 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d805e-6656-4227-bfad-aac30fc301ab None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:36.796168 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb552e20-b95b-4e14-ab94-8dac89dedd11 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:36.797820 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f2e45-ec27-4ced-b6f6-04fb91be56d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:36.798746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f2e45-ec27-4ced-b6f6-04fb91be56d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.799028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f2e45-ec27-4ced-b6f6-04fb91be56d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.799308 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f2e45-ec27-4ced-b6f6-04fb91be56d0 None admin] PATH_INFO: `/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/54123f8a9de7428bb7e34557aea23ebf/roles/4afb8bd8c6354dd9b143ef4aaa8284fa` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.814319 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f2e45-ec27-4ced-b6f6-04fb91be56d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc0f2a3e075946f1ad06146dfa252aa6, user_id=54123f8a9de7428bb7e34557aea23ebf, role_id=4afb8bd8c6354dd9b143ef4aaa8284fa)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:36.815832 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f2e45-ec27-4ced-b6f6-04fb91be56d0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:36.831303 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 403/807] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:36 2022] PUT /identity/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/54123f8a9de7428bb7e34557aea23ebf/roles/4afb8bd8c6354dd9b143ef4aaa8284fa => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:36.832439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f2e45-ec27-4ced-b6f6-04fb91be56d0 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:36.845578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711516d8-2cc6-44b7-974f-74d3f8f2e3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:36.846376 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711516d8-2cc6-44b7-974f-74d3f8f2e3be None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:36.846706 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711516d8-2cc6-44b7-974f-74d3f8f2e3be None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:36.846996 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711516d8-2cc6-44b7-974f-74d3f8f2e3be None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:36.848953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711516d8-2cc6-44b7-974f-74d3f8f2e3be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:36.849325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711516d8-2cc6-44b7-974f-74d3f8f2e3be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:36.850940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711516d8-2cc6-44b7-974f-74d3f8f2e3be None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:36.874425 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 405/808] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:36.875614 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711516d8-2cc6-44b7-974f-74d3f8f2e3be None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:36.882234 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:37.000607 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f2e45-ec27-4ced-b6f6-04fb91be56d0 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.020269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:37.022789 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711516d8-2cc6-44b7-974f-74d3f8f2e3be None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.045209 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab005bb-dcd6-4b29-8655-7c61f2e56c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.046084 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab005bb-dcd6-4b29-8655-7c61f2e56c9d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.046373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab005bb-dcd6-4b29-8655-7c61f2e56c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.046653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab005bb-dcd6-4b29-8655-7c61f2e56c9d None admin] PATH_INFO: `/v3/services/network` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.047324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab005bb-dcd6-4b29-8655-7c61f2e56c9d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:37.048719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab005bb-dcd6-4b29-8655-7c61f2e56c9d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-eab005bb-dcd6-4b29-8655-7c61f2e56c9d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:37.060653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:37.061921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:37.061921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:37.061921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:37.061921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:37.061921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:37.061921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:37.061921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:37.061921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:37.061921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:37.061921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:37.061921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:37.061921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:37.061921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:37.061921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:37.061921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:37.061921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:37.063106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:37.063106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:37.063106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:37.063106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:37.063106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:37.063106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:37.063106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:37.063106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:37.063106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:37.063106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:37.063106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:37.063106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:37.063106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 15 00:22:37.063106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:37.063106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 404/809] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:36 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:37.064098 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab005bb-dcd6-4b29-8655-7c61f2e56c9d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.068245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c420a-5df0-442c-b93b-24c7a718c277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.069219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c420a-5df0-442c-b93b-24c7a718c277 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.069696 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c420a-5df0-442c-b93b-24c7a718c277 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.070129 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c420a-5df0-442c-b93b-24c7a718c277 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.071160 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c420a-5df0-442c-b93b-24c7a718c277 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:37.071470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c420a-5df0-442c-b93b-24c7a718c277 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:37.073045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c420a-5df0-442c-b93b-24c7a718c277 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:37.095529 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 406/810] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Jun 15 00:22:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:37.101395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c420a-5df0-442c-b93b-24c7a718c277 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.171292 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:37.204995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab005bb-dcd6-4b29-8655-7c61f2e56c9d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.213312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c420a-5df0-442c-b93b-24c7a718c277 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.242970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41ddb1-6a3a-4eae-8c5e-fd6c7248cdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.243793 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41ddb1-6a3a-4eae-8c5e-fd6c7248cdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.244082 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41ddb1-6a3a-4eae-8c5e-fd6c7248cdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.244365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41ddb1-6a3a-4eae-8c5e-fd6c7248cdb1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.249877 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5245e5-8bd5-48d0-9c19-029d7301b7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.250776 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5245e5-8bd5-48d0-9c19-029d7301b7fe None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.251205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5245e5-8bd5-48d0-9c19-029d7301b7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.251624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5245e5-8bd5-48d0-9c19-029d7301b7fe None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.252145 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41ddb1-6a3a-4eae-8c5e-fd6c7248cdb1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:37.252708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5245e5-8bd5-48d0-9c19-029d7301b7fe None admin] RBAC: Adding query filter params (name=network) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:37.253156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5245e5-8bd5-48d0-9c19-029d7301b7fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:37.253642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41ddb1-6a3a-4eae-8c5e-fd6c7248cdb1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:37.255027 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5245e5-8bd5-48d0-9c19-029d7301b7fe None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:37.260816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 407/811] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:37.261838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5245e5-8bd5-48d0-9c19-029d7301b7fe None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.268410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-9c41ddb1-6a3a-4eae-8c5e-fd6c7248cdb1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:22:37.268410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:37.268410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:37.268410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:37.268410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:37.268410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:37.268410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:37.268410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:37.268410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:37.268410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:37.268410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:37.268410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:37.268410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:37.268410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:37.268410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:37.268410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:37.269539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:37.270495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:37.270495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:37.270495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:37.270495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:37.270495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:37.270495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:37.270495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:37.270495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:37.270495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:22:37.270495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:37.274294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 405/812] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:37.275448 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023affa-4944-45d4-8ccd-8b9b03b0c736 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.275742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023affa-4944-45d4-8ccd-8b9b03b0c736 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.276029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023affa-4944-45d4-8ccd-8b9b03b0c736 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.281474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 406/813] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:37.281474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023affa-4944-45d4-8ccd-8b9b03b0c736 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.331140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:37.370273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5245e5-8bd5-48d0-9c19-029d7301b7fe None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.398420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:37.400577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023affa-4944-45d4-8ccd-8b9b03b0c736 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.408183 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c7e80-e738-4650-b5ce-381afe12b0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.409572 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c7e80-e738-4650-b5ce-381afe12b0de None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.409856 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c7e80-e738-4650-b5ce-381afe12b0de None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.410131 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c7e80-e738-4650-b5ce-381afe12b0de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.421033 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c7e80-e738-4650-b5ce-381afe12b0de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:37.422930 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c7e80-e738-4650-b5ce-381afe12b0de None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:37.436544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e2d5e-54bf-42f7-9e59-959e30624ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.437235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e2d5e-54bf-42f7-9e59-959e30624ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.437543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e2d5e-54bf-42f7-9e59-959e30624ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.437821 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e2d5e-54bf-42f7-9e59-959e30624ac9 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.438541 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e2d5e-54bf-42f7-9e59-959e30624ac9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:37.438849 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e2d5e-54bf-42f7-9e59-959e30624ac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:37.440215 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e2d5e-54bf-42f7-9e59-959e30624ac9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:37.440568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-690c7e80-e738-4650-b5ce-381afe12b0de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:37.440568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:37.440568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:37.440568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:37.440568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:37.440568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:37.440568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:37.440568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:37.440568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:37.440568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:37.440568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:37.440568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:37.440568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:37.440568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:37.440568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:37.441440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:37.442341 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:37.442341 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:37.442341 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:37.442341 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:37.442341 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 408/814] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:37.442623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c7e80-e738-4650-b5ce-381afe12b0de None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.447063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 407/815] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:37.448140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118fae3-23f4-424b-9578-1304d725eb0d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.448434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118fae3-23f4-424b-9578-1304d725eb0d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.448710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118fae3-23f4-424b-9578-1304d725eb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.467286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-f118fae3-23f4-424b-9578-1304d725eb0d None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:37.468705 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f118fae3-23f4-424b-9578-1304d725eb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:37.541455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 408/816] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:37.541455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118fae3-23f4-424b-9578-1304d725eb0d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.570200 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c7e80-e738-4650-b5ce-381afe12b0de None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.571320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:37.607361 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9c707-a3c8-4ef0-a75d-a9b59a028762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.607950 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9c707-a3c8-4ef0-a75d-a9b59a028762 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.607950 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9c707-a3c8-4ef0-a75d-a9b59a028762 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.608253 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9c707-a3c8-4ef0-a75d-a9b59a028762 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.609046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9c707-a3c8-4ef0-a75d-a9b59a028762 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:37.609497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9c707-a3c8-4ef0-a75d-a9b59a028762 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:37.610821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9c707-a3c8-4ef0-a75d-a9b59a028762 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:37.633388 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 409/817] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:37.633388 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9c707-a3c8-4ef0-a75d-a9b59a028762 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.649307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118fae3-23f4-424b-9578-1304d725eb0d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.669430 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:37.686023 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528378c4-74be-4d90-ba79-11e71af7abb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.686704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528378c4-74be-4d90-ba79-11e71af7abb5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.686984 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528378c4-74be-4d90-ba79-11e71af7abb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.687254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528378c4-74be-4d90-ba79-11e71af7abb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.687976 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528378c4-74be-4d90-ba79-11e71af7abb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:37.688286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528378c4-74be-4d90-ba79-11e71af7abb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:37.689690 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528378c4-74be-4d90-ba79-11e71af7abb5 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:37.701210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 409/818] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:37.702041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528378c4-74be-4d90-ba79-11e71af7abb5 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.743251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9c707-a3c8-4ef0-a75d-a9b59a028762 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.779361 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52704f-de86-4c29-a356-ed801869c1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.780032 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52704f-de86-4c29-a356-ed801869c1d1 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.780711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52704f-de86-4c29-a356-ed801869c1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.781013 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52704f-de86-4c29-a356-ed801869c1d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.781799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52704f-de86-4c29-a356-ed801869c1d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:37.783547 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52704f-de86-4c29-a356-ed801869c1d1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:37.801078 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:37.813379 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 410/819] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 15 00:22:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:37.813379 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52704f-de86-4c29-a356-ed801869c1d1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:37.816752 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528378c4-74be-4d90-ba79-11e71af7abb5 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:37.867879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e165a6-972e-4dd5-afba-1964c114e93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:37.868727 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e165a6-972e-4dd5-afba-1964c114e93a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:37.869006 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e165a6-972e-4dd5-afba-1964c114e93a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:37.869274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e165a6-972e-4dd5-afba-1964c114e93a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:37.869964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e165a6-972e-4dd5-afba-1964c114e93a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:37.871389 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e165a6-972e-4dd5-afba-1964c114e93a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:37.888026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c7e165a6-972e-4dd5-afba-1964c114e93a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:22:37.888026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:37.888026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:37.888026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:37.888026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:37.888026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:37.888026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:37.888026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:37.888026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:22:37.888026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:37.888026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:37.888026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:37.888026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:37.888026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:37.888026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:37.888026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:37.889064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:37.889064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:37.889064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:37.889064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:37.889064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:37.889064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:37.889064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:37.889064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:37.889064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:37.889064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:37.889064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:37.889064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:37.889064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:37.889064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:37.889064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:37.889064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:37.890056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:37.890056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:37.890056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:37.890056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:37.890056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:37.890056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:37.890056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:37.890056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:37.890056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:37.890056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:37.890056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:37.890056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:37.890056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:37.890056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 15 00:22:37.890056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:37.892829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 410/820] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:37.893980 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e165a6-972e-4dd5-afba-1964c114e93a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.020266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e165a6-972e-4dd5-afba-1964c114e93a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.069333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:38.077153 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2c706-3345-433d-ae24-a08ef4def1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.078034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2c706-3345-433d-ae24-a08ef4def1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.078332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2c706-3345-433d-ae24-a08ef4def1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.078618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2c706-3345-433d-ae24-a08ef4def1d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.079586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52704f-de86-4c29-a356-ed801869c1d1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.088594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2c706-3345-433d-ae24-a08ef4def1d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.090520 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2c706-3345-433d-ae24-a08ef4def1d9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.108381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-5fd2c706-3345-433d-ae24-a08ef4def1d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:38.108381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:38.108381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:38.108381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:38.108381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:38.108381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:38.108381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:38.108381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:38.108381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:38.108381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:38.108381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:38.108381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:38.108381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:38.108381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:38.108381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:38.109362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:38.110275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:38.110275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:38.110275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:38.110275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:38.110275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:38.110275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:38.110275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:38.110275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:38.110275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 411/821] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:38.110762 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2c706-3345-433d-ae24-a08ef4def1d9 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.127938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:38.128121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cd34a-0166-4ad6-8b27-bfcac6eaa518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.128921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd34a-0166-4ad6-8b27-bfcac6eaa518 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.129828 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd34a-0166-4ad6-8b27-bfcac6eaa518 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.130222 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd34a-0166-4ad6-8b27-bfcac6eaa518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.207400 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cd34a-0166-4ad6-8b27-bfcac6eaa518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.209847 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cd34a-0166-4ad6-8b27-bfcac6eaa518 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.222656 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2c706-3345-433d-ae24-a08ef4def1d9 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.261531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a940c9-2b16-48c2-b349-13dcf9749ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.262217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a940c9-2b16-48c2-b349-13dcf9749ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.262505 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a940c9-2b16-48c2-b349-13dcf9749ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.262786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a940c9-2b16-48c2-b349-13dcf9749ce0 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.263536 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a940c9-2b16-48c2-b349-13dcf9749ce0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:38.263849 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a940c9-2b16-48c2-b349-13dcf9749ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.265255 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a940c9-2b16-48c2-b349-13dcf9749ce0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.269971 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 412/822] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Jun 15 00:22:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:38.270746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a940c9-2b16-48c2-b349-13dcf9749ce0 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.314299 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:38.326010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 411/823] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:37 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:22:38.326812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cd34a-0166-4ad6-8b27-bfcac6eaa518 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.353209 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:38.376823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a940c9-2b16-48c2-b349-13dcf9749ce0 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.412000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6979e-b986-42eb-a50e-3497f1b092c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.413096 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6979e-b986-42eb-a50e-3497f1b092c0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.413672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6979e-b986-42eb-a50e-3497f1b092c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.414001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6979e-b986-42eb-a50e-3497f1b092c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.414955 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6979e-b986-42eb-a50e-3497f1b092c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:38.415301 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6979e-b986-42eb-a50e-3497f1b092c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.417055 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6979e-b986-42eb-a50e-3497f1b092c0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.429811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 413/824] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:38.430737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cd34a-0166-4ad6-8b27-bfcac6eaa518 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.435171 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6979e-b986-42eb-a50e-3497f1b092c0 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.466802 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f37640-e383-4540-ab6a-e822c03d550b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.467482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f37640-e383-4540-ab6a-e822c03d550b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.467771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f37640-e383-4540-ab6a-e822c03d550b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.468053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f37640-e383-4540-ab6a-e822c03d550b None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.468776 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f37640-e383-4540-ab6a-e822c03d550b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:38.469091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f37640-e383-4540-ab6a-e822c03d550b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.470500 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f37640-e383-4540-ab6a-e822c03d550b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.475775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 412/825] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Jun 15 00:22:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:38.478162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f37640-e383-4540-ab6a-e822c03d550b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.538385 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:38.545181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6979e-b986-42eb-a50e-3497f1b092c0 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.579375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652b96d-d142-4146-9e92-5019db6f4b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.580105 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652b96d-d142-4146-9e92-5019db6f4b69 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.580392 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652b96d-d142-4146-9e92-5019db6f4b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.580671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652b96d-d142-4146-9e92-5019db6f4b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.585302 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f37640-e383-4540-ab6a-e822c03d550b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.587523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:38.625101 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23accfe-9e4e-4ffe-b792-b974952c7cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.626055 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23accfe-9e4e-4ffe-b792-b974952c7cd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.626333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23accfe-9e4e-4ffe-b792-b974952c7cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.626591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23accfe-9e4e-4ffe-b792-b974952c7cd1 None admin] PATH_INFO: `/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/ff27c57c1d1b4f4ab1a030995db2e63a/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.628661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23accfe-9e4e-4ffe-b792-b974952c7cd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc0f2a3e075946f1ad06146dfa252aa6, user_id=ff27c57c1d1b4f4ab1a030995db2e63a, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.630309 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23accfe-9e4e-4ffe-b792-b974952c7cd1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.653410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 413/826] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:38 2022] PUT /identity/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/ff27c57c1d1b4f4ab1a030995db2e63a/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:38.653410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23accfe-9e4e-4ffe-b792-b974952c7cd1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.721877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652b96d-d142-4146-9e92-5019db6f4b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.723951 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652b96d-d142-4146-9e92-5019db6f4b69 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.748871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-f652b96d-d142-4146-9e92-5019db6f4b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:38.748871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:38.748871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:38.748871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:38.748871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:38.748871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:38.748871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:38.748871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:38.748871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:38.748871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:38.748871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:38.748871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:38.748871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:38.748871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:38.748871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:38.749909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:38.750840 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:38.750840 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:38.750840 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:38.750840 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:38.753524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 414/827] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:38.758165 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652b96d-d142-4146-9e92-5019db6f4b69 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:38.774433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23accfe-9e4e-4ffe-b792-b974952c7cd1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.821405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c55413-374c-4dc2-96f3-6d01f5334b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.821405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c55413-374c-4dc2-96f3-6d01f5334b68 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.821405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c55413-374c-4dc2-96f3-6d01f5334b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.821977 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c55413-374c-4dc2-96f3-6d01f5334b68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.823701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c55413-374c-4dc2-96f3-6d01f5334b68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.824395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c55413-374c-4dc2-96f3-6d01f5334b68 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.827270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:38.863992 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 414/828] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 15 00:22:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:38.897688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652b96d-d142-4146-9e92-5019db6f4b69 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:38.944473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb44f5-7ac5-478e-8e89-d9e1f7c88439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:38.945106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb44f5-7ac5-478e-8e89-d9e1f7c88439 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:38.945421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb44f5-7ac5-478e-8e89-d9e1f7c88439 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:38.945747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb44f5-7ac5-478e-8e89-d9e1f7c88439 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:38.946678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb44f5-7ac5-478e-8e89-d9e1f7c88439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:38.946984 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb44f5-7ac5-478e-8e89-d9e1f7c88439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:38.948422 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb44f5-7ac5-478e-8e89-d9e1f7c88439 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:38.962785 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 415/829] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:38.968319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c55413-374c-4dc2-96f3-6d01f5334b68 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:39.047797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2932c3-8451-4ce0-b705-01244d2c4e25 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:39.048119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2932c3-8451-4ce0-b705-01244d2c4e25 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:39.048391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2932c3-8451-4ce0-b705-01244d2c4e25 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:39.050036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 416/830] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:22:39.055702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dda251-110c-4fdd-821f-b83b23239cfc None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:39.055702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dda251-110c-4fdd-821f-b83b23239cfc None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:39.055962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dda251-110c-4fdd-821f-b83b23239cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:39.081874 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-33dda251-110c-4fdd-821f-b83b23239cfc None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:39.083064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-33dda251-110c-4fdd-821f-b83b23239cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:39.093964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c55413-374c-4dc2-96f3-6d01f5334b68 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:39.132167 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0d2e1-ff33-47af-be19-4a9d01e9cdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:39.132655 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:39.132992 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d2e1-ff33-47af-be19-4a9d01e9cdfb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:39.133423 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d2e1-ff33-47af-be19-4a9d01e9cdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:39.133709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d2e1-ff33-47af-be19-4a9d01e9cdfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:39.141127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0d2e1-ff33-47af-be19-4a9d01e9cdfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:39.142652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0d2e1-ff33-47af-be19-4a9d01e9cdfb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:39.164195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-40c0d2e1-ff33-47af-be19-4a9d01e9cdfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:39.164195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:39.164195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:39.164195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:39.164195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:39.164195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:39.164195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:39.164195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:39.164195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:39.164195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:39.164195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:39.164195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:39.164195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:39.164195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:39.164195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:39.165544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:39.166647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:39.166647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:39.166647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:39.166647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:39.166647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:39.166647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:39.166647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:39.166647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:39.166647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 415/832] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:39.167219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 417/832] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:22:39.171671 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0d2e1-ff33-47af-be19-4a9d01e9cdfb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:39.189262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dda251-110c-4fdd-821f-b83b23239cfc None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:39.207795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:39.293212 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0d2e1-ff33-47af-be19-4a9d01e9cdfb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:39.313147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dda251-110c-4fdd-821f-b83b23239cfc None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:39.329766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba2e2d-de52-4c87-b3f4-89f25b796d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:39.330716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba2e2d-de52-4c87-b3f4-89f25b796d6a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:39.331187 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba2e2d-de52-4c87-b3f4-89f25b796d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:39.331610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba2e2d-de52-4c87-b3f4-89f25b796d6a None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:39.332555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba2e2d-de52-4c87-b3f4-89f25b796d6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:39.333013 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba2e2d-de52-4c87-b3f4-89f25b796d6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:39.334650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba2e2d-de52-4c87-b3f4-89f25b796d6a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:39.347625 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 416/833] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:39.354534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba2e2d-de52-4c87-b3f4-89f25b796d6a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:39.359059 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2218448-485f-41a7-8015-ce29e200d8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:39.360126 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2218448-485f-41a7-8015-ce29e200d8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:39.360601 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2218448-485f-41a7-8015-ce29e200d8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:39.361058 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2218448-485f-41a7-8015-ce29e200d8a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:39.373185 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2218448-485f-41a7-8015-ce29e200d8a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:39.381597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-e2218448-485f-41a7-8015-ce29e200d8a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:39.381597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:39.381597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:39.381597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:39.381597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:39.381597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:39.381597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:39.381597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:39.381597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:39.381597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:39.381597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:39.381597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:39.381597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:39.381597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:39.381597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:39.381597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:39.382585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:39.382585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:39.382585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:39.382585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:39.382585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:39.382585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:39.382585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:39.382585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:39.382585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:39.382585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:39.382585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:39.382585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:39.382585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:39.382585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:39.382585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:39.382585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:39.383440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:39.383440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:39.383440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:39.383440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:39.383440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:39.383440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:39.383440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:39.383440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:39.383440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:39.383440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:39.383440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:22:39.383440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:39.390967 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 418/834] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:22:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:39.392497 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2218448-485f-41a7-8015-ce29e200d8a9 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:39.434152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:39.456704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:39.466249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba2e2d-de52-4c87-b3f4-89f25b796d6a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:39.501556 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fee3e2-b0ea-494a-8c71-21fb0137f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:39.502384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fee3e2-b0ea-494a-8c71-21fb0137f132 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:39.502765 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fee3e2-b0ea-494a-8c71-21fb0137f132 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:39.503140 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fee3e2-b0ea-494a-8c71-21fb0137f132 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:39.504078 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fee3e2-b0ea-494a-8c71-21fb0137f132 None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=6d0ae1707c7041a0989889dbefeaf267) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:39.504669 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fee3e2-b0ea-494a-8c71-21fb0137f132 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:39.506108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fee3e2-b0ea-494a-8c71-21fb0137f132 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:39.514572 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2218448-485f-41a7-8015-ce29e200d8a9 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:39.517843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 417/835] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:39 2022] GET /identity/v3/role_assignments?user.id=6d0ae1707c7041a0989889dbefeaf267&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:39.552820 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b47c8-b29b-4b05-a704-be132a3f072f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:39.553895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b47c8-b29b-4b05-a704-be132a3f072f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:39.554354 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b47c8-b29b-4b05-a704-be132a3f072f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:39.554769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b47c8-b29b-4b05-a704-be132a3f072f None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:39.555681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b47c8-b29b-4b05-a704-be132a3f072f None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:39.556162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b47c8-b29b-4b05-a704-be132a3f072f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:39.557746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b47c8-b29b-4b05-a704-be132a3f072f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:39.572060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 419/836] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:22:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:39.573781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fee3e2-b0ea-494a-8c71-21fb0137f132 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:39.693150 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fee3e2-b0ea-494a-8c71-21fb0137f132 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:39.730058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b775778-b011-4f78-b17e-a96117b74887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:39.730874 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b775778-b011-4f78-b17e-a96117b74887 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:39.731152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b775778-b011-4f78-b17e-a96117b74887 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:39.731420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b775778-b011-4f78-b17e-a96117b74887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:39.743490 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b775778-b011-4f78-b17e-a96117b74887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:39.744785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b775778-b011-4f78-b17e-a96117b74887 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:39.762801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5b775778-b011-4f78-b17e-a96117b74887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:39.762801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:39.762801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:39.762801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:39.762801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:39.762801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:39.762801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:39.762801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:39.762801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:39.762801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:39.762801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:39.762801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:39.762801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:39.762801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:39.762801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:39.763753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:39.764653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:39.764653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:39.764653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:39.764653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:39.768660 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 418/837] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:39.770073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b47c8-b29b-4b05-a704-be132a3f072f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:39.877769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:39.882250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b47c8-b29b-4b05-a704-be132a3f072f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:39.918014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586e38f-c55d-41e0-99e8-9ca1beee1a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:39.919501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586e38f-c55d-41e0-99e8-9ca1beee1a29 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:39.919986 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586e38f-c55d-41e0-99e8-9ca1beee1a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:39.920463 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586e38f-c55d-41e0-99e8-9ca1beee1a29 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:39.921447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586e38f-c55d-41e0-99e8-9ca1beee1a29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:39.921956 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586e38f-c55d-41e0-99e8-9ca1beee1a29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:39.923530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586e38f-c55d-41e0-99e8-9ca1beee1a29 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:39.936883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 420/838] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:39.942485 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b775778-b011-4f78-b17e-a96117b74887 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:39.954374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:40.048731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b775778-b011-4f78-b17e-a96117b74887 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:40.086876 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800f0ec-c269-4bef-b883-715103f1dcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:40.087720 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800f0ec-c269-4bef-b883-715103f1dcd9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:40.088065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800f0ec-c269-4bef-b883-715103f1dcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:40.088348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800f0ec-c269-4bef-b883-715103f1dcd9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:40.096135 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800f0ec-c269-4bef-b883-715103f1dcd9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:40.097617 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800f0ec-c269-4bef-b883-715103f1dcd9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:40.113848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-2800f0ec-c269-4bef-b883-715103f1dcd9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:22:40.113848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:40.113848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:40.113848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:40.113848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:40.113848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:40.113848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:40.113848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:40.113848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:40.113848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:40.113848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:40.113848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:40.113848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:40.113848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:40.113848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:40.113848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:40.115208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:40.116226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:40.116226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:40.116226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:40.116226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:40.116226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:40.116226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:40.116226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:40.116226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:40.116226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:22:40.116226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:40.116226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 419/839] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 15 00:22:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:40.121552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586e38f-c55d-41e0-99e8-9ca1beee1a29 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:40.224328 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586e38f-c55d-41e0-99e8-9ca1beee1a29 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:40.259197 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618951e-9a67-4105-91c4-1d3ec80fe7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:40.259885 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618951e-9a67-4105-91c4-1d3ec80fe7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:40.260169 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618951e-9a67-4105-91c4-1d3ec80fe7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:40.260444 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618951e-9a67-4105-91c4-1d3ec80fe7a0 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:40.261288 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618951e-9a67-4105-91c4-1d3ec80fe7a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:40.261621 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618951e-9a67-4105-91c4-1d3ec80fe7a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:40.263066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618951e-9a67-4105-91c4-1d3ec80fe7a0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:40.281132 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 421/840] 10.222.0.36 () {56 vars in 1149 bytes} [Wed Jun 15 00:22:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:40.289395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800f0ec-c269-4bef-b883-715103f1dcd9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:40.358370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:40.392912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800f0ec-c269-4bef-b883-715103f1dcd9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:40.426693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf8dfd-3f0e-430a-a5c2-0a825081bf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:40.427351 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf8dfd-3f0e-430a-a5c2-0a825081bf8e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:40.427632 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf8dfd-3f0e-430a-a5c2-0a825081bf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:40.427906 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf8dfd-3f0e-430a-a5c2-0a825081bf8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:40.501481 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf8dfd-3f0e-430a-a5c2-0a825081bf8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:40.502867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf8dfd-3f0e-430a-a5c2-0a825081bf8e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:40.569014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:40.604602 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 420/841] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:40 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:22:40.610501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618951e-9a67-4105-91c4-1d3ec80fe7a0 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:40.631443 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:40.717990 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618951e-9a67-4105-91c4-1d3ec80fe7a0 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:40.755363 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa4c2f-d151-43e5-8b75-0ba08bc81854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:40.756096 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa4c2f-d151-43e5-8b75-0ba08bc81854 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:40.756374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa4c2f-d151-43e5-8b75-0ba08bc81854 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:40.756676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa4c2f-d151-43e5-8b75-0ba08bc81854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:40.767317 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa4c2f-d151-43e5-8b75-0ba08bc81854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:40.768777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa4c2f-d151-43e5-8b75-0ba08bc81854 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:40.787646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-7eaa4c2f-d151-43e5-8b75-0ba08bc81854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:40.787646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:40.787646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:40.787646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:40.787646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:40.787646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:40.787646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:40.787646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:40.787646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:40.787646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:40.787646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:40.787646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:40.787646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:40.787646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:40.787646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:40.789214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:40.790175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:40.790175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:40.790175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:40.790175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:40.793751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 422/842] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:40.798577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf8dfd-3f0e-430a-a5c2-0a825081bf8e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:40.870784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426d8d6-3182-4089-9cc0-a2773da02dee None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:40.871733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426d8d6-3182-4089-9cc0-a2773da02dee None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:40.872325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426d8d6-3182-4089-9cc0-a2773da02dee None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:40.874295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 423/843] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:22:40.879749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c707-bf05-48a5-aa81-0e6b0e353a76 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:40.880303 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c707-bf05-48a5-aa81-0e6b0e353a76 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:40.880802 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c707-bf05-48a5-aa81-0e6b0e353a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:40.899451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b349c707-bf05-48a5-aa81-0e6b0e353a76 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:40.900920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b349c707-bf05-48a5-aa81-0e6b0e353a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:40.914534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf8dfd-3f0e-430a-a5c2-0a825081bf8e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:40.950192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1aea5b-e717-4e10-8c37-844853410e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:40.951142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1aea5b-e717-4e10-8c37-844853410e03 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:40.951587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1aea5b-e717-4e10-8c37-844853410e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:40.952014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1aea5b-e717-4e10-8c37-844853410e03 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:40.952888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1aea5b-e717-4e10-8c37-844853410e03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:40.953381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1aea5b-e717-4e10-8c37-844853410e03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:40.954899 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1aea5b-e717-4e10-8c37-844853410e03 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:40.965880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:40.968179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 421/844] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:40.974728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1aea5b-e717-4e10-8c37-844853410e03 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:40.977925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 424/845] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:41.004115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349c707-bf05-48a5-aa81-0e6b0e353a76 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:41.014931 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:41.116768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1aea5b-e717-4e10-8c37-844853410e03 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:41.142646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349c707-bf05-48a5-aa81-0e6b0e353a76 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:41.155477 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f071f-cc4f-4b95-b35a-95db5b64ae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:41.156637 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f071f-cc4f-4b95-b35a-95db5b64ae7a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.157224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f071f-cc4f-4b95-b35a-95db5b64ae7a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.157728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f071f-cc4f-4b95-b35a-95db5b64ae7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.165551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f071f-cc4f-4b95-b35a-95db5b64ae7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:41.167253 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f071f-cc4f-4b95-b35a-95db5b64ae7a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:41.178441 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a53da9-055b-4e20-b69c-7cd50497d692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:41.179257 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a53da9-055b-4e20-b69c-7cd50497d692 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.179539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a53da9-055b-4e20-b69c-7cd50497d692 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.179816 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a53da9-055b-4e20-b69c-7cd50497d692 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.183891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-637f071f-cc4f-4b95-b35a-95db5b64ae7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:41.183891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:41.183891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:41.183891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:41.183891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:41.183891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:41.183891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:41.183891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:41.183891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:41.183891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:41.183891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:41.183891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:41.183891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:41.183891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:41.183891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:41.184769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:41.185714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:41.185714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:41.185714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:41.185714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:41.185714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:41.185714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:41.185714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:41.185714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:41.188151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 422/846] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:41.189650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8eea8-a80d-4bae-9821-dd60463c812e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.190006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8eea8-a80d-4bae-9821-dd60463c812e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.190356 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8eea8-a80d-4bae-9821-dd60463c812e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.191690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 423/847] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:41.193250 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8eea8-a80d-4bae-9821-dd60463c812e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:41.194556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a53da9-055b-4e20-b69c-7cd50497d692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:41.202654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-60a53da9-055b-4e20-b69c-7cd50497d692 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:41.202654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:41.202654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:41.202654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:41.202654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:41.202654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:41.202654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:41.202654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:41.202654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:41.202654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:41.202654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:41.202654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:41.202654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:41.202654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:41.202654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:41.202654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:41.203614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:41.203614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:41.203614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:41.203614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:41.203614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:41.203614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:41.203614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:41.203614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:41.203614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:41.203614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:41.203614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:41.203614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:41.203614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:41.203614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:41.203614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:41.203614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:41.204488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:41.204488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:41.204488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:41.204488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:41.204488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:41.204488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:41.204488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:41.204488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:41.204488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:41.204488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:41.204488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:22:41.204488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:41.204488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 425/848] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:41.205200 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f88d3-711f-48ce-a251-8cf07665f106 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.205375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f88d3-711f-48ce-a251-8cf07665f106 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.205798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f88d3-711f-48ce-a251-8cf07665f106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.223689 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-bd3f88d3-711f-48ce-a251-8cf07665f106 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:41.224881 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-bd3f88d3-711f-48ce-a251-8cf07665f106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:41.279920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:41.292067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:41.296526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 426/849] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:41.297606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f88d3-711f-48ce-a251-8cf07665f106 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:41.312368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8eea8-a80d-4bae-9821-dd60463c812e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:41.350985 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5a9e4-a70a-4d9a-92ae-3d3010eeb79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:41.351965 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5a9e4-a70a-4d9a-92ae-3d3010eeb79e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.352463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5a9e4-a70a-4d9a-92ae-3d3010eeb79e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.352752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5a9e4-a70a-4d9a-92ae-3d3010eeb79e None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.353598 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5a9e4-a70a-4d9a-92ae-3d3010eeb79e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:41.353912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5a9e4-a70a-4d9a-92ae-3d3010eeb79e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:41.355339 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5a9e4-a70a-4d9a-92ae-3d3010eeb79e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:41.367679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 424/850] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:41.373248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5a9e4-a70a-4d9a-92ae-3d3010eeb79e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:41.405848 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f88d3-711f-48ce-a251-8cf07665f106 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:41.442529 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa4474-5070-4226-9634-f6bcf609d979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:41.443308 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa4474-5070-4226-9634-f6bcf609d979 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.443607 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa4474-5070-4226-9634-f6bcf609d979 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.443885 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa4474-5070-4226-9634-f6bcf609d979 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.444643 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa4474-5070-4226-9634-f6bcf609d979 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:41.444955 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa4474-5070-4226-9634-f6bcf609d979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:41.446805 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa4474-5070-4226-9634-f6bcf609d979 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:41.459415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 427/851] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:41.459415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa4474-5070-4226-9634-f6bcf609d979 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:41.481016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5a9e4-a70a-4d9a-92ae-3d3010eeb79e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:41.513070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:41.516307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e64c28-995b-42bf-b160-6c4b6edfc7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:41.517127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e64c28-995b-42bf-b160-6c4b6edfc7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.517439 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e64c28-995b-42bf-b160-6c4b6edfc7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.517715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e64c28-995b-42bf-b160-6c4b6edfc7c7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.518520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e64c28-995b-42bf-b160-6c4b6edfc7c7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:41.519890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e64c28-995b-42bf-b160-6c4b6edfc7c7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b6e64c28-995b-42bf-b160-6c4b6edfc7c7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:41.533334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:41.534413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:41.534413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:41.534413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:41.534413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:41.534413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:41.534413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:41.534413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:41.534413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:41.534413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:41.534413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:41.534413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:41.534413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:41.534413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:41.534413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:41.534413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:41.534413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:41.535274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:41.535274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:41.535274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:41.535274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:41.535274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:41.535274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:41.535274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:41.535274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:41.535274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:41.535274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:41.535274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:41.535274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:41.535274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:22:41.535274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:41.535274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 425/852] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:41.536508 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e64c28-995b-42bf-b160-6c4b6edfc7c7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:41.555943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:41.571668 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa4474-5070-4226-9634-f6bcf609d979 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:41.609565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c65ca-33df-4be9-998b-cb9344f3da4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:41.610238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c65ca-33df-4be9-998b-cb9344f3da4e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.610529 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c65ca-33df-4be9-998b-cb9344f3da4e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.610924 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c65ca-33df-4be9-998b-cb9344f3da4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.611882 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c65ca-33df-4be9-998b-cb9344f3da4e None admin] RBAC: Adding query filter params (role.id=4afb8bd8c6354dd9b143ef4aaa8284fa, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=54123f8a9de7428bb7e34557aea23ebf) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:41.612231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c65ca-33df-4be9-998b-cb9344f3da4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:41.613727 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c65ca-33df-4be9-998b-cb9344f3da4e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:41.621148 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 428/853] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:41 2022] GET /identity/v3/role_assignments?user.id=54123f8a9de7428bb7e34557aea23ebf&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=4afb8bd8c6354dd9b143ef4aaa8284fa => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:41.621977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c65ca-33df-4be9-998b-cb9344f3da4e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:41.662246 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e64c28-995b-42bf-b160-6c4b6edfc7c7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:41.706068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f287b-5d9c-44f6-a10f-ed88281e74ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:41.707446 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f287b-5d9c-44f6-a10f-ed88281e74ee None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.707999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f287b-5d9c-44f6-a10f-ed88281e74ee None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.708490 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f287b-5d9c-44f6-a10f-ed88281e74ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.722635 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f287b-5d9c-44f6-a10f-ed88281e74ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:41.724603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f287b-5d9c-44f6-a10f-ed88281e74ee None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:41.744012 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c65ca-33df-4be9-998b-cb9344f3da4e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:41.745694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-6a4f287b-5d9c-44f6-a10f-ed88281e74ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:41.745694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:41.745694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:41.745694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:41.745694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:41.745694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:41.745694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:41.745694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:41.745694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:41.745694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:41.745694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:41.745694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:41.745694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:41.745694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:41.745694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:41.746591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:41.747518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:41.747518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:41.747518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:41.747518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:41.754552 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 426/854] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:41.755945 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f287b-5d9c-44f6-a10f-ed88281e74ee None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:41.759727 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:41.785447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f35b40-c875-4539-be5d-48abdd120d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:41.786087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f35b40-c875-4539-be5d-48abdd120d90 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.786379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f35b40-c875-4539-be5d-48abdd120d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.786655 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f35b40-c875-4539-be5d-48abdd120d90 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.787384 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f35b40-c875-4539-be5d-48abdd120d90 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:41.787750 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f35b40-c875-4539-be5d-48abdd120d90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:41.789172 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f35b40-c875-4539-be5d-48abdd120d90 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:41.794677 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 429/855] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:41.796002 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b6205-f7a6-40ce-856a-bfdc03460e39 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.796290 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b6205-f7a6-40ce-856a-bfdc03460e39 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.796568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b6205-f7a6-40ce-856a-bfdc03460e39 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.797996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 430/856] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:41.802366 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b6205-f7a6-40ce-856a-bfdc03460e39 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:41.837122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:41.883791 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f287b-5d9c-44f6-a10f-ed88281e74ee None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:41.922688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9c3a9-5fb6-4027-bbc9-77400cd43372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:41.923885 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9c3a9-5fb6-4027-bbc9-77400cd43372 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.924170 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9c3a9-5fb6-4027-bbc9-77400cd43372 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.924449 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9c3a9-5fb6-4027-bbc9-77400cd43372 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.925178 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9c3a9-5fb6-4027-bbc9-77400cd43372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:41.925522 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9c3a9-5fb6-4027-bbc9-77400cd43372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:41.928532 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b6205-f7a6-40ce-856a-bfdc03460e39 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:41.929081 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9c3a9-5fb6-4027-bbc9-77400cd43372 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:41.945254 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 427/857] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:41.945254 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55374a13-c6cf-4310-b080-741b92a3b920 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.945254 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55374a13-c6cf-4310-b080-741b92a3b920 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.945254 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55374a13-c6cf-4310-b080-741b92a3b920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.961562 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-55374a13-c6cf-4310-b080-741b92a3b920 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:41.962838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-55374a13-c6cf-4310-b080-741b92a3b920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:41.968695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cce33e-68a6-4b74-abb7-0336f0fd9db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:41.969388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce33e-68a6-4b74-abb7-0336f0fd9db0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:41.969697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce33e-68a6-4b74-abb7-0336f0fd9db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:41.969975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce33e-68a6-4b74-abb7-0336f0fd9db0 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:41.971104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cce33e-68a6-4b74-abb7-0336f0fd9db0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:41.971414 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cce33e-68a6-4b74-abb7-0336f0fd9db0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:41.973166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cce33e-68a6-4b74-abb7-0336f0fd9db0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:41.985373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 431/858] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:41 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:41.985373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cce33e-68a6-4b74-abb7-0336f0fd9db0 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:42.037925 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 428/859] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:42.049919 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:42.066359 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55374a13-c6cf-4310-b080-741b92a3b920 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:42.126504 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cce33e-68a6-4b74-abb7-0336f0fd9db0 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:42.129775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:42.177167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc185d4-3e2f-4293-963a-9f0fe8904ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:42.178020 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc185d4-3e2f-4293-963a-9f0fe8904ccb None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.178349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc185d4-3e2f-4293-963a-9f0fe8904ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.178630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc185d4-3e2f-4293-963a-9f0fe8904ccb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.184915 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55374a13-c6cf-4310-b080-741b92a3b920 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:42.190038 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc185d4-3e2f-4293-963a-9f0fe8904ccb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:42.191538 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc185d4-3e2f-4293-963a-9f0fe8904ccb None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:42.206340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-3bc185d4-3e2f-4293-963a-9f0fe8904ccb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:22:42.206340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:42.206340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:42.206340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:42.206340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:42.206340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:42.206340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:42.206340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:42.206340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:42.206340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:42.206340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:42.206340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:42.206340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:42.206340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:42.206340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:42.206340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:42.207330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:42.208292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:42.208292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:42.208292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:42.208292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:42.208292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:42.208292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:42.208292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:42.208292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:42.208292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 15 00:22:42.208292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:42.208292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 432/860] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:22:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:42.218319 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc185d4-3e2f-4293-963a-9f0fe8904ccb None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:42.227348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89156a1b-7411-4cff-9732-3b07cecbb6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:42.228179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89156a1b-7411-4cff-9732-3b07cecbb6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.228459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89156a1b-7411-4cff-9732-3b07cecbb6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.228731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89156a1b-7411-4cff-9732-3b07cecbb6a8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.229423 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89156a1b-7411-4cff-9732-3b07cecbb6a8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:42.231063 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89156a1b-7411-4cff-9732-3b07cecbb6a8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:42.244014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-89156a1b-7411-4cff-9732-3b07cecbb6a8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:22:42.244014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:42.244014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:42.244014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:42.244014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:42.244014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:42.244014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:42.244014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:42.244014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:22:42.244014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:42.244014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:42.244014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:42.244014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:42.244014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:42.244014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:42.244014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:42.245039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:42.245039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:42.245039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:42.245039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:42.245039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:42.245039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:42.245039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:42.245039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:42.245039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:42.245039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:42.245039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:42.245039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:42.245039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:42.245039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:42.245039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:42.245039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:42.246006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:42.246006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:42.246006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:42.246006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:42.246006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:42.246006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:42.246006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:42.246006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:42.246006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:42.246006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:42.246006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:42.246006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:42.246006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:42.246006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:22:42.246006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:42.246006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 429/861] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Jun 15 00:22:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:42.251285 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89156a1b-7411-4cff-9732-3b07cecbb6a8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:42.353909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc185d4-3e2f-4293-963a-9f0fe8904ccb None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:42.355521 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:42.370954 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89156a1b-7411-4cff-9732-3b07cecbb6a8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:42.391312 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8a993-8cbd-41a3-98f4-0239d16408ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:42.392004 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8a993-8cbd-41a3-98f4-0239d16408ec None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.392288 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8a993-8cbd-41a3-98f4-0239d16408ec None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.392564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8a993-8cbd-41a3-98f4-0239d16408ec None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.393436 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8a993-8cbd-41a3-98f4-0239d16408ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:42.393747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8a993-8cbd-41a3-98f4-0239d16408ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:42.395187 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8a993-8cbd-41a3-98f4-0239d16408ec None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:42.395435 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:42.420226 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 433/862] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Jun 15 00:22:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:42.421180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d013c6-f5fa-4bed-9c7d-8f7a297fb180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:42.421921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d013c6-f5fa-4bed-9c7d-8f7a297fb180 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.422206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d013c6-f5fa-4bed-9c7d-8f7a297fb180 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.422490 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d013c6-f5fa-4bed-9c7d-8f7a297fb180 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.423200 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d013c6-f5fa-4bed-9c7d-8f7a297fb180 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:42.423510 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d013c6-f5fa-4bed-9c7d-8f7a297fb180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:42.424932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d013c6-f5fa-4bed-9c7d-8f7a297fb180 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:42.426525 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8a993-8cbd-41a3-98f4-0239d16408ec None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:42.434672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 430/863] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 15 00:22:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:42.435673 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d013c6-f5fa-4bed-9c7d-8f7a297fb180 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:42.546027 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d013c6-f5fa-4bed-9c7d-8f7a297fb180 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:42.559768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8a993-8cbd-41a3-98f4-0239d16408ec None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:42.581051 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12c70d-4465-41b5-a615-43387006bd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:42.581882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12c70d-4465-41b5-a615-43387006bd94 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.582233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12c70d-4465-41b5-a615-43387006bd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.582575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12c70d-4465-41b5-a615-43387006bd94 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.583355 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12c70d-4465-41b5-a615-43387006bd94 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:42.583934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12c70d-4465-41b5-a615-43387006bd94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:42.585223 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12c70d-4465-41b5-a615-43387006bd94 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:42.596322 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 431/864] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 15 00:22:42 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:42.603261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9088bc3-e635-4c3b-bf93-70dda134dbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:42.604334 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9088bc3-e635-4c3b-bf93-70dda134dbd4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.604799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9088bc3-e635-4c3b-bf93-70dda134dbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.605272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9088bc3-e635-4c3b-bf93-70dda134dbd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.638042 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:42.684764 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9088bc3-e635-4c3b-bf93-70dda134dbd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:42.686610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9088bc3-e635-4c3b-bf93-70dda134dbd4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:42.798398 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 434/865] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:42 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:22:42.804428 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12c70d-4465-41b5-a615-43387006bd94 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:42.854011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:42.913862 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12c70d-4465-41b5-a615-43387006bd94 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:42.947841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abedc1a-50b7-45ad-b1d4-824d90ce3f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:42.948951 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abedc1a-50b7-45ad-b1d4-824d90ce3f01 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:42.949437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abedc1a-50b7-45ad-b1d4-824d90ce3f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:42.949918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abedc1a-50b7-45ad-b1d4-824d90ce3f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:42.960972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abedc1a-50b7-45ad-b1d4-824d90ce3f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:42.962709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abedc1a-50b7-45ad-b1d4-824d90ce3f01 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:42.980126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-9abedc1a-50b7-45ad-b1d4-824d90ce3f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:42.980126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:42.980126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:42.980126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:42.980126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:42.980126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:42.980126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:42.980126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:42.980126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:42.980126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:42.980126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:42.980126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:42.980126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:42.980126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:42.980126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:42.981039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:42.982000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:42.982000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:42.982000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:42.982000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:42.984023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 432/866] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:42.989993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9088bc3-e635-4c3b-bf93-70dda134dbd4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:43.052024 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:43.095993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9088bc3-e635-4c3b-bf93-70dda134dbd4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:43.137111 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1599fe4-fdd3-4ef1-9f2f-d00ff1b22d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:43.138210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1599fe4-fdd3-4ef1-9f2f-d00ff1b22d00 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:43.138696 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1599fe4-fdd3-4ef1-9f2f-d00ff1b22d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:43.139168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1599fe4-fdd3-4ef1-9f2f-d00ff1b22d00 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:43.140112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1599fe4-fdd3-4ef1-9f2f-d00ff1b22d00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:43.140638 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1599fe4-fdd3-4ef1-9f2f-d00ff1b22d00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:43.142252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1599fe4-fdd3-4ef1-9f2f-d00ff1b22d00 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:43.154752 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 435/867] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:43.160205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abedc1a-50b7-45ad-b1d4-824d90ce3f01 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:43.257587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:43.262081 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abedc1a-50b7-45ad-b1d4-824d90ce3f01 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:43.296542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13931645-20f7-496f-ad9a-542f34c29620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:43.297380 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13931645-20f7-496f-ad9a-542f34c29620 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:43.297659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13931645-20f7-496f-ad9a-542f34c29620 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:43.297939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13931645-20f7-496f-ad9a-542f34c29620 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:43.304814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13931645-20f7-496f-ad9a-542f34c29620 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:43.306285 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13931645-20f7-496f-ad9a-542f34c29620 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:43.321072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-13931645-20f7-496f-ad9a-542f34c29620 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:43.321072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:43.321072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:43.321072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:43.321072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:43.321072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:43.321072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:43.321072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:43.321072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:43.321072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:43.321072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:43.321072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:43.321072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:43.321072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:43.321072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:43.322028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:43.322960 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:43.322960 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:43.322960 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:43.322960 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:43.322960 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:43.322960 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:43.322960 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:43.322960 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:43.322960 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 433/868] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:43.328337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1599fe4-fdd3-4ef1-9f2f-d00ff1b22d00 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:43.433466 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1599fe4-fdd3-4ef1-9f2f-d00ff1b22d00 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:43.454285 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:43.469811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb9e14-da9c-4a99-a2fc-1bb6eada97b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:43.470852 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb9e14-da9c-4a99-a2fc-1bb6eada97b9 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:43.471337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb9e14-da9c-4a99-a2fc-1bb6eada97b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:43.471811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb9e14-da9c-4a99-a2fc-1bb6eada97b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:43.472809 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb9e14-da9c-4a99-a2fc-1bb6eada97b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:43.473339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb9e14-da9c-4a99-a2fc-1bb6eada97b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:43.475001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb9e14-da9c-4a99-a2fc-1bb6eada97b9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:43.488366 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 436/869] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:43.494417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13931645-20f7-496f-ad9a-542f34c29620 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:43.597862 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13931645-20f7-496f-ad9a-542f34c29620 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:43.633786 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba286e-6651-4e5c-bdb4-9ec5115575e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:43.634448 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba286e-6651-4e5c-bdb4-9ec5115575e3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:43.634728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba286e-6651-4e5c-bdb4-9ec5115575e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:43.635004 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba286e-6651-4e5c-bdb4-9ec5115575e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:43.635834 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba286e-6651-4e5c-bdb4-9ec5115575e3 None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=ff27c57c1d1b4f4ab1a030995db2e63a) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:43.636146 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba286e-6651-4e5c-bdb4-9ec5115575e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:43.637650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba286e-6651-4e5c-bdb4-9ec5115575e3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:43.643938 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 434/870] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:43 2022] GET /identity/v3/role_assignments?user.id=ff27c57c1d1b4f4ab1a030995db2e63a&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:43.904194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c9d20-869d-48b8-88cd-265227b7fb8e None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:43.904194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c9d20-869d-48b8-88cd-265227b7fb8e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:43.904194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c9d20-869d-48b8-88cd-265227b7fb8e None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:43.904772 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 437/871] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:43.910192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a76af-8006-4a9a-bbc3-f5814637693c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:43.910641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a76af-8006-4a9a-bbc3-f5814637693c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:43.910916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a76af-8006-4a9a-bbc3-f5814637693c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:43.927905 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-618a76af-8006-4a9a-bbc3-f5814637693c None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:43.929278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-618a76af-8006-4a9a-bbc3-f5814637693c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:43.946436 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:44.000526 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 435/872] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:44.024207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c9d20-869d-48b8-88cd-265227b7fb8e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:44.133147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c9d20-869d-48b8-88cd-265227b7fb8e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:44.151812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e187b-71ef-483f-b363-eb58c999e934 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:44.152111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e187b-71ef-483f-b363-eb58c999e934 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:44.152370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e187b-71ef-483f-b363-eb58c999e934 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:44.157551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 436/873] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:44.158981 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f49e6-d762-4310-8760-5ab1fe872025 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:44.159300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f49e6-d762-4310-8760-5ab1fe872025 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:44.159549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f49e6-d762-4310-8760-5ab1fe872025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:44.168964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62394f-299b-4e25-b1e8-9b2b2b69d0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:44.169825 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62394f-299b-4e25-b1e8-9b2b2b69d0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:44.170104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62394f-299b-4e25-b1e8-9b2b2b69d0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:44.170791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62394f-299b-4e25-b1e8-9b2b2b69d0d7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:44.175969 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b11f49e6-d762-4310-8760-5ab1fe872025 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:44.177208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b11f49e6-d762-4310-8760-5ab1fe872025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:44.182544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62394f-299b-4e25-b1e8-9b2b2b69d0d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:44.192994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-3d62394f-299b-4e25-b1e8-9b2b2b69d0d7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:22:44.192994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:44.192994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:44.192994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:44.192994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:44.192994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:44.192994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:44.192994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:44.192994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:44.192994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:44.192994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:44.192994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:44.192994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:44.192994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:44.192994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:44.192994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:44.194062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:44.194062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:44.194062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:44.194062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:44.194062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:44.194062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:44.194062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:44.194062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:44.194062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:44.194062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:44.194062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:44.194062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:44.194062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:44.194062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:44.194062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:44.194062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:44.194932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:44.194932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:44.194932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:44.194932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:44.194932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:44.194932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:44.194932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:44.194932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:44.194932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:44.194932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:44.194932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:22:44.194932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:44.195582 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 438/874] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Jun 15 00:22:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:44.200936 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62394f-299b-4e25-b1e8-9b2b2b69d0d7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:44.257443 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 437/875] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:44.257975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:44.276192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f49e6-d762-4310-8760-5ab1fe872025 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:44.324230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62394f-299b-4e25-b1e8-9b2b2b69d0d7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:44.360784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c4ade-f946-4c8d-ba33-f12d2af224da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:44.362045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4ade-f946-4c8d-ba33-f12d2af224da None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:44.362548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4ade-f946-4c8d-ba33-f12d2af224da None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:44.363018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4ade-f946-4c8d-ba33-f12d2af224da None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:44.363979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c4ade-f946-4c8d-ba33-f12d2af224da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:44.364507 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c4ade-f946-4c8d-ba33-f12d2af224da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:44.366532 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c4ade-f946-4c8d-ba33-f12d2af224da None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:44.375396 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:44.377570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 439/876] 10.222.0.36 () {56 vars in 1115 bytes} [Wed Jun 15 00:22:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:44.383577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c4ade-f946-4c8d-ba33-f12d2af224da None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:44.398949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f49e6-d762-4310-8760-5ab1fe872025 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:44.436445 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050b58c-f7fc-4d49-9b33-32d975b81e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:44.437649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050b58c-f7fc-4d49-9b33-32d975b81e6f None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:44.438161 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050b58c-f7fc-4d49-9b33-32d975b81e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:44.438629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050b58c-f7fc-4d49-9b33-32d975b81e6f None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:44.439650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050b58c-f7fc-4d49-9b33-32d975b81e6f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:44.441395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050b58c-f7fc-4d49-9b33-32d975b81e6f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:44.461380 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 438/877] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 15 00:22:44 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:22:44.508137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c4ade-f946-4c8d-ba33-f12d2af224da None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:44.511323 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:44.553427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb9974-98f9-4219-9da9-d30432bcdd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:44.554266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb9974-98f9-4219-9da9-d30432bcdd84 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:44.554553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb9974-98f9-4219-9da9-d30432bcdd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:44.554830 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb9974-98f9-4219-9da9-d30432bcdd84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:44.567261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb9974-98f9-4219-9da9-d30432bcdd84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:44.568834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb9974-98f9-4219-9da9-d30432bcdd84 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:44.587597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-cecb9974-98f9-4219-9da9-d30432bcdd84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:44.587597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:44.587597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:44.587597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:44.587597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:44.587597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:44.587597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:44.587597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:44.587597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:44.587597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:44.587597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:44.587597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:44.587597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:44.587597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:44.587597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:44.588594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:44.589863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:44.589863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:44.589863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:44.589863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:44.589863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 440/878] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:44.595247 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050b58c-f7fc-4d49-9b33-32d975b81e6f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:44.701810 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050b58c-f7fc-4d49-9b33-32d975b81e6f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:44.736310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba6a4e-b099-4f88-bd47-dc2948c366d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:44.736994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba6a4e-b099-4f88-bd47-dc2948c366d4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:44.737278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba6a4e-b099-4f88-bd47-dc2948c366d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:44.737578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba6a4e-b099-4f88-bd47-dc2948c366d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:44.738313 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba6a4e-b099-4f88-bd47-dc2948c366d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:44.738626 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba6a4e-b099-4f88-bd47-dc2948c366d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:44.740532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba6a4e-b099-4f88-bd47-dc2948c366d4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:44.753143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 439/879] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:44.758776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb9974-98f9-4219-9da9-d30432bcdd84 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:44.869114 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb9974-98f9-4219-9da9-d30432bcdd84 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:44.871970 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eeb81-6305-4047-a4c5-ecbc2af5104e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:44.872263 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eeb81-6305-4047-a4c5-ecbc2af5104e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:44.872546 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8eeb81-6305-4047-a4c5-ecbc2af5104e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:44.874204 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 440/880] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:44.879179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f88a96-6ebd-435f-aa7b-9785537af841 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:44.879465 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f88a96-6ebd-435f-aa7b-9785537af841 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:44.879739 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f88a96-6ebd-435f-aa7b-9785537af841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:44.884935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:44.902691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-52f88a96-6ebd-435f-aa7b-9785537af841 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:44.903979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-52f88a96-6ebd-435f-aa7b-9785537af841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:44.905485 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4350f-aea0-485e-975b-08c10cac0280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:44.906329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4350f-aea0-485e-975b-08c10cac0280 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:44.906613 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4350f-aea0-485e-975b-08c10cac0280 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:44.906883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4350f-aea0-485e-975b-08c10cac0280 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:44.915381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4350f-aea0-485e-975b-08c10cac0280 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:44.916908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4350f-aea0-485e-975b-08c10cac0280 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:44.932118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-e8a4350f-aea0-485e-975b-08c10cac0280 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:22:44.932118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:44.932118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:44.932118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:44.932118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:44.932118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:44.932118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:44.932118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:44.932118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:44.932118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:44.932118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:44.932118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:44.932118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:44.932118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:44.932118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:44.932118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:44.933080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:44.934069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:44.934069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:44.934069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:44.934069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:44.934069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:44.934069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:44.934069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:44.934069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:44.934069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:22:44.934069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:44.934069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 441/881] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 15 00:22:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:44.939388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4350f-aea0-485e-975b-08c10cac0280 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:44.953654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:45.000651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 441/882] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:44 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:45.025803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f88a96-6ebd-435f-aa7b-9785537af841 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:45.058722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4350f-aea0-485e-975b-08c10cac0280 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:45.094687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47330b6-64c9-4426-b7f8-1f66927d80b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:45.095466 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47330b6-64c9-4426-b7f8-1f66927d80b5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:45.095821 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47330b6-64c9-4426-b7f8-1f66927d80b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:45.096170 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47330b6-64c9-4426-b7f8-1f66927d80b5 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:45.097141 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47330b6-64c9-4426-b7f8-1f66927d80b5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:45.097564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47330b6-64c9-4426-b7f8-1f66927d80b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:45.099069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47330b6-64c9-4426-b7f8-1f66927d80b5 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:45.117977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 442/883] 10.222.0.36 () {56 vars in 1149 bytes} [Wed Jun 15 00:22:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:45.123584 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47330b6-64c9-4426-b7f8-1f66927d80b5 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:45.137525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f88a96-6ebd-435f-aa7b-9785537af841 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:45.167597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:45.173873 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc756f70-ee92-4a93-946d-2a343217974a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:45.175577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc756f70-ee92-4a93-946d-2a343217974a None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:45.176068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc756f70-ee92-4a93-946d-2a343217974a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:45.176515 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc756f70-ee92-4a93-946d-2a343217974a None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:45.177430 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc756f70-ee92-4a93-946d-2a343217974a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:45.179019 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc756f70-ee92-4a93-946d-2a343217974a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:45.192611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:45.205899 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 442/884] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 15 00:22:45 2022] POST /identity/v3/services => generated 269 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:22:45.231431 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47330b6-64c9-4426-b7f8-1f66927d80b5 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:45.278386 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f28111-0b50-4523-b68b-0733f4f4693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:45.279074 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f28111-0b50-4523-b68b-0733f4f4693c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:45.279361 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f28111-0b50-4523-b68b-0733f4f4693c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:45.279637 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f28111-0b50-4523-b68b-0733f4f4693c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:45.361688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f28111-0b50-4523-b68b-0733f4f4693c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:45.363190 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f28111-0b50-4523-b68b-0733f4f4693c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:45.429063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:45.471778 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 443/885] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:45 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 00:22:45.477515 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc756f70-ee92-4a93-946d-2a343217974a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:45.582936 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc756f70-ee92-4a93-946d-2a343217974a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:45.618854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf95039-192e-482f-8638-5cf78047faec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:45.620056 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf95039-192e-482f-8638-5cf78047faec None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:45.620535 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf95039-192e-482f-8638-5cf78047faec None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:45.621016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf95039-192e-482f-8638-5cf78047faec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:45.632498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf95039-192e-482f-8638-5cf78047faec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:45.634307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf95039-192e-482f-8638-5cf78047faec None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:45.652863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-9cf95039-192e-482f-8638-5cf78047faec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:45.652863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:45.652863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:45.652863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:45.652863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:45.652863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:45.652863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:45.652863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:45.652863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:45.652863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:45.652863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:45.652863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:45.652863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:45.652863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:45.652863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:45.653892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:45.654777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:45.654777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:45.654777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:45.654777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:45.657429 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 443/886] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:45.669612 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f28111-0b50-4523-b68b-0733f4f4693c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:45.772892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f28111-0b50-4523-b68b-0733f4f4693c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:45.810862 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7c13e-9408-42c6-9a92-e40c1a7a42bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:45.811545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7c13e-9408-42c6-9a92-e40c1a7a42bf None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:45.811831 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7c13e-9408-42c6-9a92-e40c1a7a42bf None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:45.812109 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7c13e-9408-42c6-9a92-e40c1a7a42bf None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:45.812834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7c13e-9408-42c6-9a92-e40c1a7a42bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:45.813141 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7c13e-9408-42c6-9a92-e40c1a7a42bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:45.814549 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7c13e-9408-42c6-9a92-e40c1a7a42bf None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:45.826549 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 444/887] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:45.831227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a3471-c609-4154-9327-3888ca3a3191 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:45.831521 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a3471-c609-4154-9327-3888ca3a3191 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:45.831805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a3471-c609-4154-9327-3888ca3a3191 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:45.833293 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 444/888] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:45.837723 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7c13e-9408-42c6-9a92-e40c1a7a42bf None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:45.838716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8811f-0868-428d-8803-17fdb2f19a09 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:45.839220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8811f-0868-428d-8803-17fdb2f19a09 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:45.839693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8811f-0868-428d-8803-17fdb2f19a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:45.856723 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0eb8811f-0868-428d-8803-17fdb2f19a09 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:45.858265 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0eb8811f-0868-428d-8803-17fdb2f19a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:45.865392 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:45.906368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:45.949091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 445/889] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:45.956120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7c13e-9408-42c6-9a92-e40c1a7a42bf None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:45.969588 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8811f-0868-428d-8803-17fdb2f19a09 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:45.992913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef3fc-646b-42f5-aa34-d42638c95768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:45.994092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef3fc-646b-42f5-aa34-d42638c95768 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:45.994583 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef3fc-646b-42f5-aa34-d42638c95768 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:45.995093 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef3fc-646b-42f5-aa34-d42638c95768 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.002558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffef3fc-646b-42f5-aa34-d42638c95768 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:46.004268 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffef3fc-646b-42f5-aa34-d42638c95768 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:46.020073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-7ffef3fc-646b-42f5-aa34-d42638c95768 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:46.020073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:46.020073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:46.020073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:46.020073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:46.020073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:46.020073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:46.020073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:46.020073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:46.020073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:46.020073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:46.020073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:46.020073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:46.020073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:46.020073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:46.021029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:46.022104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:46.022104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:46.022104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:46.022104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:46.022104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:46.022104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:46.022104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:46.022104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:46.025181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 445/890] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:46.030848 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef3fc-646b-42f5-aa34-d42638c95768 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:46.077463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8811f-0868-428d-8803-17fdb2f19a09 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.112291 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de9587-4dbf-45cd-bc01-1ba06c812556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:46.113127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de9587-4dbf-45cd-bc01-1ba06c812556 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.113447 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de9587-4dbf-45cd-bc01-1ba06c812556 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.113727 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de9587-4dbf-45cd-bc01-1ba06c812556 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.114397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de9587-4dbf-45cd-bc01-1ba06c812556 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:46.116378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de9587-4dbf-45cd-bc01-1ba06c812556 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b0de9587-4dbf-45cd-bc01-1ba06c812556 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:46.128916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:46.130010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:46.130010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:46.130010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:46.130010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:46.130010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:46.130010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:46.130010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:46.130010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:46.130010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:46.130010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:46.130010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:46.130010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:46.130010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:46.130010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:46.130010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:46.130010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:46.130853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:46.130853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:46.130853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:46.130853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:46.130853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:46.130853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:46.130853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:46.130853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:46.130853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:46.130853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:46.130853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:46.130853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:46.130853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:22:46.130853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:46.135480 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 446/891] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 15 00:22:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:46.136169 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de9587-4dbf-45cd-bc01-1ba06c812556 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:46.144663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:46.169273 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef3fc-646b-42f5-aa34-d42638c95768 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.185090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:46.206941 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022676f-4c93-4e33-bd5d-c850102ea93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:46.207642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022676f-4c93-4e33-bd5d-c850102ea93b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.207999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022676f-4c93-4e33-bd5d-c850102ea93b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.208349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022676f-4c93-4e33-bd5d-c850102ea93b None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.209239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022676f-4c93-4e33-bd5d-c850102ea93b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:46.209689 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022676f-4c93-4e33-bd5d-c850102ea93b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:46.211280 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022676f-4c93-4e33-bd5d-c850102ea93b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:46.228373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 446/892] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:46.229703 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022676f-4c93-4e33-bd5d-c850102ea93b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:46.269290 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de9587-4dbf-45cd-bc01-1ba06c812556 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.313277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31851164-ff53-4036-9e3e-82e2ec775d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:46.314712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31851164-ff53-4036-9e3e-82e2ec775d42 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.315441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31851164-ff53-4036-9e3e-82e2ec775d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.315945 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31851164-ff53-4036-9e3e-82e2ec775d42 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.317021 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31851164-ff53-4036-9e3e-82e2ec775d42 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:46.317813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31851164-ff53-4036-9e3e-82e2ec775d42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:46.319535 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31851164-ff53-4036-9e3e-82e2ec775d42 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:46.331414 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 447/893] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 15 00:22:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:46.332693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31851164-ff53-4036-9e3e-82e2ec775d42 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:46.341999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022676f-4c93-4e33-bd5d-c850102ea93b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.377530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070b358-0c14-4518-a415-a0f97a49a158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:46.378258 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070b358-0c14-4518-a415-a0f97a49a158 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.378539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070b358-0c14-4518-a415-a0f97a49a158 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.378823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070b358-0c14-4518-a415-a0f97a49a158 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.379665 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070b358-0c14-4518-a415-a0f97a49a158 None admin] RBAC: Adding query filter params (role.id=6e721ce489704e1fbef73a459c754865, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=54123f8a9de7428bb7e34557aea23ebf) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:46.379979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070b358-0c14-4518-a415-a0f97a49a158 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:46.381591 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070b358-0c14-4518-a415-a0f97a49a158 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:46.393385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 447/894] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:46 2022] GET /identity/v3/role_assignments?user.id=54123f8a9de7428bb7e34557aea23ebf&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=6e721ce489704e1fbef73a459c754865 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:46.464953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31851164-ff53-4036-9e3e-82e2ec775d42 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.467014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:46.504334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9ffea-881e-48fb-a82b-1f65082d1e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:46.505024 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9ffea-881e-48fb-a82b-1f65082d1e20 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.505306 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9ffea-881e-48fb-a82b-1f65082d1e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.505635 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9ffea-881e-48fb-a82b-1f65082d1e20 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.506432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9ffea-881e-48fb-a82b-1f65082d1e20 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:46.506746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9ffea-881e-48fb-a82b-1f65082d1e20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:46.508154 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9ffea-881e-48fb-a82b-1f65082d1e20 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:46.514005 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 448/895] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 15 00:22:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:46.710440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793fb9c-d7a0-443a-8cd9-b218bce8d0a3 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.710965 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793fb9c-d7a0-443a-8cd9-b218bce8d0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.711266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793fb9c-d7a0-443a-8cd9-b218bce8d0a3 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.712950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 448/896] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:46.718445 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874e968-306d-442b-834b-813eb074c3f2 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.718736 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874e968-306d-442b-834b-813eb074c3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.719013 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874e968-306d-442b-834b-813eb074c3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.736023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1874e968-306d-442b-834b-813eb074c3f2 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:46.737195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1874e968-306d-442b-834b-813eb074c3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:46.809458 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 449/897] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:22:46.828269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793fb9c-d7a0-443a-8cd9-b218bce8d0a3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:46.840079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:46.936680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793fb9c-d7a0-443a-8cd9-b218bce8d0a3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:46.973765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce20152-9336-438b-ad62-97d9d86f012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:46.974921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce20152-9336-438b-ad62-97d9d86f012e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:46.975484 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce20152-9336-438b-ad62-97d9d86f012e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:46.975947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce20152-9336-438b-ad62-97d9d86f012e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:46.976804 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce20152-9336-438b-ad62-97d9d86f012e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:46.978409 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce20152-9336-438b-ad62-97d9d86f012e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-9ce20152-9336-438b-ad62-97d9d86f012e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:46.991265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:46.992369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:46.992369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:46.992369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:46.992369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:46.992369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:46.992369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:46.992369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:46.992369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:46.992369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:46.992369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:46.992369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:46.992369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:46.992369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:46.992369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:46.992369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:46.992369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:46.993307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:46.993307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:46.993307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:46.993307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:46.993307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:46.993307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:46.993307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:46.993307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:46.993307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:46.993307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:46.993307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:46.993307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:46.993307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:22:46.993307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:46.995904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 449/898] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:47.001931 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874e968-306d-442b-834b-813eb074c3f2 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.106008 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:47.113069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874e968-306d-442b-834b-813eb074c3f2 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:47.148392 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a71534-36d4-4102-8674-17013e3b0238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.149076 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a71534-36d4-4102-8674-17013e3b0238 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.149380 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a71534-36d4-4102-8674-17013e3b0238 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.149675 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a71534-36d4-4102-8674-17013e3b0238 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.150392 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a71534-36d4-4102-8674-17013e3b0238 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:47.150700 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a71534-36d4-4102-8674-17013e3b0238 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:47.152082 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a71534-36d4-4102-8674-17013e3b0238 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:47.157214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 450/899] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:47.162829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce20152-9336-438b-ad62-97d9d86f012e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.235343 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:47.268212 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce20152-9336-438b-ad62-97d9d86f012e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:47.303292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11431fc-3c9e-48c5-ae19-f458fbbf16f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.303989 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11431fc-3c9e-48c5-ae19-f458fbbf16f7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.304277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11431fc-3c9e-48c5-ae19-f458fbbf16f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.304559 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11431fc-3c9e-48c5-ae19-f458fbbf16f7 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.305289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11431fc-3c9e-48c5-ae19-f458fbbf16f7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:47.305631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11431fc-3c9e-48c5-ae19-f458fbbf16f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:47.307080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11431fc-3c9e-48c5-ae19-f458fbbf16f7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:47.313019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 450/900] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:47.318950 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a71534-36d4-4102-8674-17013e3b0238 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.421897 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a71534-36d4-4102-8674-17013e3b0238 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:47.458285 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c1d50-eda9-4199-8c6f-a826fe43516a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.458991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c1d50-eda9-4199-8c6f-a826fe43516a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.459283 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c1d50-eda9-4199-8c6f-a826fe43516a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.459687 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c1d50-eda9-4199-8c6f-a826fe43516a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.460520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c1d50-eda9-4199-8c6f-a826fe43516a None admin] RBAC: Adding query filter params (interface=public, service_id=d0428f2aad0f41119ddaa0a2298303ad, region_id=RegionOne) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:47.460845 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c1d50-eda9-4199-8c6f-a826fe43516a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:47.462321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c1d50-eda9-4199-8c6f-a826fe43516a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:47.468909 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 451/901] 10.222.0.36 () {56 vars in 1251 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/endpoints?service_id=d0428f2aad0f41119ddaa0a2298303ad&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:47.474739 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11431fc-3c9e-48c5-ae19-f458fbbf16f7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.514804 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e740c-4c95-429f-b5df-4c432c66255d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.514996 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e740c-4c95-429f-b5df-4c432c66255d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.515270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e740c-4c95-429f-b5df-4c432c66255d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.516890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 452/902] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:22:47.521641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff9ab7-c1a6-484f-8536-6ae7f2080ef5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.522005 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff9ab7-c1a6-484f-8536-6ae7f2080ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.522293 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff9ab7-c1a6-484f-8536-6ae7f2080ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.540143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7bff9ab7-c1a6-484f-8536-6ae7f2080ef5 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:47.541321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7bff9ab7-c1a6-484f-8536-6ae7f2080ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:47.559916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:47.597487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11431fc-3c9e-48c5-ae19-f458fbbf16f7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:47.620447 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 453/903] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:22:47.638146 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef210c6-cea5-4ffc-ac3d-fd4d0f5db6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.638735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff9ab7-c1a6-484f-8536-6ae7f2080ef5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.639137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef210c6-cea5-4ffc-ac3d-fd4d0f5db6dd None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.639430 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef210c6-cea5-4ffc-ac3d-fd4d0f5db6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.639718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef210c6-cea5-4ffc-ac3d-fd4d0f5db6dd None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.640415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef210c6-cea5-4ffc-ac3d-fd4d0f5db6dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:47.642052 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef210c6-cea5-4ffc-ac3d-fd4d0f5db6dd None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:47.644995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:47.650386 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 451/904] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/services => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:22:47.761761 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff9ab7-c1a6-484f-8536-6ae7f2080ef5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:47.801045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f2326-0b94-4648-8482-978d97194939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.802321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f2326-0b94-4648-8482-978d97194939 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.802815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f2326-0b94-4648-8482-978d97194939 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.803323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f2326-0b94-4648-8482-978d97194939 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.804192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f2326-0b94-4648-8482-978d97194939 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:47.806163 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f2326-0b94-4648-8482-978d97194939 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:47.820771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-1e3f2326-0b94-4648-8482-978d97194939 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:22:47.820771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:47.820771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:47.820771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:47.820771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:47.820771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:47.820771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:47.820771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:47.820771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:22:47.820771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:47.820771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:47.820771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:47.820771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:47.820771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:47.820771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:47.820771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:47.821825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:47.821825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:47.821825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:47.821825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:47.821825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:47.821825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:47.821825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:47.821825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:47.821825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:47.821825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:47.821825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:47.821825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:47.821825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:47.821825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:47.821825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:47.821825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:47.822695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:47.822695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:47.822695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:47.822695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:47.822695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:47.822695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:47.822695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:47.822695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:47.822695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:47.822695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:47.822695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:47.822695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:47.822695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:47.822695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:22:47.822695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:47.825086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 454/905] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:47.831248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef210c6-cea5-4ffc-ac3d-fd4d0f5db6dd None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:47.942398 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef210c6-cea5-4ffc-ac3d-fd4d0f5db6dd None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:47.976881 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506adc56-2b90-461f-9b3a-835241557ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:47.977595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506adc56-2b90-461f-9b3a-835241557ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:47.977924 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506adc56-2b90-461f-9b3a-835241557ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:47.978212 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506adc56-2b90-461f-9b3a-835241557ac1 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:47.978933 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506adc56-2b90-461f-9b3a-835241557ac1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:47.979239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506adc56-2b90-461f-9b3a-835241557ac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:47.980623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506adc56-2b90-461f-9b3a-835241557ac1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:47.985870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 452/906] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:47.991912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f2326-0b94-4648-8482-978d97194939 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:48.012546 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:48.099762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f2326-0b94-4648-8482-978d97194939 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:48.135348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265a9af-7bf7-410d-82ec-2c5b24ae23d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:48.136068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265a9af-7bf7-410d-82ec-2c5b24ae23d6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.136302 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265a9af-7bf7-410d-82ec-2c5b24ae23d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.136579 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265a9af-7bf7-410d-82ec-2c5b24ae23d6 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.137305 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265a9af-7bf7-410d-82ec-2c5b24ae23d6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:48.137645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265a9af-7bf7-410d-82ec-2c5b24ae23d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:48.139029 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265a9af-7bf7-410d-82ec-2c5b24ae23d6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:48.144688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 455/907] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 15 00:22:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:48.150656 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506adc56-2b90-461f-9b3a-835241557ac1 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:48.216326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:48.256012 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506adc56-2b90-461f-9b3a-835241557ac1 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:48.290730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e1703-7112-4a1e-ad33-40f58b1088d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:48.291408 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e1703-7112-4a1e-ad33-40f58b1088d9 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.291692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e1703-7112-4a1e-ad33-40f58b1088d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.292024 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e1703-7112-4a1e-ad33-40f58b1088d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.292832 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e1703-7112-4a1e-ad33-40f58b1088d9 None admin] RBAC: Adding query filter params (interface=public, service_id=42ebf6f5c3b74978bfa397caf1fa9580, region_id=RegionOne) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:48.293197 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e1703-7112-4a1e-ad33-40f58b1088d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:48.294625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e1703-7112-4a1e-ad33-40f58b1088d9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:48.300207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 453/908] 10.222.0.36 () {56 vars in 1251 bytes} [Wed Jun 15 00:22:48 2022] GET /identity/v3/endpoints?service_id=42ebf6f5c3b74978bfa397caf1fa9580&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:48.305893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265a9af-7bf7-410d-82ec-2c5b24ae23d6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:48.392154 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:48.411271 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265a9af-7bf7-410d-82ec-2c5b24ae23d6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:48.456352 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e45de5-6080-4c7a-8850-c6dc48cd8a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:48.457030 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e45de5-6080-4c7a-8850-c6dc48cd8a14 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.457320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e45de5-6080-4c7a-8850-c6dc48cd8a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.457624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e45de5-6080-4c7a-8850-c6dc48cd8a14 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.458311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e45de5-6080-4c7a-8850-c6dc48cd8a14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:48.459711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e45de5-6080-4c7a-8850-c6dc48cd8a14 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:48.465966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 456/909] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 15 00:22:48 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:22:48.696296 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4eaec-45e3-4341-9da4-319300697699 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.696961 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4eaec-45e3-4341-9da4-319300697699 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.697496 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4eaec-45e3-4341-9da4-319300697699 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.699361 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 454/910] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:48.704789 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceba7b-11c7-490e-bd59-ae342732d720 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.705085 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceba7b-11c7-490e-bd59-ae342732d720 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.705399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ceba7b-11c7-490e-bd59-ae342732d720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.720220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7c15c-e3de-495f-bdff-7bdafd976e72 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.720520 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7c15c-e3de-495f-bdff-7bdafd976e72 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.720770 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7c15c-e3de-495f-bdff-7bdafd976e72 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.722410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 455/911] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:48.722569 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-04ceba7b-11c7-490e-bd59-ae342732d720 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:48.723705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-04ceba7b-11c7-490e-bd59-ae342732d720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:48.727888 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede6848-bdce-4def-84a0-e1aff722dec4 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.728190 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede6848-bdce-4def-84a0-e1aff722dec4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.728466 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede6848-bdce-4def-84a0-e1aff722dec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.745887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1ede6848-bdce-4def-84a0-e1aff722dec4 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:48.747087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1ede6848-bdce-4def-84a0-e1aff722dec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:48.814395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 457/912] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:48.829226 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 456/913] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:22:48.836953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ceba7b-11c7-490e-bd59-ae342732d720 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:48.854795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede6848-bdce-4def-84a0-e1aff722dec4 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:48.915181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:48.929110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:48.942511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ceba7b-11c7-490e-bd59-ae342732d720 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:48.979815 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede6848-bdce-4def-84a0-e1aff722dec4 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:48.984061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9351c2-91af-40ca-9d89-3ff836562c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:48.984757 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9351c2-91af-40ca-9d89-3ff836562c11 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:48.985044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9351c2-91af-40ca-9d89-3ff836562c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:48.985318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9351c2-91af-40ca-9d89-3ff836562c11 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:48.986100 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9351c2-91af-40ca-9d89-3ff836562c11 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:48.987885 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9351c2-91af-40ca-9d89-3ff836562c11 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:49.008800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 458/914] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 15 00:22:48 2022] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:49.033232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d246e56-017f-45f6-8fac-790e02ae400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:49.034285 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d246e56-017f-45f6-8fac-790e02ae400e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.034559 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d246e56-017f-45f6-8fac-790e02ae400e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.035759 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d246e56-017f-45f6-8fac-790e02ae400e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.052200 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d246e56-017f-45f6-8fac-790e02ae400e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:49.061519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-4d246e56-017f-45f6-8fac-790e02ae400e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:22:49.061519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:49.061519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:49.061519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:49.061519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:49.061519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:49.061519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:49.061519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:49.061519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:49.061519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:49.061519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:49.061519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:49.061519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:49.061519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:49.061519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:49.061519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:49.066904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:49.066904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:49.066904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:49.066904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:49.066904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:49.066904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:49.066904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:49.066904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:49.066904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:49.066904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:49.066904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:49.066904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:49.066904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:49.066904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:49.066904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:49.066904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:49.068974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:49.068974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:49.068974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:49.068974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:49.068974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:49.068974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:49.068974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:49.068974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:49.068974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:49.068974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:49.068974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:22:49.068974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:49.068974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 457/915] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Jun 15 00:22:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:49.070619 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9351c2-91af-40ca-9d89-3ff836562c11 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:49.185205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9351c2-91af-40ca-9d89-3ff836562c11 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:49.220992 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a8bce-2d95-4793-b597-c2a2d5fd6a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:49.221703 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a8bce-2d95-4793-b597-c2a2d5fd6a1f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.222040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a8bce-2d95-4793-b597-c2a2d5fd6a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.222322 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a8bce-2d95-4793-b597-c2a2d5fd6a1f None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.223083 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a8bce-2d95-4793-b597-c2a2d5fd6a1f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:49.223394 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a8bce-2d95-4793-b597-c2a2d5fd6a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:49.224776 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a8bce-2d95-4793-b597-c2a2d5fd6a1f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:49.227193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:49.234784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 459/916] 10.222.0.36 () {56 vars in 1115 bytes} [Wed Jun 15 00:22:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:49.241806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d246e56-017f-45f6-8fac-790e02ae400e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:49.346093 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d246e56-017f-45f6-8fac-790e02ae400e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:49.362750 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:49.380979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ecaaf-1589-46a7-b0aa-ced5068d2c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:49.381902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ecaaf-1589-46a7-b0aa-ced5068d2c5d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.382333 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ecaaf-1589-46a7-b0aa-ced5068d2c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.382675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ecaaf-1589-46a7-b0aa-ced5068d2c5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.393963 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ecaaf-1589-46a7-b0aa-ced5068d2c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:49.395433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ecaaf-1589-46a7-b0aa-ced5068d2c5d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:49.412977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c65ecaaf-1589-46a7-b0aa-ced5068d2c5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:49.412977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:49.412977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:49.412977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:49.412977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:49.412977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:49.412977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:49.412977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:49.412977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:49.412977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:49.412977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:49.412977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:49.412977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:49.412977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:49.412977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:49.413995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:49.414924 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:49.414924 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:49.414924 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:49.414924 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:49.414924 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 458/917] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:49.420735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a8bce-2d95-4793-b597-c2a2d5fd6a1f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:49.526018 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a8bce-2d95-4793-b597-c2a2d5fd6a1f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:49.565006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b15eb-1e75-45d8-89f5-bb6854067327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:49.565716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b15eb-1e75-45d8-89f5-bb6854067327 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.566001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b15eb-1e75-45d8-89f5-bb6854067327 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.566287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b15eb-1e75-45d8-89f5-bb6854067327 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.567007 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b15eb-1e75-45d8-89f5-bb6854067327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:49.567316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b15eb-1e75-45d8-89f5-bb6854067327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:49.568719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b15eb-1e75-45d8-89f5-bb6854067327 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:49.585302 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 460/918] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:49.591272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ecaaf-1589-46a7-b0aa-ced5068d2c5d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:49.696145 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ecaaf-1589-46a7-b0aa-ced5068d2c5d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:49.730336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b755c-6e27-4c4a-a2b9-ab54c84763b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:49.731184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b755c-6e27-4c4a-a2b9-ab54c84763b8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.731469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b755c-6e27-4c4a-a2b9-ab54c84763b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.731750 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b755c-6e27-4c4a-a2b9-ab54c84763b8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.741211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b755c-6e27-4c4a-a2b9-ab54c84763b8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:49.742701 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b755c-6e27-4c4a-a2b9-ab54c84763b8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:49.757733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-1f5b755c-6e27-4c4a-a2b9-ab54c84763b8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:22:49.757733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:49.757733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:49.757733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:49.757733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:49.757733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:49.757733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:49.757733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:49.757733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:49.757733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:49.757733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:49.757733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:49.757733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:49.757733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:49.757733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:49.757733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:49.758722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:49.759822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:49.759822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:49.759822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:49.759822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:49.759822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:49.759822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:49.759822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:49.759822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:49.759822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:22:49.759822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:49.759822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 459/919] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 15 00:22:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:49.766753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b15eb-1e75-45d8-89f5-bb6854067327 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:49.832180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:49.880337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b15eb-1e75-45d8-89f5-bb6854067327 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:49.918514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99835d8-e21b-4d91-a8d7-01527383922a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:49.919212 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99835d8-e21b-4d91-a8d7-01527383922a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.919496 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99835d8-e21b-4d91-a8d7-01527383922a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.919770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99835d8-e21b-4d91-a8d7-01527383922a None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.920621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99835d8-e21b-4d91-a8d7-01527383922a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:49.920934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99835d8-e21b-4d91-a8d7-01527383922a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:49.922401 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99835d8-e21b-4d91-a8d7-01527383922a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:49.940528 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 461/920] 10.222.0.36 () {56 vars in 1149 bytes} [Wed Jun 15 00:22:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:49.946464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b755c-6e27-4c4a-a2b9-ab54c84763b8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:49.955680 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db85b1-1777-459c-a358-ed959f27731f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.955973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db85b1-1777-459c-a358-ed959f27731f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.956256 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db85b1-1777-459c-a358-ed959f27731f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.958317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 462/921] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:22:49.963682 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536592cc-6a67-4df3-9c56-a41d6acd3029 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:49.963970 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536592cc-6a67-4df3-9c56-a41d6acd3029 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:49.964248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536592cc-6a67-4df3-9c56-a41d6acd3029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:49.984835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-536592cc-6a67-4df3-9c56-a41d6acd3029 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:49.986204 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-536592cc-6a67-4df3-9c56-a41d6acd3029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:49.988958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:50.057235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b755c-6e27-4c4a-a2b9-ab54c84763b8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:50.077476 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 463/922] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:22:50.100891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536592cc-6a67-4df3-9c56-a41d6acd3029 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:50.108650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1dc28-3b1d-4aa0-83c6-8f34aac862b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:50.110339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1dc28-3b1d-4aa0-83c6-8f34aac862b5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.110846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1dc28-3b1d-4aa0-83c6-8f34aac862b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.111332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1dc28-3b1d-4aa0-83c6-8f34aac862b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.125958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1dc28-3b1d-4aa0-83c6-8f34aac862b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:50.128571 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1dc28-3b1d-4aa0-83c6-8f34aac862b5 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:50.149941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:50.151263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-5fe1dc28-3b1d-4aa0-83c6-8f34aac862b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:50.151263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:50.151263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:50.151263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:50.151263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:50.151263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:50.151263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:50.151263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:50.151263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:50.151263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:50.151263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:50.151263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:50.151263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:50.151263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:50.151263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:50.152876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:50.153858 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:50.153858 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:50.153858 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:50.153858 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:50.157426 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 460/923] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:50.161096 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1dc28-3b1d-4aa0-83c6-8f34aac862b5 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:50.216089 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536592cc-6a67-4df3-9c56-a41d6acd3029 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:50.263714 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:50.267111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a68a3-5deb-4c2d-bc24-d4d3b892cdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:50.268153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a68a3-5deb-4c2d-bc24-d4d3b892cdd7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.268439 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a68a3-5deb-4c2d-bc24-d4d3b892cdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.268723 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a68a3-5deb-4c2d-bc24-d4d3b892cdd7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.269896 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a68a3-5deb-4c2d-bc24-d4d3b892cdd7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:50.271657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a68a3-5deb-4c2d-bc24-d4d3b892cdd7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b21a68a3-5deb-4c2d-bc24-d4d3b892cdd7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:50.290633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:50.291698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:50.291698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:50.291698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:50.291698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:50.291698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:50.291698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:50.291698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:50.291698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:50.291698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:50.291698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:50.291698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:50.291698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:50.291698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:50.291698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:50.291698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:50.291698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:50.292571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:50.292571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:50.292571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:50.292571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:50.292571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:50.292571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:50.292571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:50.292571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:50.292571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:50.292571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:50.292571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:50.292571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:50.292571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 15 00:22:50.292571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:50.294410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1dc28-3b1d-4aa0-83c6-8f34aac862b5 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:50.296978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 464/924] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:50.298843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a68a3-5deb-4c2d-bc24-d4d3b892cdd7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:50.332076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928fbbd-2e95-45d2-9075-24fe8c15e83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:50.333225 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928fbbd-2e95-45d2-9075-24fe8c15e83e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.333806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928fbbd-2e95-45d2-9075-24fe8c15e83e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.334482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928fbbd-2e95-45d2-9075-24fe8c15e83e None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.335433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928fbbd-2e95-45d2-9075-24fe8c15e83e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:50.335949 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928fbbd-2e95-45d2-9075-24fe8c15e83e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:50.337793 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928fbbd-2e95-45d2-9075-24fe8c15e83e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:50.351762 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 461/925] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:50.356901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928fbbd-2e95-45d2-9075-24fe8c15e83e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:50.430642 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a68a3-5deb-4c2d-bc24-d4d3b892cdd7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:50.445218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:50.463864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928fbbd-2e95-45d2-9075-24fe8c15e83e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:50.477273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9df830-b20c-4ea1-ba9a-3e5da5861df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:50.478482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9df830-b20c-4ea1-ba9a-3e5da5861df8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.478959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9df830-b20c-4ea1-ba9a-3e5da5861df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.479876 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9df830-b20c-4ea1-ba9a-3e5da5861df8 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.481029 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9df830-b20c-4ea1-ba9a-3e5da5861df8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:50.481551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9df830-b20c-4ea1-ba9a-3e5da5861df8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:50.483657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9df830-b20c-4ea1-ba9a-3e5da5861df8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:50.495416 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 465/926] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:50.496779 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9df830-b20c-4ea1-ba9a-3e5da5861df8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:50.506652 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a601ba-1e25-4c91-ac4d-aff70705ec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:50.507548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a601ba-1e25-4c91-ac4d-aff70705ec59 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.507837 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a601ba-1e25-4c91-ac4d-aff70705ec59 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.508491 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a601ba-1e25-4c91-ac4d-aff70705ec59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.515942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a601ba-1e25-4c91-ac4d-aff70705ec59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:50.517632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a601ba-1e25-4c91-ac4d-aff70705ec59 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:50.519450 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:50.534836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-d0a601ba-1e25-4c91-ac4d-aff70705ec59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:50.534836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:50.534836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:50.534836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:50.534836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:50.534836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:50.534836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:50.534836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:50.534836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:50.534836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:50.534836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:50.534836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:50.534836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:50.534836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:50.534836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:50.535791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:50.536713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:50.536713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:50.536713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:50.536713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:50.536713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:50.536713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:50.536713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:50.536713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:50.541053 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 462/927] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:50.542712 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a601ba-1e25-4c91-ac4d-aff70705ec59 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:50.628028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9df830-b20c-4ea1-ba9a-3e5da5861df8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:50.661044 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a601ba-1e25-4c91-ac4d-aff70705ec59 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:50.662541 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a3fd5-e73d-424b-bea8-2602e3efa65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:50.663220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a3fd5-e73d-424b-bea8-2602e3efa65b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.663511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a3fd5-e73d-424b-bea8-2602e3efa65b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.663787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a3fd5-e73d-424b-bea8-2602e3efa65b None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.664506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a3fd5-e73d-424b-bea8-2602e3efa65b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:50.664818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a3fd5-e73d-424b-bea8-2602e3efa65b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:50.666236 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a3fd5-e73d-424b-bea8-2602e3efa65b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:50.675659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 466/928] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Jun 15 00:22:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:50.675659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e92ff-c0f5-4ba9-8ab0-551e8689d427 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.675659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e92ff-c0f5-4ba9-8ab0-551e8689d427 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.675659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e92ff-c0f5-4ba9-8ab0-551e8689d427 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.675659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 467/929] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:50.678942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e92ff-c0f5-4ba9-8ab0-551e8689d427 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:50.700930 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d290f8-2858-487a-a6b7-97351795230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:50.701644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d290f8-2858-487a-a6b7-97351795230d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.701925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d290f8-2858-487a-a6b7-97351795230d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.702200 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d290f8-2858-487a-a6b7-97351795230d None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.703367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d290f8-2858-487a-a6b7-97351795230d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:50.703367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d290f8-2858-487a-a6b7-97351795230d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:50.704728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d290f8-2858-487a-a6b7-97351795230d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:50.717401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 463/930] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:50.720528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cabe46-3b36-4ba7-9634-c97178c831a2 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.720528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cabe46-3b36-4ba7-9634-c97178c831a2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.720528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cabe46-3b36-4ba7-9634-c97178c831a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.731192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:50.738724 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-72cabe46-3b36-4ba7-9634-c97178c831a2 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:50.740642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-72cabe46-3b36-4ba7-9634-c97178c831a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:50.798486 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e92ff-c0f5-4ba9-8ab0-551e8689d427 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:50.801490 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:50.816393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 464/931] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:50.817529 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cabe46-3b36-4ba7-9634-c97178c831a2 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:50.846327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea299749-cd7a-4cd7-b146-0fa195683f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:50.847326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea299749-cd7a-4cd7-b146-0fa195683f38 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.847793 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea299749-cd7a-4cd7-b146-0fa195683f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.848262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea299749-cd7a-4cd7-b146-0fa195683f38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.849188 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea299749-cd7a-4cd7-b146-0fa195683f38 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:50.851030 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea299749-cd7a-4cd7-b146-0fa195683f38 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:50.877137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 468/932] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 15 00:22:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:22:50.882793 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea299749-cd7a-4cd7-b146-0fa195683f38 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:50.941499 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cabe46-3b36-4ba7-9634-c97178c831a2 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:50.987276 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f784d-2b10-4cff-ad9b-fe6710420e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:50.988553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f784d-2b10-4cff-ad9b-fe6710420e8a None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:50.988553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f784d-2b10-4cff-ad9b-fe6710420e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:50.988727 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f784d-2b10-4cff-ad9b-fe6710420e8a None admin] PATH_INFO: `/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/54123f8a9de7428bb7e34557aea23ebf/roles/6e721ce489704e1fbef73a459c754865` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:50.991599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f784d-2b10-4cff-ad9b-fe6710420e8a None admin] RBAC: Authorizing `identity:create_grant(project_id=fc0f2a3e075946f1ad06146dfa252aa6, user_id=54123f8a9de7428bb7e34557aea23ebf, role_id=6e721ce489704e1fbef73a459c754865)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:50.993152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f784d-2b10-4cff-ad9b-fe6710420e8a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:51.015335 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 465/933] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:22:50 2022] PUT /identity/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/54123f8a9de7428bb7e34557aea23ebf/roles/6e721ce489704e1fbef73a459c754865 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:22:51.024936 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:51.034593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea299749-cd7a-4cd7-b146-0fa195683f38 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:51.091103 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c405dc-b190-4ecb-9071-c5aa8140d9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:51.091963 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c405dc-b190-4ecb-9071-c5aa8140d9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:51.092244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c405dc-b190-4ecb-9071-c5aa8140d9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:51.092518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c405dc-b190-4ecb-9071-c5aa8140d9b7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:51.093185 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c405dc-b190-4ecb-9071-c5aa8140d9b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:51.094621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c405dc-b190-4ecb-9071-c5aa8140d9b7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:51.109560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-d8c405dc-b190-4ecb-9071-c5aa8140d9b7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:22:51.109560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:51.109560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:51.109560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:51.109560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:51.109560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:51.109560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:51.109560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:51.109560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:22:51.109560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:51.109560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:51.109560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:51.109560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:51.109560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:51.109560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:51.109560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:51.110620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:51.110620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:51.110620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:51.110620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:51.110620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:51.110620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:51.110620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:51.110620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:51.110620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:51.110620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:51.110620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:51.110620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:51.110620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:51.110620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:51.110620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:51.110620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:51.111505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:51.111505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:51.111505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:51.111505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:51.111505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:51.111505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:51.111505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:51.111505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:51.111505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:51.111505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:51.111505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:51.111505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:51.111505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:51.111505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 15 00:22:51.111505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:51.111505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 469/934] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Jun 15 00:22:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:51.119681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f784d-2b10-4cff-ad9b-fe6710420e8a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:51.189360 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:51.256312 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f784d-2b10-4cff-ad9b-fe6710420e8a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:51.260960 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c394d-c261-4b0d-a9f4-a656c7d4cc27 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:51.261477 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c394d-c261-4b0d-a9f4-a656c7d4cc27 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:51.261559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c394d-c261-4b0d-a9f4-a656c7d4cc27 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:51.263034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 470/935] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:51.268394 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdad1b6-1638-49a6-94e2-8fd5c80c63f5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:51.268941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdad1b6-1638-49a6-94e2-8fd5c80c63f5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:51.269476 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdad1b6-1638-49a6-94e2-8fd5c80c63f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:51.287071 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4bdad1b6-1638-49a6-94e2-8fd5c80c63f5 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:51.288639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4bdad1b6-1638-49a6-94e2-8fd5c80c63f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:51.295430 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01796bd-59ff-4f57-87f3-7f748e73aa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:51.296131 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01796bd-59ff-4f57-87f3-7f748e73aa06 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:51.296419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01796bd-59ff-4f57-87f3-7f748e73aa06 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:51.296699 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01796bd-59ff-4f57-87f3-7f748e73aa06 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:51.297451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01796bd-59ff-4f57-87f3-7f748e73aa06 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:51.297766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01796bd-59ff-4f57-87f3-7f748e73aa06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:51.299691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01796bd-59ff-4f57-87f3-7f748e73aa06 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:51.307157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 466/936] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 15 00:22:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:51.312647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01796bd-59ff-4f57-87f3-7f748e73aa06 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:51.364448 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 471/937] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:22:51.388117 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdad1b6-1638-49a6-94e2-8fd5c80c63f5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:51.418379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01796bd-59ff-4f57-87f3-7f748e73aa06 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:51.441823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:51.457978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afda534-34cf-435b-bd70-cfbb3572b995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:51.458686 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afda534-34cf-435b-bd70-cfbb3572b995 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:51.458982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afda534-34cf-435b-bd70-cfbb3572b995 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:51.459297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afda534-34cf-435b-bd70-cfbb3572b995 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:51.460014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afda534-34cf-435b-bd70-cfbb3572b995 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:51.460326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afda534-34cf-435b-bd70-cfbb3572b995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:51.462342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afda534-34cf-435b-bd70-cfbb3572b995 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:51.467692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 467/938] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 15 00:22:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:51.473184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afda534-34cf-435b-bd70-cfbb3572b995 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:51.481357 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:51.495150 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdad1b6-1638-49a6-94e2-8fd5c80c63f5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:51.530199 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e516bc6-a767-4a2a-afcb-ee0d88313760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:51.531252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e516bc6-a767-4a2a-afcb-ee0d88313760 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:51.531573 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e516bc6-a767-4a2a-afcb-ee0d88313760 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:51.531953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e516bc6-a767-4a2a-afcb-ee0d88313760 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:51.532708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e516bc6-a767-4a2a-afcb-ee0d88313760 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:51.534546 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e516bc6-a767-4a2a-afcb-ee0d88313760 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-9e516bc6-a767-4a2a-afcb-ee0d88313760 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:51.547147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:51.548461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:51.548461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:51.548461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:51.548461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:51.548461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:51.548461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:51.548461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:51.548461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:51.548461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:51.548461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:51.548461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:51.548461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:51.548461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:51.548461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:51.548461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:51.548461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:51.549549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:51.549549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:51.549549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:51.549549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:51.549549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:51.549549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:51.549549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:51.549549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:51.549549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:51.549549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:51.549549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:51.549549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:51.549549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:22:51.549549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:51.556545 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 472/939] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 15 00:22:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:51.558147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e516bc6-a767-4a2a-afcb-ee0d88313760 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:51.589196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afda534-34cf-435b-bd70-cfbb3572b995 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:51.626588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a835a1-d50f-4b15-b585-28e5a80e9272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:51.627597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a835a1-d50f-4b15-b585-28e5a80e9272 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:51.628025 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a835a1-d50f-4b15-b585-28e5a80e9272 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:51.628446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a835a1-d50f-4b15-b585-28e5a80e9272 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:51.629480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a835a1-d50f-4b15-b585-28e5a80e9272 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:51.631048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a835a1-d50f-4b15-b585-28e5a80e9272 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:51.658115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 468/940] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 15 00:22:51 2022] POST /identity/v3/endpoints => generated 347 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:22:51.671724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e516bc6-a767-4a2a-afcb-ee0d88313760 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:51.719766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3006b91-d46c-473e-95d5-15e7ff162676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:51.720539 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3006b91-d46c-473e-95d5-15e7ff162676 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:51.720835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3006b91-d46c-473e-95d5-15e7ff162676 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:51.721209 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3006b91-d46c-473e-95d5-15e7ff162676 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:51.721985 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3006b91-d46c-473e-95d5-15e7ff162676 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:51.722295 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3006b91-d46c-473e-95d5-15e7ff162676 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:51.723814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3006b91-d46c-473e-95d5-15e7ff162676 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:51.730163 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 473/941] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 15 00:22:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:51.736194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a835a1-d50f-4b15-b585-28e5a80e9272 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:51.770210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:51.858961 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a835a1-d50f-4b15-b585-28e5a80e9272 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:51.894261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b270f1-e7a6-4691-9aae-384f6a53a11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:51.894944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b270f1-e7a6-4691-9aae-384f6a53a11a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:51.895230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b270f1-e7a6-4691-9aae-384f6a53a11a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:51.895508 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b270f1-e7a6-4691-9aae-384f6a53a11a None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:51.896252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b270f1-e7a6-4691-9aae-384f6a53a11a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:51.896563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b270f1-e7a6-4691-9aae-384f6a53a11a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:51.898026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b270f1-e7a6-4691-9aae-384f6a53a11a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:51.903069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 469/942] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 15 00:22:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:51.908803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3006b91-d46c-473e-95d5-15e7ff162676 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:51.924313 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:52.009716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3006b91-d46c-473e-95d5-15e7ff162676 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:52.043177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9166b8-5687-495e-acce-ccdadfeeb610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:52.043851 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9166b8-5687-495e-acce-ccdadfeeb610 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:52.044134 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9166b8-5687-495e-acce-ccdadfeeb610 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:52.044410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9166b8-5687-495e-acce-ccdadfeeb610 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:52.045211 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9166b8-5687-495e-acce-ccdadfeeb610 None admin] RBAC: Adding query filter params (interface=public, service_id=1d6fd0e536454a61b93cc384cbfd868e, region_id=RegionOne) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:52.045554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9166b8-5687-495e-acce-ccdadfeeb610 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:52.046937 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9166b8-5687-495e-acce-ccdadfeeb610 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:52.052375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 474/943] 10.222.0.36 () {56 vars in 1251 bytes} [Wed Jun 15 00:22:51 2022] GET /identity/v3/endpoints?service_id=1d6fd0e536454a61b93cc384cbfd868e&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:52.058024 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b270f1-e7a6-4691-9aae-384f6a53a11a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:52.161214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:52.171979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b270f1-e7a6-4691-9aae-384f6a53a11a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:52.207396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891955b0-9a9e-488a-999a-909eaa27243f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:52.208457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891955b0-9a9e-488a-999a-909eaa27243f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:52.208941 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891955b0-9a9e-488a-999a-909eaa27243f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:52.209514 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891955b0-9a9e-488a-999a-909eaa27243f None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:52.210459 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891955b0-9a9e-488a-999a-909eaa27243f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:52.212034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891955b0-9a9e-488a-999a-909eaa27243f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:52.219012 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 470/944] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 15 00:22:52 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:22:53.154941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c932419-3a7d-4ea4-8e91-0ddfda1fcdfb None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.155514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c932419-3a7d-4ea4-8e91-0ddfda1fcdfb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.155514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c932419-3a7d-4ea4-8e91-0ddfda1fcdfb None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.157326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 475/945] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:53.163614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc38806-b5e9-460f-8f73-e8ca575fb021 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.164140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc38806-b5e9-460f-8f73-e8ca575fb021 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.164271 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc38806-b5e9-460f-8f73-e8ca575fb021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.182121 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8fc38806-b5e9-460f-8f73-e8ca575fb021 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:53.183357 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8fc38806-b5e9-460f-8f73-e8ca575fb021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:53.220913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62c919-b210-4282-8715-acd1ab4ac699 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.221221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62c919-b210-4282-8715-acd1ab4ac699 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.221513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62c919-b210-4282-8715-acd1ab4ac699 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.223117 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 476/946] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:53.228211 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553b3a5-dc75-4888-8653-3eb915448abd None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.228497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553b3a5-dc75-4888-8653-3eb915448abd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.228772 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553b3a5-dc75-4888-8653-3eb915448abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.246364 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c553b3a5-dc75-4888-8653-3eb915448abd None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:53.247530 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c553b3a5-dc75-4888-8653-3eb915448abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:53.259068 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 471/947] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:53.282316 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc38806-b5e9-460f-8f73-e8ca575fb021 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.323320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 477/948] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:53.366298 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553b3a5-dc75-4888-8653-3eb915448abd None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.377771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:53.385692 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:53.405774 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc38806-b5e9-460f-8f73-e8ca575fb021 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:53.450842 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eada27-8d9a-4529-a89e-2f23e7c9811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:53.451527 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eada27-8d9a-4529-a89e-2f23e7c9811a None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.453390 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eada27-8d9a-4529-a89e-2f23e7c9811a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.453390 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eada27-8d9a-4529-a89e-2f23e7c9811a None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.457539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eada27-8d9a-4529-a89e-2f23e7c9811a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:53.459681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eada27-8d9a-4529-a89e-2f23e7c9811a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:53.461805 dv-cinder-835384-6-smb devstack@keystone.service[80188]: WARNING keystone.server.flask.common [None req-38eada27-8d9a-4529-a89e-2f23e7c9811a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 15 00:22:53.482164 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.sql.core [None req-38eada27-8d9a-4529-a89e-2f23e7c9811a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 00:22:53.482164 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 15 00:22:53.482164 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [parameters: {'id': '02f915943d50406792d4c31b3472dca5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 15 00:22:53.482164 dv-cinder-835384-6-smb devstack@keystone.service[80188]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80188) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 00:22:53.492090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-38eada27-8d9a-4529-a89e-2f23e7c9811a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 02f915943d50406792d4c31b3472dca5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 02f915943d50406792d4c31b3472dca5. Jun 15 00:22:53.492090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:53.492090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 00:22:53.492090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 00:22:53.492090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 00:22:53.492090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 00:22:53.492090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 00:22:53.492090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 00:22:53.492090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 00:22:53.492090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application conn.query(q) Jun 15 00:22:53.492090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 00:22:53.492090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 00:22:53.492090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application result.read() Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 15 00:22:53.492929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application next(self.gen) Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application yield resource Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application next(self.gen) Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise self.value Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application session.commit() Jun 15 00:22:53.494272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self.session.flush() Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application compat.raise_( Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 00:22:53.495203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 00:22:53.496106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 00:22:53.496106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 00:22:53.496106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 00:22:53.496106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 00:22:53.496106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 15 00:22:53.496106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 15 00:22:53.496106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 00:22:53.496106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 00:22:53.496106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 00:22:53.496106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 00:22:53.496106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 00:22:53.496106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 00:22:53.496106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 00:22:53.496106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 00:22:53.496106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application conn.query(q) Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application result.read() Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 00:22:53.496911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 00:22:53.497846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 00:22:53.497846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 00:22:53.497846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 00:22:53.497846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 00:22:53.497846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 00:22:53.497846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 00:22:53.497846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 15 00:22:53.497846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 15 00:22:53.497846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [parameters: {'id': '02f915943d50406792d4c31b3472dca5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 15 00:22:53.497846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 00:22:53.497846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:53.497846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:53.497846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:53.497846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:53.497846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:53.498650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:53.499588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:53.499588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 15 00:22:53.499588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 15 00:22:53.499588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:53.499588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:53.499588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 15 00:22:53.499588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 15 00:22:53.499588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 02f915943d50406792d4c31b3472dca5. Jun 15 00:22:53.499588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:53.504266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 472/949] 10.222.0.36 () {60 vars in 1140 bytes} [Wed Jun 15 00:22:53 2022] POST /identity/v3/projects => generated 262 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:53.510914 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eada27-8d9a-4529-a89e-2f23e7c9811a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.542874 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553b3a5-dc75-4888-8653-3eb915448abd None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:53.629799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eada27-8d9a-4529-a89e-2f23e7c9811a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:53.636303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba7839-456f-4b77-ae47-2b2fea875152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:53.637145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7839-456f-4b77-ae47-2b2fea875152 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.637451 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7839-456f-4b77-ae47-2b2fea875152 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.637716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba7839-456f-4b77-ae47-2b2fea875152 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.661660 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba7839-456f-4b77-ae47-2b2fea875152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:22:53.676219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-c5ba7839-456f-4b77-ae47-2b2fea875152 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:22:53.676219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:53.676219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:53.676219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:53.676219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:53.676219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:53.676219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:53.676219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:53.676219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:53.676219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:53.676219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:53.676219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:53.676219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:22:53.676219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:22:53.676219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:22:53.676219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:22:53.677195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:22:53.677195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:22:53.677195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:22:53.677195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:22:53.677195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:53.677195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:53.677195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:53.677195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:53.677195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:53.677195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:53.677195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:53.677195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:53.677195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:53.677195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:53.677195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:53.677195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:53.678181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:53.678181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:53.678181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:53.678181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:53.678181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:22:53.678181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:22:53.678181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:22:53.678181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:22:53.678181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:22:53.678181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:22:53.678181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:22:53.678181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:53.686086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 478/950] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Jun 15 00:22:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:53.687009 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba7839-456f-4b77-ae47-2b2fea875152 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.694226 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2052d-8070-4a75-9bcc-d3a832f02141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:53.695369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2052d-8070-4a75-9bcc-d3a832f02141 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.695852 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2052d-8070-4a75-9bcc-d3a832f02141 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.696354 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2052d-8070-4a75-9bcc-d3a832f02141 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.705807 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2052d-8070-4a75-9bcc-d3a832f02141 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:53.707472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2052d-8070-4a75-9bcc-d3a832f02141 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:53.735124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c2c2052d-8070-4a75-9bcc-d3a832f02141 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:53.735124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:53.735124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:53.735124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:53.735124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:53.735124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:53.735124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:53.735124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:53.735124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:53.735124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:53.735124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:53.735124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:53.735124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:53.735124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:53.735124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:53.736124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:53.737028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:53.737028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:53.737028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:53.737028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:53.737028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:53.737028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:53.737028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:53.737028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:53.737028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 473/951] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:53.744421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2052d-8070-4a75-9bcc-d3a832f02141 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.750198 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:53.779786 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:53.822398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba7839-456f-4b77-ae47-2b2fea875152 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:53.871565 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95903d-7821-4ce1-bf20-f4e9ab76cd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:53.872728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95903d-7821-4ce1-bf20-f4e9ab76cd1a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:53.873247 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95903d-7821-4ce1-bf20-f4e9ab76cd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:53.873840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95903d-7821-4ce1-bf20-f4e9ab76cd1a None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:53.875110 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95903d-7821-4ce1-bf20-f4e9ab76cd1a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:53.876065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95903d-7821-4ce1-bf20-f4e9ab76cd1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:53.877720 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95903d-7821-4ce1-bf20-f4e9ab76cd1a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:53.889067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 479/952] 10.222.0.36 () {56 vars in 1115 bytes} [Wed Jun 15 00:22:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:53.894325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95903d-7821-4ce1-bf20-f4e9ab76cd1a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:53.974947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2052d-8070-4a75-9bcc-d3a832f02141 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.013992 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b75cb-7c6c-4f95-863a-d9e0753f927e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.015032 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b75cb-7c6c-4f95-863a-d9e0753f927e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.015498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b75cb-7c6c-4f95-863a-d9e0753f927e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.016005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b75cb-7c6c-4f95-863a-d9e0753f927e None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.017068 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b75cb-7c6c-4f95-863a-d9e0753f927e None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:54.017715 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b75cb-7c6c-4f95-863a-d9e0753f927e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.019390 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b75cb-7c6c-4f95-863a-d9e0753f927e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:54.026477 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95903d-7821-4ce1-bf20-f4e9ab76cd1a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.041641 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 474/953] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 15 00:22:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:54.043270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84898113-e78b-4f14-b740-94735bec7441 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.043563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84898113-e78b-4f14-b740-94735bec7441 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.043841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84898113-e78b-4f14-b740-94735bec7441 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.045409 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 475/954] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:54.050905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9daf91-06db-4234-b88f-f545649922ae None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.051606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9daf91-06db-4234-b88f-f545649922ae None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.051962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9daf91-06db-4234-b88f-f545649922ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.071325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:54.073295 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c30d8c-88e3-4290-8ac7-868d8e5a56b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.074345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c30d8c-88e3-4290-8ac7-868d8e5a56b5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.074784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c30d8c-88e3-4290-8ac7-868d8e5a56b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.075213 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c30d8c-88e3-4290-8ac7-868d8e5a56b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.084392 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4e9daf91-06db-4234-b88f-f545649922ae None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:54.086298 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4e9daf91-06db-4234-b88f-f545649922ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:54.088498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c30d8c-88e3-4290-8ac7-868d8e5a56b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.090257 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c30d8c-88e3-4290-8ac7-868d8e5a56b5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:54.112393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-15c30d8c-88e3-4290-8ac7-868d8e5a56b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:54.112393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:54.112393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:54.112393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:54.112393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:54.112393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:54.112393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:54.112393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:54.112393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:54.112393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:54.112393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:54.112393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:54.112393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:54.112393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:54.112393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:54.113613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:54.115371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:54.115371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:54.115371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:54.115371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:54.115371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 480/955] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:54.120219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c30d8c-88e3-4290-8ac7-868d8e5a56b5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.171858 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:54.189524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 476/956] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:54.214057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9daf91-06db-4234-b88f-f545649922ae None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.259692 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c30d8c-88e3-4290-8ac7-868d8e5a56b5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.304691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359bc89-7843-443c-857f-51f1bf5263d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.305429 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359bc89-7843-443c-857f-51f1bf5263d2 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.305772 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359bc89-7843-443c-857f-51f1bf5263d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.306046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359bc89-7843-443c-857f-51f1bf5263d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.307311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359bc89-7843-443c-857f-51f1bf5263d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:54.307311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359bc89-7843-443c-857f-51f1bf5263d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.308550 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359bc89-7843-443c-857f-51f1bf5263d2 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:54.324188 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 481/957] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:54.330585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359bc89-7843-443c-857f-51f1bf5263d2 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.356016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9daf91-06db-4234-b88f-f545649922ae None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.382347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:54.393395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f65c0-6cc8-48ca-ad42-2664e4ae41eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.394476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f65c0-6cc8-48ca-ad42-2664e4ae41eb None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.394746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f65c0-6cc8-48ca-ad42-2664e4ae41eb None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.395015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f65c0-6cc8-48ca-ad42-2664e4ae41eb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.395797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f65c0-6cc8-48ca-ad42-2664e4ae41eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.397151 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f65c0-6cc8-48ca-ad42-2664e4ae41eb None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-387f65c0-6cc8-48ca-ad42-2664e4ae41eb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:54.409163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:54.414329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:54.414329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:54.414329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:54.414329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:54.414329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:54.414329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:54.414329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:54.414329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:54.414329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:54.414329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:54.414329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:54.414329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:54.414329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:54.414329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:54.414329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:54.414329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:54.415277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:54.415277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:54.415277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:54.415277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:54.415277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:54.415277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:54.415277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:54.415277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:54.415277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:54.415277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:54.415277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:54.415277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:54.415277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:22:54.415277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:54.415277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 477/958] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:54.416115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db697-5287-4a85-aaeb-bed05b831d91 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.416115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db697-5287-4a85-aaeb-bed05b831d91 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.416115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56db697-5287-4a85-aaeb-bed05b831d91 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.416115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 478/959] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:54.417130 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56db697-5287-4a85-aaeb-bed05b831d91 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.451902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359bc89-7843-443c-857f-51f1bf5263d2 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.475736 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:54.490419 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fb074-59ca-4440-8795-560e0a7915f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.491595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fb074-59ca-4440-8795-560e0a7915f3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.492092 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fb074-59ca-4440-8795-560e0a7915f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.492563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fb074-59ca-4440-8795-560e0a7915f3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.500625 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fb074-59ca-4440-8795-560e0a7915f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.502153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fb074-59ca-4440-8795-560e0a7915f3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:54.518701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-b79fb074-59ca-4440-8795-560e0a7915f3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:22:54.518701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:54.518701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:54.518701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:54.518701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:54.518701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:54.518701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:54.518701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:54.518701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:54.518701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:54.518701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:54.518701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:54.518701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:54.518701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:54.518701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:54.518701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:54.519681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:54.520631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:54.520631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:54.520631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:54.520631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:54.520631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:54.520631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:54.520631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:54.520631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:54.520631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 15 00:22:54.520631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:54.520631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 482/960] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:54.521251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71462259-6444-4ce6-b84a-4d371974309e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.521916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71462259-6444-4ce6-b84a-4d371974309e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.521916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71462259-6444-4ce6-b84a-4d371974309e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.530887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56db697-5287-4a85-aaeb-bed05b831d91 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.539288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-71462259-6444-4ce6-b84a-4d371974309e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:54.540842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-71462259-6444-4ce6-b84a-4d371974309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:54.566565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18708c-3fc7-4c14-b5e1-284be6b65128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.567361 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18708c-3fc7-4c14-b5e1-284be6b65128 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.567900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18708c-3fc7-4c14-b5e1-284be6b65128 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.568083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18708c-3fc7-4c14-b5e1-284be6b65128 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.568810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18708c-3fc7-4c14-b5e1-284be6b65128 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:54.569123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18708c-3fc7-4c14-b5e1-284be6b65128 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.570748 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18708c-3fc7-4c14-b5e1-284be6b65128 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:54.580871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 479/961] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:54.581678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18708c-3fc7-4c14-b5e1-284be6b65128 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.612057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 483/962] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:54.613196 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71462259-6444-4ce6-b84a-4d371974309e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.644304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:54.700315 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18708c-3fc7-4c14-b5e1-284be6b65128 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.716941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71462259-6444-4ce6-b84a-4d371974309e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.722284 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:54.738210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46eadd2-6604-4787-8203-b787f96d9806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.738932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eadd2-6604-4787-8203-b787f96d9806 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.739294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eadd2-6604-4787-8203-b787f96d9806 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.739934 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eadd2-6604-4787-8203-b787f96d9806 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.740936 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46eadd2-6604-4787-8203-b787f96d9806 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:54.741251 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46eadd2-6604-4787-8203-b787f96d9806 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.742820 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46eadd2-6604-4787-8203-b787f96d9806 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:54.750962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b2002-2e67-40e8-a3ea-cf0dc3438a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.751642 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b2002-2e67-40e8-a3ea-cf0dc3438a20 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.751937 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b2002-2e67-40e8-a3ea-cf0dc3438a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.752217 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b2002-2e67-40e8-a3ea-cf0dc3438a20 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.752934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b2002-2e67-40e8-a3ea-cf0dc3438a20 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:54.753272 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b2002-2e67-40e8-a3ea-cf0dc3438a20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.754668 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b2002-2e67-40e8-a3ea-cf0dc3438a20 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:54.759188 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 484/963] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:54.759974 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b2002-2e67-40e8-a3ea-cf0dc3438a20 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.772985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 480/964] 10.222.0.36 () {56 vars in 1149 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:54.779693 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46eadd2-6604-4787-8203-b787f96d9806 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:54.900688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46eadd2-6604-4787-8203-b787f96d9806 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.907100 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:54.916947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b2002-2e67-40e8-a3ea-cf0dc3438a20 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:54.946361 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dccd77-b9f1-4e90-b207-93588c19505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.947450 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dccd77-b9f1-4e90-b207-93588c19505e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.947943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dccd77-b9f1-4e90-b207-93588c19505e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.948411 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dccd77-b9f1-4e90-b207-93588c19505e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.964576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a873d3b-432b-4eae-8f67-870406578bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:54.965603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a873d3b-432b-4eae-8f67-870406578bcc None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:54.965895 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a873d3b-432b-4eae-8f67-870406578bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:54.966181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a873d3b-432b-4eae-8f67-870406578bcc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:54.966844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a873d3b-432b-4eae-8f67-870406578bcc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:54.968280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a873d3b-432b-4eae-8f67-870406578bcc None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7a873d3b-432b-4eae-8f67-870406578bcc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:54.981589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:54.982623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:54.982623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:54.982623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:54.982623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:54.982623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:54.982623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:54.982623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:54.982623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:54.982623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:54.982623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:54.982623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:54.982623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:54.982623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:54.982623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:54.982623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:54.982623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:54.983495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:54.983495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:54.983495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:54.983495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:54.983495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:54.983495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:54.983495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:54.983495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:54.983495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:54.983495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:54.983495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:54.983495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:54.983495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:22:54.983495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:54.983495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 485/965] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:54.991623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a873d3b-432b-4eae-8f67-870406578bcc None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.003233 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:55.030103 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dccd77-b9f1-4e90-b207-93588c19505e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.031726 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dccd77-b9f1-4e90-b207-93588c19505e None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.122020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a873d3b-432b-4eae-8f67-870406578bcc None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.139447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 481/966] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 00:22:55.144347 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dccd77-b9f1-4e90-b207-93588c19505e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.168246 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e777e7-04e7-4221-bef8-01afbd7bed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:55.168925 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e777e7-04e7-4221-bef8-01afbd7bed6f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:55.169209 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e777e7-04e7-4221-bef8-01afbd7bed6f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:55.169519 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e777e7-04e7-4221-bef8-01afbd7bed6f None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:55.170230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e777e7-04e7-4221-bef8-01afbd7bed6f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:55.170539 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e777e7-04e7-4221-bef8-01afbd7bed6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.172404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e777e7-04e7-4221-bef8-01afbd7bed6f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.181430 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 486/967] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 15 00:22:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:55.184712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e777e7-04e7-4221-bef8-01afbd7bed6f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.214355 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:55.243605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:55.276908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dccd77-b9f1-4e90-b207-93588c19505e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.310030 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e777e7-04e7-4221-bef8-01afbd7bed6f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.319452 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44a27b-9491-45d6-87b9-90d550db745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:55.320276 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44a27b-9491-45d6-87b9-90d550db745d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:55.320558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44a27b-9491-45d6-87b9-90d550db745d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:55.320831 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44a27b-9491-45d6-87b9-90d550db745d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:55.331500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44a27b-9491-45d6-87b9-90d550db745d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.332976 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44a27b-9491-45d6-87b9-90d550db745d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.348166 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c614d-c4fa-45bf-bc1b-2e5a34b37cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:55.349172 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c614d-c4fa-45bf-bc1b-2e5a34b37cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:55.349913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c614d-c4fa-45bf-bc1b-2e5a34b37cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:55.350383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c614d-c4fa-45bf-bc1b-2e5a34b37cb1 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:55.350943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-0d44a27b-9491-45d6-87b9-90d550db745d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:55.350943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:55.350943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:55.350943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:55.350943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:55.350943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:55.350943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:55.350943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:55.350943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:55.350943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:55.350943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:55.350943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:55.350943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:22:55.350943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:22:55.350943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:55.351904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:55.352789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:22:55.352789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:22:55.352789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:22:55.352789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:55.353849 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c614d-c4fa-45bf-bc1b-2e5a34b37cb1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:55.354356 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c614d-c4fa-45bf-bc1b-2e5a34b37cb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.355924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c614d-c4fa-45bf-bc1b-2e5a34b37cb1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.356892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 482/968] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:55.358012 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44a27b-9491-45d6-87b9-90d550db745d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.367566 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 487/969] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 15 00:22:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:55.368687 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c614d-c4fa-45bf-bc1b-2e5a34b37cb1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.458253 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44a27b-9491-45d6-87b9-90d550db745d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.459219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:55.475777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c614d-c4fa-45bf-bc1b-2e5a34b37cb1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.490975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:55.497728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a98390-1f47-4ad1-bff2-2701bbf95d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:55.498349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a98390-1f47-4ad1-bff2-2701bbf95d1b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:55.498637 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a98390-1f47-4ad1-bff2-2701bbf95d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:55.498920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a98390-1f47-4ad1-bff2-2701bbf95d1b None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:55.499652 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a98390-1f47-4ad1-bff2-2701bbf95d1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:55.499963 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a98390-1f47-4ad1-bff2-2701bbf95d1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.501495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a98390-1f47-4ad1-bff2-2701bbf95d1b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.516019 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171072e7-9106-448a-8cb8-2d46accf5f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:55.517110 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171072e7-9106-448a-8cb8-2d46accf5f09 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:55.517639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171072e7-9106-448a-8cb8-2d46accf5f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:55.517764 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 483/970] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:55.518237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171072e7-9106-448a-8cb8-2d46accf5f09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:55.519173 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171072e7-9106-448a-8cb8-2d46accf5f09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.519720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a98390-1f47-4ad1-bff2-2701bbf95d1b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.520961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171072e7-9106-448a-8cb8-2d46accf5f09 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.553676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 488/971] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 15 00:22:55 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:55.641792 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a98390-1f47-4ad1-bff2-2701bbf95d1b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.684706 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bdb79-f417-4ab0-a557-bdb5e4bc3b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:55.685562 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bdb79-f417-4ab0-a557-bdb5e4bc3b40 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:55.685848 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bdb79-f417-4ab0-a557-bdb5e4bc3b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:55.686126 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bdb79-f417-4ab0-a557-bdb5e4bc3b40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:55.693743 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bdb79-f417-4ab0-a557-bdb5e4bc3b40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.695227 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bdb79-f417-4ab0-a557-bdb5e4bc3b40 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.710523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-378bdb79-f417-4ab0-a557-bdb5e4bc3b40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:55.710523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:55.710523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:55.710523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:55.710523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:55.710523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:55.710523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:55.710523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:55.710523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:55.710523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:55.710523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:55.710523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:55.710523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:22:55.710523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:22:55.710523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:55.711498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:55.712439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:22:55.712439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:22:55.712439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:22:55.712439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:22:55.712439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:22:55.712439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:22:55.712439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:22:55.712439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:55.712439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 484/972] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:22:55.718054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171072e7-9106-448a-8cb8-2d46accf5f09 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.824125 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171072e7-9106-448a-8cb8-2d46accf5f09 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:55.860312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550f980-7282-4b61-9ea7-2cac57f22ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:55.860989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550f980-7282-4b61-9ea7-2cac57f22ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:55.861273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550f980-7282-4b61-9ea7-2cac57f22ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:55.861580 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550f980-7282-4b61-9ea7-2cac57f22ae8 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:55.862424 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550f980-7282-4b61-9ea7-2cac57f22ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:55.862741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550f980-7282-4b61-9ea7-2cac57f22ae8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:55.864177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550f980-7282-4b61-9ea7-2cac57f22ae8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:55.879611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 489/973] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:22:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:55.885813 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bdb79-f417-4ab0-a557-bdb5e4bc3b40 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:55.937431 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:55.994388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bdb79-f417-4ab0-a557-bdb5e4bc3b40 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:56.033375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcaf4a-e7ed-4946-b825-0cbfbe5e9cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:56.034069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcaf4a-e7ed-4946-b825-0cbfbe5e9cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.034354 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcaf4a-e7ed-4946-b825-0cbfbe5e9cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.034630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcaf4a-e7ed-4946-b825-0cbfbe5e9cf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.035469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcaf4a-e7ed-4946-b825-0cbfbe5e9cf4 None admin] RBAC: Adding query filter params (role.id=6e721ce489704e1fbef73a459c754865, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=54123f8a9de7428bb7e34557aea23ebf) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:56.035780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcaf4a-e7ed-4946-b825-0cbfbe5e9cf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:56.037328 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcaf4a-e7ed-4946-b825-0cbfbe5e9cf4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:56.044237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 485/974] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:22:55 2022] GET /identity/v3/role_assignments?user.id=54123f8a9de7428bb7e34557aea23ebf&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=6e721ce489704e1fbef73a459c754865 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:56.308740 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03ae68-907d-49b6-b95f-0caff35a5ca7 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.309129 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03ae68-907d-49b6-b95f-0caff35a5ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.309308 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03ae68-907d-49b6-b95f-0caff35a5ca7 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.310968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 490/975] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:56.316153 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95779532-b57e-4f5a-9fff-ee4fec44b6c0 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.316547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95779532-b57e-4f5a-9fff-ee4fec44b6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.316710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95779532-b57e-4f5a-9fff-ee4fec44b6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.334682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-95779532-b57e-4f5a-9fff-ee4fec44b6c0 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:56.335871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-95779532-b57e-4f5a-9fff-ee4fec44b6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:56.405918 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 486/976] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:56.430051 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03ae68-907d-49b6-b95f-0caff35a5ca7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:56.433425 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:56.536151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03ae68-907d-49b6-b95f-0caff35a5ca7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:56.571153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcad4a-03e1-4103-bb9e-4d97905381ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:56.571752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcad4a-03e1-4103-bb9e-4d97905381ce None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.572035 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcad4a-03e1-4103-bb9e-4d97905381ce None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.572309 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcad4a-03e1-4103-bb9e-4d97905381ce None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.573022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dcad4a-03e1-4103-bb9e-4d97905381ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:56.574492 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dcad4a-03e1-4103-bb9e-4d97905381ce None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:56.575819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: WARNING keystone.server.flask.common [None req-c6dcad4a-03e1-4103-bb9e-4d97905381ce None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 15 00:22:56.590166 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.sql.core [None req-c6dcad4a-03e1-4103-bb9e-4d97905381ce None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 00:22:56.590166 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 15 00:22:56.590166 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [parameters: {'user_id': 'd200271008d94786bfed4c028cb06c17', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 15 00:22:56.590166 dv-cinder-835384-6-smb devstack@keystone.service[80189]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80189) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 15 00:22:56.609975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-c6dcad4a-03e1-4103-bb9e-4d97905381ce None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 15 00:22:56.609975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:56.609975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 00:22:56.609975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 00:22:56.609975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 00:22:56.609975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 00:22:56.609975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 00:22:56.609975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 00:22:56.609975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 00:22:56.609975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application conn.query(q) Jun 15 00:22:56.609975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 00:22:56.609975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 00:22:56.609975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 00:22:56.609975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application result.read() Jun 15 00:22:56.609975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 00:22:56.610964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application next(self.gen) Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application yield resource Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application next(self.gen) Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.session.rollback() Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.force_reraise() Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise self.value Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application session.commit() Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 15 00:22:56.611994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._prepare_impl() Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.session.flush() Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._flush(objects) Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application compat.raise_( Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application flush_context.execute() Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rec.execute(self) Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 15 00:22:56.613054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 15 00:22:56.614023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 15 00:22:56.614023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 15 00:22:56.614023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 15 00:22:56.614023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 15 00:22:56.614023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 15 00:22:56.614023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 15 00:22:56.614023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 15 00:22:56.614023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 15 00:22:56.614023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 15 00:22:56.614023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 15 00:22:56.614023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 15 00:22:56.614023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 15 00:22:56.614023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 15 00:22:56.614023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 15 00:22:56.614023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 15 00:22:56.614023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception Jun 15 00:22:56.615358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 15 00:22:56.615358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 15 00:22:56.615358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 15 00:22:56.615358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 15 00:22:56.615358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 15 00:22:56.615358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application result = self._query(query) Jun 15 00:22:56.615358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 15 00:22:56.615358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application conn.query(q) Jun 15 00:22:56.615358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 15 00:22:56.615358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 15 00:22:56.615358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 15 00:22:56.615358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application result.read() Jun 15 00:22:56.615358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 15 00:22:56.615358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 15 00:22:56.615358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 15 00:22:56.615358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 15 00:22:56.616347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 15 00:22:56.616347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 15 00:22:56.616347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 15 00:22:56.616347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 15 00:22:56.616347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 15 00:22:56.616347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 15 00:22:56.616347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd200271008d94786bfed4c028cb06c17', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 15 00:22:56.616347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 15 00:22:56.616347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:56.616347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:56.616347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:56.616347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:56.616347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:56.616347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:56.616347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 15 00:22:56.617190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 15 00:22:56.622320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 15 00:22:56.622320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 15 00:22:56.622320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 15 00:22:56.622320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 15 00:22:56.622320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 15 00:22:56.622320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:56.622320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 491/977] 10.222.0.36 () {60 vars in 1131 bytes} [Wed Jun 15 00:22:56 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:56.622793 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95779532-b57e-4f5a-9fff-ee4fec44b6c0 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:56.669837 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:56.730253 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95779532-b57e-4f5a-9fff-ee4fec44b6c0 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:56.765896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d78141-5d7b-4668-9159-b86e8c24c9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:56.766718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d78141-5d7b-4668-9159-b86e8c24c9ee None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.766999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d78141-5d7b-4668-9159-b86e8c24c9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.767324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d78141-5d7b-4668-9159-b86e8c24c9ee None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.775799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d78141-5d7b-4668-9159-b86e8c24c9ee None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:56.777380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d78141-5d7b-4668-9159-b86e8c24c9ee None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:56.793005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c1d78141-5d7b-4668-9159-b86e8c24c9ee None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 00:22:56.793005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:56.793005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:56.793005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:56.793005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:56.793005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:56.793005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:56.793005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:56.793005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:56.793005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:56.793005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:56.793005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:56.793005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:22:56.793005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:22:56.793005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:22:56.793005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:56.795054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:56.796294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:56.796294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:56.796294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:22:56.796294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:22:56.796294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:22:56.796294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:22:56.796294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:22:56.796294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:22:56.796294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 15 00:22:56.796294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:56.796294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 487/978] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:22:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:56.802750 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcad4a-03e1-4103-bb9e-4d97905381ce None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:56.873935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:56.913182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcad4a-03e1-4103-bb9e-4d97905381ce None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:56.950618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db438dd8-d083-4864-994c-5650ecca02bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:56.951340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db438dd8-d083-4864-994c-5650ecca02bb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:56.951627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db438dd8-d083-4864-994c-5650ecca02bb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:56.951905 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db438dd8-d083-4864-994c-5650ecca02bb None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:56.952735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db438dd8-d083-4864-994c-5650ecca02bb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:56.953045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db438dd8-d083-4864-994c-5650ecca02bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:56.954790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db438dd8-d083-4864-994c-5650ecca02bb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:56.995575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 492/979] 10.222.0.36 () {56 vars in 1101 bytes} [Wed Jun 15 00:22:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:57.006085 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cce86-4fa5-4b39-8767-9cba1c72d99c None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:57.006414 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cce86-4fa5-4b39-8767-9cba1c72d99c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:57.006655 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cce86-4fa5-4b39-8767-9cba1c72d99c None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:57.009613 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 488/980] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:57.014646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ca9af-845a-4f57-94e8-bcfee42c76d7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:57.014961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ca9af-845a-4f57-94e8-bcfee42c76d7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:57.015239 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ca9af-845a-4f57-94e8-bcfee42c76d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:57.033667 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8c2ca9af-845a-4f57-94e8-bcfee42c76d7 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:57.035259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8c2ca9af-845a-4f57-94e8-bcfee42c76d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:57.116740 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 493/981] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:57.142293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cce86-4fa5-4b39-8767-9cba1c72d99c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:57.251154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:57.255322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cce86-4fa5-4b39-8767-9cba1c72d99c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:57.292876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc9c87-ccf2-48c8-88ef-72554f7391b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:57.293588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc9c87-ccf2-48c8-88ef-72554f7391b2 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:57.293874 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc9c87-ccf2-48c8-88ef-72554f7391b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:57.294202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc9c87-ccf2-48c8-88ef-72554f7391b2 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:57.294934 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc9c87-ccf2-48c8-88ef-72554f7391b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:57.296330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc9c87-ccf2-48c8-88ef-72554f7391b2 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:57.315577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 489/982] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 15 00:22:57 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:22:57.880250 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dedf4-537b-4f26-81b7-be2a9a10cbc8 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:57.880812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dedf4-537b-4f26-81b7-be2a9a10cbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:57.880812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dedf4-537b-4f26-81b7-be2a9a10cbc8 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:57.882514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 494/983] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:57.888820 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df2221-aaa3-4895-9fa5-adfc4e38a94f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:57.889252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df2221-aaa3-4895-9fa5-adfc4e38a94f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:57.889475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df2221-aaa3-4895-9fa5-adfc4e38a94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:57.906871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-45df2221-aaa3-4895-9fa5-adfc4e38a94f None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:57.908079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-45df2221-aaa3-4895-9fa5-adfc4e38a94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:57.987984 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 490/984] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:58.011144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dedf4-537b-4f26-81b7-be2a9a10cbc8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:58.075460 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:58.126779 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dedf4-537b-4f26-81b7-be2a9a10cbc8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:58.161984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779501b-79e4-4116-8595-5026bfd5aa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:58.162779 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779501b-79e4-4116-8595-5026bfd5aa55 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.163062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779501b-79e4-4116-8595-5026bfd5aa55 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.163334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779501b-79e4-4116-8595-5026bfd5aa55 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.164004 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779501b-79e4-4116-8595-5026bfd5aa55 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:58.165452 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779501b-79e4-4116-8595-5026bfd5aa55 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-0779501b-79e4-4116-8595-5026bfd5aa55 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:58.178835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:58.179923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:58.179923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:58.179923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:58.179923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:58.179923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:58.179923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:58.179923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:58.179923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:58.179923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:58.179923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:58.179923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:58.179923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:58.179923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:58.179923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:58.179923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:58.179923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:58.180764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:58.180764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:58.180764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:58.180764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:58.180764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:58.180764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:58.180764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:58.180764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:58.180764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:58.180764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:58.180764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:58.180764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:58.180764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:22:58.180764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:58.185399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 495/985] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 15 00:22:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:58.186857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df2221-aaa3-4895-9fa5-adfc4e38a94f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:58.227857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b19ad7-187a-4df9-bf39-bc3307355612 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.228212 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b19ad7-187a-4df9-bf39-bc3307355612 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.228401 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b19ad7-187a-4df9-bf39-bc3307355612 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.229858 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 496/986] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:22:58.234792 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611daea0-9cc9-4305-9a21-9b987958287a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.235072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611daea0-9cc9-4305-9a21-9b987958287a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.235352 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611daea0-9cc9-4305-9a21-9b987958287a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.252348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-611daea0-9cc9-4305-9a21-9b987958287a None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:58.253571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-611daea0-9cc9-4305-9a21-9b987958287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:58.275881 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:58.292783 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df2221-aaa3-4895-9fa5-adfc4e38a94f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:58.326596 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 497/987] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:22:58.328377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddabf2-3258-4e0f-97bf-b09f11afe0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:58.329060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddabf2-3258-4e0f-97bf-b09f11afe0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.329368 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddabf2-3258-4e0f-97bf-b09f11afe0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.329657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddabf2-3258-4e0f-97bf-b09f11afe0f3 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.330376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddabf2-3258-4e0f-97bf-b09f11afe0f3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:58.330688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddabf2-3258-4e0f-97bf-b09f11afe0f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:58.332083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddabf2-3258-4e0f-97bf-b09f11afe0f3 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:58.343325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 491/988] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 15 00:22:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:58.344885 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611daea0-9cc9-4305-9a21-9b987958287a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:58.348376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddabf2-3258-4e0f-97bf-b09f11afe0f3 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:58.396220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:58.452980 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611daea0-9cc9-4305-9a21-9b987958287a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:58.455435 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddabf2-3258-4e0f-97bf-b09f11afe0f3 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:58.488462 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495cd1c-220c-4dd3-a2dd-d33f7271ee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:58.489144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495cd1c-220c-4dd3-a2dd-d33f7271ee4f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.489944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495cd1c-220c-4dd3-a2dd-d33f7271ee4f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.490337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495cd1c-220c-4dd3-a2dd-d33f7271ee4f None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.491048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495cd1c-220c-4dd3-a2dd-d33f7271ee4f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:58.491212 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa2e60-227b-4f0c-9e88-7872c3156308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:58.491397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495cd1c-220c-4dd3-a2dd-d33f7271ee4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:58.492019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa2e60-227b-4f0c-9e88-7872c3156308 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.492305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa2e60-227b-4f0c-9e88-7872c3156308 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.492584 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa2e60-227b-4f0c-9e88-7872c3156308 None admin] PATH_INFO: `/v3/services/image` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.492736 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495cd1c-220c-4dd3-a2dd-d33f7271ee4f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:58.493246 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa2e60-227b-4f0c-9e88-7872c3156308 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:58.494723 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa2e60-227b-4f0c-9e88-7872c3156308 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:58.503000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 498/989] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 15 00:22:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:58.504053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495cd1c-220c-4dd3-a2dd-d33f7271ee4f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-5efa2e60-227b-4f0c-9e88-7872c3156308 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:58.512449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:58.513760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:58.513760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:58.513760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:58.513760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:58.513760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:58.513760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:58.513760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:58.513760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:58.513760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:58.513760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:58.513760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:58.513760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:58.513760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:58.513760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:58.513760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:58.513760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:58.514892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:58.514892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:58.514892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:58.514892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:58.514892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:58.514892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:58.514892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:58.514892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:58.514892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:58.514892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:58.514892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:58.514892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:58.514892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:22:58.514892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:22:58.517668 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 492/990] 10.222.0.36 () {56 vars in 1105 bytes} [Wed Jun 15 00:22:58 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:58.519312 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa2e60-227b-4f0c-9e88-7872c3156308 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:58.536132 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:58.608785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495cd1c-220c-4dd3-a2dd-d33f7271ee4f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:58.620631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:58.623902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa2e60-227b-4f0c-9e88-7872c3156308 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:58.649974 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f59c4-fb03-4a08-b6c6-18e0e2eb1a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:58.650650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f59c4-fb03-4a08-b6c6-18e0e2eb1a8c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.650936 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f59c4-fb03-4a08-b6c6-18e0e2eb1a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.651352 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f59c4-fb03-4a08-b6c6-18e0e2eb1a8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.652019 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f59c4-fb03-4a08-b6c6-18e0e2eb1a8c None admin] RBAC: Adding query filter params (interface=admin, service_id=1d6fd0e536454a61b93cc384cbfd868e, region_id=RegionOne) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:58.652340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f59c4-fb03-4a08-b6c6-18e0e2eb1a8c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:58.653747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f59c4-fb03-4a08-b6c6-18e0e2eb1a8c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:58.659074 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 499/991] 10.222.0.36 () {56 vars in 1249 bytes} [Wed Jun 15 00:22:58 2022] GET /identity/v3/endpoints?service_id=1d6fd0e536454a61b93cc384cbfd868e&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:58.661656 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbff04-568a-43ea-b141-bf59e66bb8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:58.662374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbff04-568a-43ea-b141-bf59e66bb8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.662705 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbff04-568a-43ea-b141-bf59e66bb8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.662983 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbff04-568a-43ea-b141-bf59e66bb8a6 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.663874 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbff04-568a-43ea-b141-bf59e66bb8a6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:58.664189 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbff04-568a-43ea-b141-bf59e66bb8a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:58.664383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f59c4-fb03-4a08-b6c6-18e0e2eb1a8c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:58.665596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbff04-568a-43ea-b141-bf59e66bb8a6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:58.676147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 493/992] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:58.676844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbff04-568a-43ea-b141-bf59e66bb8a6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:58.758363 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:58.768791 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f59c4-fb03-4a08-b6c6-18e0e2eb1a8c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:58.782467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbff04-568a-43ea-b141-bf59e66bb8a6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:58.804583 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7cac8-6504-428b-8494-72ec5b53d840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:58.805269 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7cac8-6504-428b-8494-72ec5b53d840 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.805587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7cac8-6504-428b-8494-72ec5b53d840 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.805867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7cac8-6504-428b-8494-72ec5b53d840 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.806673 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7cac8-6504-428b-8494-72ec5b53d840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:58.808157 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7cac8-6504-428b-8494-72ec5b53d840 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:58.814959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 500/993] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 15 00:22:58 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:22:58.817686 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0aea9-00b3-4061-a991-497b6a1286bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:58.818410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0aea9-00b3-4061-a991-497b6a1286bc None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:58.818698 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0aea9-00b3-4061-a991-497b6a1286bc None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:58.818978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0aea9-00b3-4061-a991-497b6a1286bc None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:58.819705 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0aea9-00b3-4061-a991-497b6a1286bc None admin] RBAC: Adding query filter params (type=image) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:58.820019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0aea9-00b3-4061-a991-497b6a1286bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:58.821468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0aea9-00b3-4061-a991-497b6a1286bc None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:58.833225 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 494/994] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:22:58 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:22:59.412070 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d8983-6868-4091-b0e3-6ba2dbaeacff None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:59.412574 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d8983-6868-4091-b0e3-6ba2dbaeacff None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:59.412574 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d8983-6868-4091-b0e3-6ba2dbaeacff None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:59.414111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 501/995] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:22:59.419276 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e7d2c-f4a4-4c5b-bb2e-b9a71731ac82 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:59.419658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e7d2c-f4a4-4c5b-bb2e-b9a71731ac82 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:59.419840 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e7d2c-f4a4-4c5b-bb2e-b9a71731ac82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:59.437322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-448e7d2c-f4a4-4c5b-bb2e-b9a71731ac82 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:22:59.438640 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-448e7d2c-f4a4-4c5b-bb2e-b9a71731ac82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:22:59.510867 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 495/996] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:22:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:22:59.533817 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d8983-6868-4091-b0e3-6ba2dbaeacff None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:59.576784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:59.643414 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d8983-6868-4091-b0e3-6ba2dbaeacff None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:59.679589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ce30e-90bf-48e4-9ad3-625ebba6b9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:59.680328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ce30e-90bf-48e4-9ad3-625ebba6b9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:59.680613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ce30e-90bf-48e4-9ad3-625ebba6b9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:59.680884 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ce30e-90bf-48e4-9ad3-625ebba6b9f9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:59.681570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ce30e-90bf-48e4-9ad3-625ebba6b9f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:59.682946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ce30e-90bf-48e4-9ad3-625ebba6b9f9 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-958ce30e-90bf-48e4-9ad3-625ebba6b9f9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:22:59.694994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:22:59.696096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:22:59.696096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:22:59.696096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:22:59.696096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:22:59.696096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:22:59.696096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:22:59.696096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:22:59.696096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:22:59.696096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:22:59.696096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:22:59.696096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:22:59.696096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:22:59.696096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:22:59.696096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:22:59.696096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:22:59.696096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:22:59.696942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:22:59.696942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:22:59.696942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:22:59.696942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:22:59.696942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:22:59.696942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:22:59.696942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:22:59.696942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:22:59.696942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:22:59.696942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:22:59.696942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:22:59.696942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:22:59.696942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:22:59.696942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:22:59.701298 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 502/997] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:22:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:22:59.702367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e7d2c-f4a4-4c5b-bb2e-b9a71731ac82 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:59.771786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:22:59.801899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e7d2c-f4a4-4c5b-bb2e-b9a71731ac82 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:59.835682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532d260-e6e3-4f38-9b7e-49dfd8e981d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:22:59.836396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532d260-e6e3-4f38-9b7e-49dfd8e981d7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:22:59.836678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532d260-e6e3-4f38-9b7e-49dfd8e981d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:22:59.837001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532d260-e6e3-4f38-9b7e-49dfd8e981d7 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:22:59.837747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532d260-e6e3-4f38-9b7e-49dfd8e981d7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:22:59.838207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532d260-e6e3-4f38-9b7e-49dfd8e981d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:22:59.839599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532d260-e6e3-4f38-9b7e-49dfd8e981d7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:22:59.844676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 496/998] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 15 00:22:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:22:59.850582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ce30e-90bf-48e4-9ad3-625ebba6b9f9 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:22:59.963586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ce30e-90bf-48e4-9ad3-625ebba6b9f9 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:22:59.965416 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:00.000112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6267e-f0a2-44f0-a351-da4f69a40f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:00.000793 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6267e-f0a2-44f0-a351-da4f69a40f25 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.001075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6267e-f0a2-44f0-a351-da4f69a40f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.001375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6267e-f0a2-44f0-a351-da4f69a40f25 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.002086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6267e-f0a2-44f0-a351-da4f69a40f25 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:00.002395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6267e-f0a2-44f0-a351-da4f69a40f25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:00.003773 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6267e-f0a2-44f0-a351-da4f69a40f25 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:00.013378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 503/999] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 15 00:22:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:00.015431 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532d260-e6e3-4f38-9b7e-49dfd8e981d7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:00.124733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532d260-e6e3-4f38-9b7e-49dfd8e981d7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:00.160398 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639beba-506d-472f-b03f-223ac99d1161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:00.161067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639beba-506d-472f-b03f-223ac99d1161 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.161376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639beba-506d-472f-b03f-223ac99d1161 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.161666 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639beba-506d-472f-b03f-223ac99d1161 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.162478 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639beba-506d-472f-b03f-223ac99d1161 None admin] RBAC: Adding query filter params (interface=public, service_id=b39ac5929998422ab7bd50d1d4ae5723, region_id=RegionOne) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:00.162787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639beba-506d-472f-b03f-223ac99d1161 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:00.164162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639beba-506d-472f-b03f-223ac99d1161 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:00.166919 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:00.170600 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 497/1000] 10.222.0.36 () {56 vars in 1251 bytes} [Wed Jun 15 00:23:00 2022] GET /identity/v3/endpoints?service_id=b39ac5929998422ab7bd50d1d4ae5723&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:00.175990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6267e-f0a2-44f0-a351-da4f69a40f25 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:00.277316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6267e-f0a2-44f0-a351-da4f69a40f25 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:00.309969 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39259a1b-8dde-4ba1-93e6-7c6362ebcdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:00.310636 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39259a1b-8dde-4ba1-93e6-7c6362ebcdcd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.310921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39259a1b-8dde-4ba1-93e6-7c6362ebcdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.311197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39259a1b-8dde-4ba1-93e6-7c6362ebcdcd None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.311876 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39259a1b-8dde-4ba1-93e6-7c6362ebcdcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:00.313235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39259a1b-8dde-4ba1-93e6-7c6362ebcdcd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:00.325398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 504/1001] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 15 00:23:00 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:23:00.951603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb816b-8379-44d5-b6cd-f5a73c8a22d5 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.952144 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb816b-8379-44d5-b6cd-f5a73c8a22d5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.952144 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb816b-8379-44d5-b6cd-f5a73c8a22d5 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.953859 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 498/1002] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:00.959230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd362cb-d9be-4935-ade9-f4770e52feb6 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.959516 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd362cb-d9be-4935-ade9-f4770e52feb6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.959619 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80bb7d-a917-48f2-b51c-71416d4a33e8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.959991 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd362cb-d9be-4935-ade9-f4770e52feb6 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.960066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80bb7d-a917-48f2-b51c-71416d4a33e8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.960066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80bb7d-a917-48f2-b51c-71416d4a33e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.961063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 499/1003] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:23:00.966401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db07dd-e67a-4f0d-ac04-38e531aaf999 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:00.966685 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db07dd-e67a-4f0d-ac04-38e531aaf999 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:00.966965 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db07dd-e67a-4f0d-ac04-38e531aaf999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:00.977665 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0c80bb7d-a917-48f2-b51c-71416d4a33e8 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:00.978855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0c80bb7d-a917-48f2-b51c-71416d4a33e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:00.983483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e6db07dd-e67a-4f0d-ac04-38e531aaf999 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:00.984636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e6db07dd-e67a-4f0d-ac04-38e531aaf999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:01.009678 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:01.055182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 505/1004] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:01.059112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 500/1005] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:01.078523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80bb7d-a917-48f2-b51c-71416d4a33e8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:01.083147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db07dd-e67a-4f0d-ac04-38e531aaf999 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:01.184469 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80bb7d-a917-48f2-b51c-71416d4a33e8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:01.184723 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db07dd-e67a-4f0d-ac04-38e531aaf999 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:01.224758 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:01.227863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f4d9a-fbdb-42e6-b7ab-f497192cb567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:01.228744 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f4d9a-fbdb-42e6-b7ab-f497192cb567 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:01.229012 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f4d9a-fbdb-42e6-b7ab-f497192cb567 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:01.229283 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f4d9a-fbdb-42e6-b7ab-f497192cb567 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:01.229984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f4d9a-fbdb-42e6-b7ab-f497192cb567 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:01.231363 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f4d9a-fbdb-42e6-b7ab-f497192cb567 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:01.232333 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1718e8-273a-484f-8ec6-4089e21490a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:01.233233 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1718e8-273a-484f-8ec6-4089e21490a4 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:01.233554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1718e8-273a-484f-8ec6-4089e21490a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:01.234073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1718e8-273a-484f-8ec6-4089e21490a4 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:01.234600 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1718e8-273a-484f-8ec6-4089e21490a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:01.235954 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1718e8-273a-484f-8ec6-4089e21490a4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-9e1f4d9a-fbdb-42e6-b7ab-f497192cb567 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:01.244672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:01.245788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:01.245788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:01.245788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:01.245788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:01.245788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:01.245788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:01.245788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:01.245788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:01.245788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:01.245788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:01.245788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:01.245788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:01.245788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:01.245788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:01.245788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:01.245788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:01.252137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:01.252137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:01.252137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:01.252137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:01.252137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:01.252137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:01.252137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:01.252137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:01.252137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:01.252137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:01.252137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:01.252137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:01.252137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 15 00:23:01.252137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:01.252137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 506/1006] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Jun 15 00:23:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:01.252974 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f4d9a-fbdb-42e6-b7ab-f497192cb567 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:01.257599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 501/1007] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 15 00:23:01 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:23:01.282955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:01.367480 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f4d9a-fbdb-42e6-b7ab-f497192cb567 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:01.413313 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ebc5d-181e-4b12-b635-fa6c7e5eeb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:01.414021 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ebc5d-181e-4b12-b635-fa6c7e5eeb58 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:01.414304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ebc5d-181e-4b12-b635-fa6c7e5eeb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:01.414590 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ebc5d-181e-4b12-b635-fa6c7e5eeb58 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:01.415278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ebc5d-181e-4b12-b635-fa6c7e5eeb58 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:01.415598 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ebc5d-181e-4b12-b635-fa6c7e5eeb58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:01.416958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ebc5d-181e-4b12-b635-fa6c7e5eeb58 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:01.423130 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 507/1008] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 15 00:23:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:01.428807 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1718e8-273a-484f-8ec6-4089e21490a4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:01.536358 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1718e8-273a-484f-8ec6-4089e21490a4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:01.570631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf394cfc-6862-4301-b098-49a267d7c042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:01.571311 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf394cfc-6862-4301-b098-49a267d7c042 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:01.571876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf394cfc-6862-4301-b098-49a267d7c042 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:01.572165 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf394cfc-6862-4301-b098-49a267d7c042 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:01.572883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf394cfc-6862-4301-b098-49a267d7c042 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:01.573191 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf394cfc-6862-4301-b098-49a267d7c042 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:01.574621 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf394cfc-6862-4301-b098-49a267d7c042 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:01.579742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 502/1009] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Jun 15 00:23:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:01.585490 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ebc5d-181e-4b12-b635-fa6c7e5eeb58 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:01.672155 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:01.689845 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ebc5d-181e-4b12-b635-fa6c7e5eeb58 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:01.723330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc4a11-f44d-43b4-b6f6-aabcab5ac269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:01.724001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4a11-f44d-43b4-b6f6-aabcab5ac269 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:01.724287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4a11-f44d-43b4-b6f6-aabcab5ac269 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:01.724610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4a11-f44d-43b4-b6f6-aabcab5ac269 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:01.725373 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc4a11-f44d-43b4-b6f6-aabcab5ac269 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:01.726774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc4a11-f44d-43b4-b6f6-aabcab5ac269 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:01.742794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 508/1010] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 15 00:23:01 2022] POST /identity/v3/endpoints => generated 325 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:02.420896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841f19-68ec-440f-a303-738dee767fb3 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.421677 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841f19-68ec-440f-a303-738dee767fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.421677 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841f19-68ec-440f-a303-738dee767fb3 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.422942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 503/1011] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:02.428280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cec107-83a3-4dd5-9044-db7c4b425999 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.428743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cec107-83a3-4dd5-9044-db7c4b425999 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.428823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cec107-83a3-4dd5-9044-db7c4b425999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.446503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b9cec107-83a3-4dd5-9044-db7c4b425999 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:02.447687 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b9cec107-83a3-4dd5-9044-db7c4b425999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:02.522816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 509/1012] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:02 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:02.545384 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841f19-68ec-440f-a303-738dee767fb3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:02.602690 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:02.649120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841f19-68ec-440f-a303-738dee767fb3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:02.681587 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c0455-cf19-47a6-96e2-4dbd2152cd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:02.682330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c0455-cf19-47a6-96e2-4dbd2152cd33 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.682611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c0455-cf19-47a6-96e2-4dbd2152cd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.682885 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c0455-cf19-47a6-96e2-4dbd2152cd33 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.683534 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c0455-cf19-47a6-96e2-4dbd2152cd33 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:02.684912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c0455-cf19-47a6-96e2-4dbd2152cd33 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c59c0455-cf19-47a6-96e2-4dbd2152cd33 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:02.696623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:02.697632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:02.697632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:02.697632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:02.697632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:02.697632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:02.697632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:02.697632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:02.697632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:02.697632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:02.697632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:02.697632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:02.697632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:02.697632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:02.697632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:02.697632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:02.697632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:02.698501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:02.698501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:02.698501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:02.698501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:02.698501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:02.698501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:02.698501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:02.698501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:02.698501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:02.698501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:02.698501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:02.698501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:02.698501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 15 00:23:02.698501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:23:02.701672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 504/1013] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:02.705872 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cec107-83a3-4dd5-9044-db7c4b425999 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:02.771421 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:02.803191 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cec107-83a3-4dd5-9044-db7c4b425999 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:02.838591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae15ea-7749-47b5-a932-87e43d156479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:02.839295 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae15ea-7749-47b5-a932-87e43d156479 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.839576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae15ea-7749-47b5-a932-87e43d156479 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.839850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae15ea-7749-47b5-a932-87e43d156479 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.840588 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae15ea-7749-47b5-a932-87e43d156479 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:02.840891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae15ea-7749-47b5-a932-87e43d156479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:02.842409 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae15ea-7749-47b5-a932-87e43d156479 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:02.852773 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 510/1014] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 15 00:23:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:02.854224 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c0455-cf19-47a6-96e2-4dbd2152cd33 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:02.958986 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c0455-cf19-47a6-96e2-4dbd2152cd33 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:02.977142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:02.995806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f10c43-e9e3-45f4-a35c-8e821105a40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:02.996481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f10c43-e9e3-45f4-a35c-8e821105a40b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:02.996763 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f10c43-e9e3-45f4-a35c-8e821105a40b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:02.997035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f10c43-e9e3-45f4-a35c-8e821105a40b None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:02.997770 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f10c43-e9e3-45f4-a35c-8e821105a40b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:02.998082 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f10c43-e9e3-45f4-a35c-8e821105a40b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:02.999454 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f10c43-e9e3-45f4-a35c-8e821105a40b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:03.004606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 505/1015] 10.222.0.36 () {56 vars in 1112 bytes} [Wed Jun 15 00:23:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:03.010450 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae15ea-7749-47b5-a932-87e43d156479 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:03.126383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae15ea-7749-47b5-a932-87e43d156479 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:03.160504 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31caba-28d0-4709-a03c-060e0e140c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:03.161175 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31caba-28d0-4709-a03c-060e0e140c8f None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:03.161491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31caba-28d0-4709-a03c-060e0e140c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:03.161770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31caba-28d0-4709-a03c-060e0e140c8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:03.162539 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31caba-28d0-4709-a03c-060e0e140c8f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:03.163911 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c31caba-28d0-4709-a03c-060e0e140c8f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:03.167235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:03.183767 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 511/1016] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 15 00:23:03 2022] POST /identity/v3/endpoints => generated 334 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:23:03.387664 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e86f2-8977-48d2-85a0-76a7a2a5bb92 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:03.387873 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e86f2-8977-48d2-85a0-76a7a2a5bb92 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:03.388148 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e86f2-8977-48d2-85a0-76a7a2a5bb92 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:03.389781 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 506/1017] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:03.395117 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c5d53-9098-46f1-8b2d-6e22a79a30f4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:03.395407 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c5d53-9098-46f1-8b2d-6e22a79a30f4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:03.395684 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c5d53-9098-46f1-8b2d-6e22a79a30f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:03.413228 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-303c5d53-9098-46f1-8b2d-6e22a79a30f4 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:03.414492 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-303c5d53-9098-46f1-8b2d-6e22a79a30f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:03.488749 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 512/1018] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:03.511799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e86f2-8977-48d2-85a0-76a7a2a5bb92 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:03.616003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e86f2-8977-48d2-85a0-76a7a2a5bb92 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:03.652636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4339-e8a5-4849-932d-b76c0e9d084b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:03.653400 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4339-e8a5-4849-932d-b76c0e9d084b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:03.653693 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4339-e8a5-4849-932d-b76c0e9d084b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:03.653970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4339-e8a5-4849-932d-b76c0e9d084b None admin] PATH_INFO: `/v3/services/image` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:03.654647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e4339-e8a5-4849-932d-b76c0e9d084b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:03.656059 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e4339-e8a5-4849-932d-b76c0e9d084b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-ed9e4339-e8a5-4849-932d-b76c0e9d084b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:03.668194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:03.669207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:03.669207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:03.669207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:03.669207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:03.669207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:03.669207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:03.669207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:03.669207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:03.669207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:03.669207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:03.669207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:03.669207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:03.669207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:03.669207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:03.669207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:03.669207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:03.670442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:03.670442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:03.670442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:03.670442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:03.670442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:03.670442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:03.670442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:03.670442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:03.670442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:03.670442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:03.670442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:03.670442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:03.670442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:23:03.670442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:23:03.670442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 507/1019] 10.222.0.36 () {56 vars in 1105 bytes} [Wed Jun 15 00:23:03 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:03.677388 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c5d53-9098-46f1-8b2d-6e22a79a30f4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:03.782698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c5d53-9098-46f1-8b2d-6e22a79a30f4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:03.801062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:03.823408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8ed2d-b484-4b35-aa80-be8ed2c296a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:03.824114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8ed2d-b484-4b35-aa80-be8ed2c296a6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:03.824403 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8ed2d-b484-4b35-aa80-be8ed2c296a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:03.824692 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8ed2d-b484-4b35-aa80-be8ed2c296a6 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:03.825460 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8ed2d-b484-4b35-aa80-be8ed2c296a6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:03.825782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8ed2d-b484-4b35-aa80-be8ed2c296a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:03.827240 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8ed2d-b484-4b35-aa80-be8ed2c296a6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:03.833177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 513/1020] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:03.839292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4339-e8a5-4849-932d-b76c0e9d084b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:03.870869 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7322099-f061-465a-838a-07a54b504640 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:03.871191 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7322099-f061-465a-838a-07a54b504640 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:03.871405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7322099-f061-465a-838a-07a54b504640 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:03.873049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 514/1021] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:23:03.877649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27961cc9-1d68-4ab5-b760-e9fa41c0e2ce None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:03.877932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27961cc9-1d68-4ab5-b760-e9fa41c0e2ce None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:03.878219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27961cc9-1d68-4ab5-b760-e9fa41c0e2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:03.889176 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:03.897051 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-27961cc9-1d68-4ab5-b760-e9fa41c0e2ce None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:03.898308 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-27961cc9-1d68-4ab5-b760-e9fa41c0e2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:03.948504 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4339-e8a5-4849-932d-b76c0e9d084b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:03.977395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 515/1022] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:03.986574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47547bb9-e7aa-4bf2-9653-9acaecc97428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:03.987252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47547bb9-e7aa-4bf2-9653-9acaecc97428 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:03.987533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47547bb9-e7aa-4bf2-9653-9acaecc97428 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:03.987809 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47547bb9-e7aa-4bf2-9653-9acaecc97428 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:03.988516 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47547bb9-e7aa-4bf2-9653-9acaecc97428 None admin] RBAC: Adding query filter params (type=image) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:03.988821 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47547bb9-e7aa-4bf2-9653-9acaecc97428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:03.990655 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47547bb9-e7aa-4bf2-9653-9acaecc97428 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:04.000511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 508/1023] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:04.000696 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27961cc9-1d68-4ab5-b760-e9fa41c0e2ce None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:04.002168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47547bb9-e7aa-4bf2-9653-9acaecc97428 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:04.103995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47547bb9-e7aa-4bf2-9653-9acaecc97428 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:04.106378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27961cc9-1d68-4ab5-b760-e9fa41c0e2ce None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:04.115396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:04.117552 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:04.141247 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693b754-f6d6-4b0c-ab7d-46b83a2caafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:04.141955 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693b754-f6d6-4b0c-ab7d-46b83a2caafa None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:04.142242 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693b754-f6d6-4b0c-ab7d-46b83a2caafa None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:04.142522 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693b754-f6d6-4b0c-ab7d-46b83a2caafa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:04.142851 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba5414-b4fe-48a5-9829-933750ca8252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:04.143323 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693b754-f6d6-4b0c-ab7d-46b83a2caafa None admin] RBAC: Adding query filter params (interface=public, service_id=4eb2b0305cec4385a439ca8331bd4c17, region_id=RegionOne) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:04.143639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693b754-f6d6-4b0c-ab7d-46b83a2caafa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:04.143732 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba5414-b4fe-48a5-9829-933750ca8252 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:04.143935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba5414-b4fe-48a5-9829-933750ca8252 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:04.144208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba5414-b4fe-48a5-9829-933750ca8252 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:04.145015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693b754-f6d6-4b0c-ab7d-46b83a2caafa None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:04.145378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba5414-b4fe-48a5-9829-933750ca8252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:04.146852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba5414-b4fe-48a5-9829-933750ca8252 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:04.148790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 516/1024] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:04.155766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 509/1025] 10.222.0.36 () {56 vars in 1251 bytes} [Wed Jun 15 00:23:04 2022] GET /identity/v3/endpoints?service_id=4eb2b0305cec4385a439ca8331bd4c17&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:04.155907 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba5414-b4fe-48a5-9829-933750ca8252 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:04.157692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693b754-f6d6-4b0c-ab7d-46b83a2caafa None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:04.254841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba5414-b4fe-48a5-9829-933750ca8252 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:04.261827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693b754-f6d6-4b0c-ab7d-46b83a2caafa None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:04.292226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f20fe-5bf5-44ff-ac98-9456e3dcc96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:04.292898 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f20fe-5bf5-44ff-ac98-9456e3dcc96e None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:04.293182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f20fe-5bf5-44ff-ac98-9456e3dcc96e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:04.293493 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f20fe-5bf5-44ff-ac98-9456e3dcc96e None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:04.294216 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f20fe-5bf5-44ff-ac98-9456e3dcc96e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:04.295603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af762ab-20be-4708-bc78-9b3d8ac620a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:04.295718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f20fe-5bf5-44ff-ac98-9456e3dcc96e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:04.296274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af762ab-20be-4708-bc78-9b3d8ac620a9 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:04.296554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af762ab-20be-4708-bc78-9b3d8ac620a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:04.296825 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af762ab-20be-4708-bc78-9b3d8ac620a9 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:04.297556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af762ab-20be-4708-bc78-9b3d8ac620a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:04.298877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af762ab-20be-4708-bc78-9b3d8ac620a9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:04.312059 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 510/1026] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 15 00:23:04 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:23:04.333924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 517/1027] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 15 00:23:04 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:23:05.411337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d2da2-7e0c-4cbd-a650-e797c3585dc4 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:05.411999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d2da2-7e0c-4cbd-a650-e797c3585dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:05.411999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d2da2-7e0c-4cbd-a650-e797c3585dc4 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:05.413255 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 511/1028] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:05.419429 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6114ff3-4498-411f-b2d5-5df3889f2bc6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:05.419948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6114ff3-4498-411f-b2d5-5df3889f2bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:05.419948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6114ff3-4498-411f-b2d5-5df3889f2bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:05.437004 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b6114ff3-4498-411f-b2d5-5df3889f2bc6 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:05.438211 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b6114ff3-4498-411f-b2d5-5df3889f2bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:05.465331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:05.515520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 518/1029] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:05.538665 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d2da2-7e0c-4cbd-a650-e797c3585dc4 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:05.581263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:05.644049 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d2da2-7e0c-4cbd-a650-e797c3585dc4 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:05.676819 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7d4e9-f12a-4d70-93dd-c064ea620581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:05.677647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7d4e9-f12a-4d70-93dd-c064ea620581 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:05.677930 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7d4e9-f12a-4d70-93dd-c064ea620581 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:05.678204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7d4e9-f12a-4d70-93dd-c064ea620581 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:05.688474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7d4e9-f12a-4d70-93dd-c064ea620581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:05.696672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-84f7d4e9-f12a-4d70-93dd-c064ea620581 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:05.696672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:05.696672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:05.696672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:05.696672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:05.696672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:05.696672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:05.696672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:05.696672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:05.696672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:05.696672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:05.696672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:05.696672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:05.696672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:05.696672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:05.696672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:05.697940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:05.697940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:05.697940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:05.697940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:05.697940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:05.697940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:05.697940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:05.697940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:05.697940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:05.697940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:05.697940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:05.697940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:05.697940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:05.697940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:05.697940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:05.697940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:05.698824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:05.698824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:05.698824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:05.698824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:05.698824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:05.698824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:05.698824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:05.698824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:05.698824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:05.698824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:05.698824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:05.698824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:23:05.701715 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 512/1030] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Jun 15 00:23:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:05.703835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6114ff3-4498-411f-b2d5-5df3889f2bc6 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:05.808109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6114ff3-4498-411f-b2d5-5df3889f2bc6 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:05.843674 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f1891-42c7-492e-97bb-4fbe2ab74a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:05.844379 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f1891-42c7-492e-97bb-4fbe2ab74a92 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:05.844665 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f1891-42c7-492e-97bb-4fbe2ab74a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:05.844944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f1891-42c7-492e-97bb-4fbe2ab74a92 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:05.845712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f1891-42c7-492e-97bb-4fbe2ab74a92 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:05.846026 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f1891-42c7-492e-97bb-4fbe2ab74a92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:05.847488 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f1891-42c7-492e-97bb-4fbe2ab74a92 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:05.860279 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 519/1031] 10.222.0.36 () {56 vars in 1115 bytes} [Wed Jun 15 00:23:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:05.861548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7d4e9-f12a-4d70-93dd-c064ea620581 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:05.963610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:05.968515 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7d4e9-f12a-4d70-93dd-c064ea620581 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:06.006374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8605a-d755-40e4-a364-d7180aea2d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:06.007186 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8605a-d755-40e4-a364-d7180aea2d4f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.007467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8605a-d755-40e4-a364-d7180aea2d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.007743 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8605a-d755-40e4-a364-d7180aea2d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.019204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8605a-d755-40e4-a364-d7180aea2d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:06.020659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8605a-d755-40e4-a364-d7180aea2d4f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:06.038870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-87c8605a-d755-40e4-a364-d7180aea2d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:06.038870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:06.038870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:06.038870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:06.038870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:06.038870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:06.038870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:06.038870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:06.038870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:06.038870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:06.038870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:06.038870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:06.038870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:06.038870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:06.038870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:06.039810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:06.040727 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:06.040727 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:06.040727 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:06.040727 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:23:06.044960 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 513/1032] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:06.045950 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f1891-42c7-492e-97bb-4fbe2ab74a92 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:06.079542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:06.159384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f1891-42c7-492e-97bb-4fbe2ab74a92 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:06.193666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bc254-3fe4-4efc-9f17-67a3a67f253f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:06.194335 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc254-3fe4-4efc-9f17-67a3a67f253f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.194616 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc254-3fe4-4efc-9f17-67a3a67f253f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.194888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc254-3fe4-4efc-9f17-67a3a67f253f None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.195611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc254-3fe4-4efc-9f17-67a3a67f253f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:06.195916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc254-3fe4-4efc-9f17-67a3a67f253f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:06.197280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc254-3fe4-4efc-9f17-67a3a67f253f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:06.209641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 520/1033] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:06.215173 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8605a-d755-40e4-a364-d7180aea2d4f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:06.325855 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8605a-d755-40e4-a364-d7180aea2d4f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:06.361681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb5497-1ec8-4215-bde9-c13d7daa110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:06.362505 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb5497-1ec8-4215-bde9-c13d7daa110c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.362790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb5497-1ec8-4215-bde9-c13d7daa110c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.363079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb5497-1ec8-4215-bde9-c13d7daa110c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.371467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb5497-1ec8-4215-bde9-c13d7daa110c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:06.372947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb5497-1ec8-4215-bde9-c13d7daa110c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:06.388702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-23eb5497-1ec8-4215-bde9-c13d7daa110c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:06.388702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:06.388702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:06.388702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:06.388702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:06.388702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:06.388702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:06.388702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:06.388702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:06.388702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:06.388702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:06.388702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:06.388702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:06.388702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:06.388702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:06.388702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:06.389833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:06.395768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:06.395768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:06.395768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:06.395768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:06.395768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:06.395768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:06.395768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:06.395768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:06.395768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:06.395768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:23:06.395768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 514/1034] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 15 00:23:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:06.396471 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bc254-3fe4-4efc-9f17-67a3a67f253f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:06.452932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea121723-1e2e-4430-a7a9-896a3cbbb6c9 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.453573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea121723-1e2e-4430-a7a9-896a3cbbb6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.453573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea121723-1e2e-4430-a7a9-896a3cbbb6c9 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.455293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 515/1035] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:23:06.460867 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69656d6a-4881-4e11-85b8-2c027fedf97e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.461111 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69656d6a-4881-4e11-85b8-2c027fedf97e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.461474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69656d6a-4881-4e11-85b8-2c027fedf97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.478648 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-69656d6a-4881-4e11-85b8-2c027fedf97e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:06.479789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-69656d6a-4881-4e11-85b8-2c027fedf97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:06.482659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:06.495661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:06.517541 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bc254-3fe4-4efc-9f17-67a3a67f253f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:06.548631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 516/1036] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:06.551724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3aa24-4313-4585-a6d3-87220b8e86f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:06.552438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3aa24-4313-4585-a6d3-87220b8e86f3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.552728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3aa24-4313-4585-a6d3-87220b8e86f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.553012 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3aa24-4313-4585-a6d3-87220b8e86f3 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.553887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3aa24-4313-4585-a6d3-87220b8e86f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:06.554240 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3aa24-4313-4585-a6d3-87220b8e86f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:06.554848 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c6e9d-31ec-4d05-9eb1-6546f37a716f None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.555141 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c6e9d-31ec-4d05-9eb1-6546f37a716f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.555417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c6e9d-31ec-4d05-9eb1-6546f37a716f None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.555652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3aa24-4313-4585-a6d3-87220b8e86f3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:06.556947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 517/1037] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:06.562053 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fb7ce-c6a5-4f9c-ae7a-47be9d9ff18b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.562335 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fb7ce-c6a5-4f9c-ae7a-47be9d9ff18b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.562609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fb7ce-c6a5-4f9c-ae7a-47be9d9ff18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.575480 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 521/1038] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 15 00:23:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:06.576658 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3aa24-4313-4585-a6d3-87220b8e86f3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:06.579427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-7d0fb7ce-c6a5-4f9c-ae7a-47be9d9ff18b None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:06.580618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7d0fb7ce-c6a5-4f9c-ae7a-47be9d9ff18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:06.645790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 518/1039] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:06.651698 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fb7ce-c6a5-4f9c-ae7a-47be9d9ff18b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:06.677224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3aa24-4313-4585-a6d3-87220b8e86f3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:06.711890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9de553-6283-43a5-93d3-6ce6787ce388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:06.712695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9de553-6283-43a5-93d3-6ce6787ce388 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.712979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9de553-6283-43a5-93d3-6ce6787ce388 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.713256 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9de553-6283-43a5-93d3-6ce6787ce388 None admin] PATH_INFO: `/v3/services/image` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.713941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9de553-6283-43a5-93d3-6ce6787ce388 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:06.715310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9de553-6283-43a5-93d3-6ce6787ce388 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:06.722517 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7a9de553-6283-43a5-93d3-6ce6787ce388 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:06.726694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:06.727840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:06.727840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:06.727840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:06.727840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:06.727840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:06.727840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:06.727840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:23:06.727840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:23:06.727840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:23:06.727840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:23:06.727840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:06.727840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:06.727840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:06.727840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:06.727840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:06.727840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:06.728775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:06.728775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:06.728775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:06.728775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:06.728775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:06.728775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:06.728775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:06.728775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:06.728775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:06.728775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:06.728775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:23:06.728775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:23:06.728775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 15 00:23:06.728775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:06.728775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 522/1040] 10.222.0.36 () {56 vars in 1105 bytes} [Wed Jun 15 00:23:06 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:06.729647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9de553-6283-43a5-93d3-6ce6787ce388 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:06.733227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:06.756398 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fb7ce-c6a5-4f9c-ae7a-47be9d9ff18b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:06.790921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20749f77-34c3-474f-921a-caa14ee19c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:06.791578 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20749f77-34c3-474f-921a-caa14ee19c50 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.791911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20749f77-34c3-474f-921a-caa14ee19c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.792188 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20749f77-34c3-474f-921a-caa14ee19c50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.827513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9de553-6283-43a5-93d3-6ce6787ce388 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:06.863122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b15f1c-bf85-4b26-ae8d-ab9505c0de9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:06.863926 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b15f1c-bf85-4b26-ae8d-ab9505c0de9a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:06.864213 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b15f1c-bf85-4b26-ae8d-ab9505c0de9a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:06.864706 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20749f77-34c3-474f-921a-caa14ee19c50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:06.864807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b15f1c-bf85-4b26-ae8d-ab9505c0de9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:06.866068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b15f1c-bf85-4b26-ae8d-ab9505c0de9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:06.866374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20749f77-34c3-474f-921a-caa14ee19c50 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:06.867494 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b15f1c-bf85-4b26-ae8d-ab9505c0de9a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:06.869143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 523/1041] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:06.869948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b15f1c-bf85-4b26-ae8d-ab9505c0de9a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:06.934540 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:06.940066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:06.968017 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 519/1042] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:06 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:23:06.968798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20749f77-34c3-474f-921a-caa14ee19c50 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:06.969691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b15f1c-bf85-4b26-ae8d-ab9505c0de9a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:07.004901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804bfdf-bded-49ce-bfd3-a8e9faa14af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:07.005568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804bfdf-bded-49ce-bfd3-a8e9faa14af8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.005860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804bfdf-bded-49ce-bfd3-a8e9faa14af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.006145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804bfdf-bded-49ce-bfd3-a8e9faa14af8 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.006865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804bfdf-bded-49ce-bfd3-a8e9faa14af8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:07.007182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804bfdf-bded-49ce-bfd3-a8e9faa14af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:07.008565 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804bfdf-bded-49ce-bfd3-a8e9faa14af8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:07.013475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 524/1043] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:07.014245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804bfdf-bded-49ce-bfd3-a8e9faa14af8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:07.074867 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20749f77-34c3-474f-921a-caa14ee19c50 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:07.109528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809f420-afd2-43a0-b21e-22fc7171e905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:07.110192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809f420-afd2-43a0-b21e-22fc7171e905 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.110474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809f420-afd2-43a0-b21e-22fc7171e905 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.110744 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809f420-afd2-43a0-b21e-22fc7171e905 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.111449 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804bfdf-bded-49ce-bfd3-a8e9faa14af8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:07.111583 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809f420-afd2-43a0-b21e-22fc7171e905 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:07.112925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809f420-afd2-43a0-b21e-22fc7171e905 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:07.134240 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 520/1044] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:23:06 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:07.135161 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809f420-afd2-43a0-b21e-22fc7171e905 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:07.146585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bc9df-a732-4c19-b381-71c154f592c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:07.147516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc9df-a732-4c19-b381-71c154f592c3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.147865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc9df-a732-4c19-b381-71c154f592c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.148146 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc9df-a732-4c19-b381-71c154f592c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.151497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:07.161858 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bc9df-a732-4c19-b381-71c154f592c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:07.163353 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bc9df-a732-4c19-b381-71c154f592c3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:07.167783 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:07.182818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-dd6bc9df-a732-4c19-b381-71c154f592c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:07.182818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:07.182818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:07.182818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:07.182818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:07.182818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:07.182818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:07.182818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:07.182818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:07.182818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:07.182818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:07.182818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:07.182818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:07.182818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:07.182818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:07.183827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:07.184764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:07.184764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:07.184764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:07.184764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:07.189064 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 525/1045] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:07.190144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bc9df-a732-4c19-b381-71c154f592c3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:07.255227 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809f420-afd2-43a0-b21e-22fc7171e905 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:07.300477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec79ab9-d950-4129-8208-b860db027dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:07.301173 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec79ab9-d950-4129-8208-b860db027dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.301472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec79ab9-d950-4129-8208-b860db027dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.301748 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec79ab9-d950-4129-8208-b860db027dc5 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.302495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec79ab9-d950-4129-8208-b860db027dc5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:07.302804 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec79ab9-d950-4129-8208-b860db027dc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:07.304191 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec79ab9-d950-4129-8208-b860db027dc5 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:07.308612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bc9df-a732-4c19-b381-71c154f592c3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:07.310202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 521/1046] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:07.316766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec79ab9-d950-4129-8208-b860db027dc5 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:07.352237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67cc08-c7c4-4a96-9a44-c70367ed60ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:07.353216 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67cc08-c7c4-4a96-9a44-c70367ed60ae None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.353797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67cc08-c7c4-4a96-9a44-c70367ed60ae None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.354065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67cc08-c7c4-4a96-9a44-c70367ed60ae None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.354787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67cc08-c7c4-4a96-9a44-c70367ed60ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:07.355100 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67cc08-c7c4-4a96-9a44-c70367ed60ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:07.356883 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67cc08-c7c4-4a96-9a44-c70367ed60ae None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:07.370253 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 526/1047] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:07.376401 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67cc08-c7c4-4a96-9a44-c70367ed60ae None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:07.420540 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:07.430228 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:07.431288 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec79ab9-d950-4129-8208-b860db027dc5 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:07.466543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77e5c5-a02f-477d-ab74-15c79ef04d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:07.467226 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77e5c5-a02f-477d-ab74-15c79ef04d62 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.467489 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77e5c5-a02f-477d-ab74-15c79ef04d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.467755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77e5c5-a02f-477d-ab74-15c79ef04d62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.468495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77e5c5-a02f-477d-ab74-15c79ef04d62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:07.469907 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77e5c5-a02f-477d-ab74-15c79ef04d62 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:07.484300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67cc08-c7c4-4a96-9a44-c70367ed60ae None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:07.491346 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 522/1048] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 15 00:23:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:07.533100 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f356c7-1565-45df-ad12-b73152f6c231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:07.533944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f356c7-1565-45df-ad12-b73152f6c231 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.534234 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f356c7-1565-45df-ad12-b73152f6c231 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.534509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f356c7-1565-45df-ad12-b73152f6c231 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.543036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f356c7-1565-45df-ad12-b73152f6c231 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:07.544628 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f356c7-1565-45df-ad12-b73152f6c231 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:07.561069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-32f356c7-1565-45df-ad12-b73152f6c231 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:07.561069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:07.561069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:07.561069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:07.561069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:07.561069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:07.561069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:07.561069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:07.561069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:07.561069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:07.561069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:07.561069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:07.561069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:07.561069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:07.561069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:07.562238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:07.563158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:07.563158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:07.563158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:07.563158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:07.563158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:07.563158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:07.563158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:07.563158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:07.563158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 527/1049] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:07.568808 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77e5c5-a02f-477d-ab74-15c79ef04d62 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:07.678529 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77e5c5-a02f-477d-ab74-15c79ef04d62 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:07.713214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560cfcc-4d7e-4f9b-bd2a-7e4bf2b07c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:07.714295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560cfcc-4d7e-4f9b-bd2a-7e4bf2b07c4c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.714795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560cfcc-4d7e-4f9b-bd2a-7e4bf2b07c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.715278 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560cfcc-4d7e-4f9b-bd2a-7e4bf2b07c4c None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.716292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560cfcc-4d7e-4f9b-bd2a-7e4bf2b07c4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:07.716814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560cfcc-4d7e-4f9b-bd2a-7e4bf2b07c4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:07.718487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560cfcc-4d7e-4f9b-bd2a-7e4bf2b07c4c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:07.731467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 523/1050] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:07.737783 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f356c7-1565-45df-ad12-b73152f6c231 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:07.841487 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f356c7-1565-45df-ad12-b73152f6c231 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:07.844629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:07.878990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceea3d0-2982-48a3-82c1-24fdc53a5715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:07.879664 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceea3d0-2982-48a3-82c1-24fdc53a5715 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:07.879949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceea3d0-2982-48a3-82c1-24fdc53a5715 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:07.880228 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceea3d0-2982-48a3-82c1-24fdc53a5715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:07.881121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceea3d0-2982-48a3-82c1-24fdc53a5715 None admin] RBAC: Adding query filter params (role.id=6e721ce489704e1fbef73a459c754865, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=6d0ae1707c7041a0989889dbefeaf267) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:07.881442 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceea3d0-2982-48a3-82c1-24fdc53a5715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:07.882877 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceea3d0-2982-48a3-82c1-24fdc53a5715 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:07.888863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 528/1051] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:07 2022] GET /identity/v3/role_assignments?user.id=6d0ae1707c7041a0989889dbefeaf267&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=6e721ce489704e1fbef73a459c754865 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:09.312405 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d05b88-3ceb-4bd7-81bf-c8e559b42a5d None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:09.312961 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d05b88-3ceb-4bd7-81bf-c8e559b42a5d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:09.313044 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d05b88-3ceb-4bd7-81bf-c8e559b42a5d None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:09.314506 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 524/1052] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:09.319916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4eebea-0fcc-457a-97c0-4ce6fcd7b28d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:09.320343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4eebea-0fcc-457a-97c0-4ce6fcd7b28d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:09.320423 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4eebea-0fcc-457a-97c0-4ce6fcd7b28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:09.337635 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5c4eebea-0fcc-457a-97c0-4ce6fcd7b28d None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:09.338829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5c4eebea-0fcc-457a-97c0-4ce6fcd7b28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:09.414097 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 529/1053] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:09.437314 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d05b88-3ceb-4bd7-81bf-c8e559b42a5d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:09.446964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:09.545618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d05b88-3ceb-4bd7-81bf-c8e559b42a5d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:09.586091 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8c625-95aa-4990-9373-77e064d242e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:09.586866 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c625-95aa-4990-9373-77e064d242e5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:09.587142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c625-95aa-4990-9373-77e064d242e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:09.587419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c625-95aa-4990-9373-77e064d242e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:09.599919 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8c625-95aa-4990-9373-77e064d242e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:09.607872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-e6d8c625-95aa-4990-9373-77e064d242e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:09.607872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:09.607872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:09.607872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:09.607872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:09.607872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:09.607872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:09.607872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:09.607872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:09.607872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:09.607872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:09.607872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:09.607872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:09.607872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:09.607872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:09.607872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:09.608865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:09.608865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:09.608865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:09.608865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:09.608865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:09.608865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:09.608865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:09.608865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:09.608865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:09.608865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:09.608865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:09.608865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:09.608865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:09.608865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:09.608865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:09.608865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:09.610117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:09.610117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:09.610117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:09.610117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:09.610117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:09.610117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:09.610117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:09.610117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:09.610117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:09.610117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:09.610117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:09.610117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:23:09.613722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 525/1054] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:09.615545 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4eebea-0fcc-457a-97c0-4ce6fcd7b28d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:09.638751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4208fd0-2cd3-4010-8174-6f9a2e668d43 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:09.639056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4208fd0-2cd3-4010-8174-6f9a2e668d43 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:09.639295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4208fd0-2cd3-4010-8174-6f9a2e668d43 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:09.640807 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 526/1055] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:23:09.645527 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45dc10-1042-4884-82e4-17ebcd3d2322 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:09.645854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45dc10-1042-4884-82e4-17ebcd3d2322 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:09.646159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45dc10-1042-4884-82e4-17ebcd3d2322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:09.662717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-fb45dc10-1042-4884-82e4-17ebcd3d2322 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:09.663901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fb45dc10-1042-4884-82e4-17ebcd3d2322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:09.719972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:09.723560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4eebea-0fcc-457a-97c0-4ce6fcd7b28d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:09.735047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:09.743771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 527/1056] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:23:09.763912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529877d-8cd4-4e69-949e-415c184424cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:09.764674 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529877d-8cd4-4e69-949e-415c184424cf None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:09.765026 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529877d-8cd4-4e69-949e-415c184424cf None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:09.765377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529877d-8cd4-4e69-949e-415c184424cf None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:09.766149 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529877d-8cd4-4e69-949e-415c184424cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:09.766432 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45dc10-1042-4884-82e4-17ebcd3d2322 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:09.766545 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529877d-8cd4-4e69-949e-415c184424cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:09.767822 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529877d-8cd4-4e69-949e-415c184424cf None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:09.778117 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 530/1057] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:09.784287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529877d-8cd4-4e69-949e-415c184424cf None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:09.878740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45dc10-1042-4884-82e4-17ebcd3d2322 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:09.890284 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529877d-8cd4-4e69-949e-415c184424cf None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:09.918974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8c414-c738-48a1-88fd-0d20d904566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:09.919658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8c414-c738-48a1-88fd-0d20d904566d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:09.919926 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8c414-c738-48a1-88fd-0d20d904566d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:09.920205 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8c414-c738-48a1-88fd-0d20d904566d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:09.928808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc0ab9-16e8-492a-b098-2a0505dea757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:09.930577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc0ab9-16e8-492a-b098-2a0505dea757 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:09.930867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc0ab9-16e8-492a-b098-2a0505dea757 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:09.931147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc0ab9-16e8-492a-b098-2a0505dea757 None admin] PATH_INFO: `/v3/users/10ac2ca182fb4c068eb359f9f2a17a38` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:09.949714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc0ab9-16e8-492a-b098-2a0505dea757 None admin] RBAC: Authorizing `identity:get_user(user_id=10ac2ca182fb4c068eb359f9f2a17a38)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:09.951186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc0ab9-16e8-492a-b098-2a0505dea757 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:09.953124 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 531/1058] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:23:09 2022] GET /identity/v3/users/10ac2ca182fb4c068eb359f9f2a17a38 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:09.959836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc0ab9-16e8-492a-b098-2a0505dea757 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:09.978958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:09.992159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:10.000072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8c414-c738-48a1-88fd-0d20d904566d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.001651 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8c414-c738-48a1-88fd-0d20d904566d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.063004 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc0ab9-16e8-492a-b098-2a0505dea757 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:10.100074 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41952eb4-c84d-4632-8049-bb660410ca93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.100731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41952eb4-c84d-4632-8049-bb660410ca93 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.101016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41952eb4-c84d-4632-8049-bb660410ca93 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.101319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41952eb4-c84d-4632-8049-bb660410ca93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.105935 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 528/1059] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:23:10.107275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252e07f-66ef-4497-ad51-9fb81ad7975c None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.107563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252e07f-66ef-4497-ad51-9fb81ad7975c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.107836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252e07f-66ef-4497-ad51-9fb81ad7975c None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.113189 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 529/1060] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:10.113979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252e07f-66ef-4497-ad51-9fb81ad7975c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:10.168173 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41952eb4-c84d-4632-8049-bb660410ca93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.169611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41952eb4-c84d-4632-8049-bb660410ca93 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.187842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:10.207133 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:10.214454 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252e07f-66ef-4497-ad51-9fb81ad7975c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:10.248504 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a191d3-214c-4266-846d-ce30ca0adeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.249321 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a191d3-214c-4266-846d-ce30ca0adeaa None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.249639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a191d3-214c-4266-846d-ce30ca0adeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.249922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a191d3-214c-4266-846d-ce30ca0adeaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.262626 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a191d3-214c-4266-846d-ce30ca0adeaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.264086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a191d3-214c-4266-846d-ce30ca0adeaa None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.269131 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 532/1061] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 00:23:10.270545 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8b386-05bd-412e-a621-6ea1b5d2e5cc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.270838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8b386-05bd-412e-a621-6ea1b5d2e5cc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.271189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8b386-05bd-412e-a621-6ea1b5d2e5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.282684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-b4a191d3-214c-4266-846d-ce30ca0adeaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:10.282684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:10.282684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:10.282684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:10.282684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:10.282684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:10.282684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:10.282684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:10.282684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:10.282684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:10.282684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:10.282684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:10.282684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:10.282684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:10.282684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:10.283649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:10.284600 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:10.284600 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:10.284600 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:10.284600 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:23:10.285084 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 530/1062] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:10.286089 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a191d3-214c-4266-846d-ce30ca0adeaa None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:10.286831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-58d8b386-05bd-412e-a621-6ea1b5d2e5cc None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:10.287997 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-58d8b386-05bd-412e-a621-6ea1b5d2e5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:10.355174 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 533/1063] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:10.356011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8b386-05bd-412e-a621-6ea1b5d2e5cc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:10.383681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a191d3-214c-4266-846d-ce30ca0adeaa None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:10.418537 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:10.419940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cfcdc-7abc-4d13-9690-90ef553def48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.421470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cfcdc-7abc-4d13-9690-90ef553def48 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.421980 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cfcdc-7abc-4d13-9690-90ef553def48 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.422479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cfcdc-7abc-4d13-9690-90ef553def48 None admin] PATH_INFO: `/v3/projects/862e61b731f8486d95faeca2fa08d34b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.424627 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cfcdc-7abc-4d13-9690-90ef553def48 None admin] RBAC: Authorizing `identity:get_project(project_id=862e61b731f8486d95faeca2fa08d34b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.427365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cfcdc-7abc-4d13-9690-90ef553def48 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.430322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 531/1064] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:23:10 2022] GET /identity/v3/projects/862e61b731f8486d95faeca2fa08d34b => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:10.431089 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cfcdc-7abc-4d13-9690-90ef553def48 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:10.450803 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:10.472025 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8b386-05bd-412e-a621-6ea1b5d2e5cc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:10.506288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d133ac-5c17-44f3-abc4-9fc750e7652a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.506964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d133ac-5c17-44f3-abc4-9fc750e7652a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.507251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d133ac-5c17-44f3-abc4-9fc750e7652a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.507532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d133ac-5c17-44f3-abc4-9fc750e7652a None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.508261 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d133ac-5c17-44f3-abc4-9fc750e7652a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:10.508569 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d133ac-5c17-44f3-abc4-9fc750e7652a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.509979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d133ac-5c17-44f3-abc4-9fc750e7652a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.521833 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 534/1065] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:10.522459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d133ac-5c17-44f3-abc4-9fc750e7652a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:10.536204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cfcdc-7abc-4d13-9690-90ef553def48 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:10.578684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91613951-73b1-44b6-bb48-20509c124d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.579541 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91613951-73b1-44b6-bb48-20509c124d37 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.579823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91613951-73b1-44b6-bb48-20509c124d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.580109 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91613951-73b1-44b6-bb48-20509c124d37 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.592778 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91613951-73b1-44b6-bb48-20509c124d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:10.601913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-91613951-73b1-44b6-bb48-20509c124d37 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:10.601913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:10.601913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:10.601913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:10.601913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:10.601913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:10.601913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:10.601913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:10.601913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:10.601913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:10.601913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:10.601913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:10.601913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:10.601913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:10.601913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:10.601913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:10.602968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:10.602968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:10.602968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:10.602968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:10.602968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:10.602968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:10.602968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:10.602968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:10.602968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:10.602968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:10.602968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:10.602968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:10.602968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:10.602968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:10.602968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:10.602968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:10.603863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:10.603863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:10.603863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:10.603863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:10.603863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:10.603863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:10.603863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:10.603863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:10.603863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:10.603863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:10.603863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:10.603863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:23:10.608730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 532/1066] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Jun 15 00:23:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:10.609560 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91613951-73b1-44b6-bb48-20509c124d37 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:10.633662 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d133ac-5c17-44f3-abc4-9fc750e7652a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:10.643670 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:10.671034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b9ce0-0e01-4131-9b4c-600a96c3e2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.672097 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b9ce0-0e01-4131-9b4c-600a96c3e2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.672380 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b9ce0-0e01-4131-9b4c-600a96c3e2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.672815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b9ce0-0e01-4131-9b4c-600a96c3e2e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.673700 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b9ce0-0e01-4131-9b4c-600a96c3e2e1 None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=862e61b731f8486d95faeca2fa08d34b, user.id=10ac2ca182fb4c068eb359f9f2a17a38) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:10.674022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b9ce0-0e01-4131-9b4c-600a96c3e2e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.675480 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b9ce0-0e01-4131-9b4c-600a96c3e2e1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.681476 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 535/1067] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:10 2022] GET /identity/v3/role_assignments?user.id=10ac2ca182fb4c068eb359f9f2a17a38&scope.project.id=862e61b731f8486d95faeca2fa08d34b&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:10.698785 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:10.731070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91613951-73b1-44b6-bb48-20509c124d37 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:10.769894 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e38a2b-e193-46f8-b905-0d99e076c4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.770596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e38a2b-e193-46f8-b905-0d99e076c4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.770882 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e38a2b-e193-46f8-b905-0d99e076c4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.771224 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e38a2b-e193-46f8-b905-0d99e076c4d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.772000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e38a2b-e193-46f8-b905-0d99e076c4d9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:10.772310 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e38a2b-e193-46f8-b905-0d99e076c4d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.773967 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e38a2b-e193-46f8-b905-0d99e076c4d9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.784396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 533/1068] 10.222.0.36 () {56 vars in 1115 bytes} [Wed Jun 15 00:23:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:10.790662 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b9ce0-0e01-4131-9b4c-600a96c3e2e1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:10.900314 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b9ce0-0e01-4131-9b4c-600a96c3e2e1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:10.935457 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da723e-7b24-407e-b5d4-b8a82a1cce4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:10.936186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da723e-7b24-407e-b5d4-b8a82a1cce4e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:10.936470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da723e-7b24-407e-b5d4-b8a82a1cce4e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:10.936742 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da723e-7b24-407e-b5d4-b8a82a1cce4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:10.947346 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da723e-7b24-407e-b5d4-b8a82a1cce4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:10.948797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da723e-7b24-407e-b5d4-b8a82a1cce4e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:10.966340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-60da723e-7b24-407e-b5d4-b8a82a1cce4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:10.966340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:10.966340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:10.966340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:10.966340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:10.966340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:10.966340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:10.966340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:10.966340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:10.966340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:10.966340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:10.966340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:10.966340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:10.966340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:10.966340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:10.967304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:10.968233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:10.968233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:10.968233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:10.968233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:10.969526 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 536/1069] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:10.973379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e38a2b-e193-46f8-b905-0d99e076c4d9 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:11.077044 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e38a2b-e193-46f8-b905-0d99e076c4d9 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:11.111382 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30a562-e880-45d3-b29c-47a441be0374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:11.112061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30a562-e880-45d3-b29c-47a441be0374 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.112342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30a562-e880-45d3-b29c-47a441be0374 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.112610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30a562-e880-45d3-b29c-47a441be0374 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.113324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30a562-e880-45d3-b29c-47a441be0374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:11.113668 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30a562-e880-45d3-b29c-47a441be0374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:11.115388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc30a562-e880-45d3-b29c-47a441be0374 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:11.122370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:11.128404 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 534/1070] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:11.133700 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da723e-7b24-407e-b5d4-b8a82a1cce4e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:11.159004 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:11.233180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da723e-7b24-407e-b5d4-b8a82a1cce4e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:11.268232 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20fda4-a29f-4eff-80ea-a1ce9cdb4b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:11.269029 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20fda4-a29f-4eff-80ea-a1ce9cdb4b88 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.269314 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20fda4-a29f-4eff-80ea-a1ce9cdb4b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.269660 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20fda4-a29f-4eff-80ea-a1ce9cdb4b88 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.276634 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20fda4-a29f-4eff-80ea-a1ce9cdb4b88 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:11.278110 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20fda4-a29f-4eff-80ea-a1ce9cdb4b88 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:11.292836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-3a20fda4-a29f-4eff-80ea-a1ce9cdb4b88 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:11.292836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:11.292836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:11.292836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:11.292836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:11.292836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:11.292836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:11.292836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:11.292836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:11.292836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:11.292836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:11.292836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:11.292836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:11.292836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:11.292836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:11.292836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:11.293889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:11.295237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:11.295237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:11.295237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:11.295237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:11.295237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:11.295237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:11.295237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:11.295237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:11.295237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:11.295237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:11.295237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 537/1071] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 15 00:23:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:11.299921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30a562-e880-45d3-b29c-47a441be0374 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:11.405600 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc30a562-e880-45d3-b29c-47a441be0374 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:11.442601 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef48097-03d3-48f0-bf27-f91b5c99c69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:11.443314 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef48097-03d3-48f0-bf27-f91b5c99c69b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.443603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef48097-03d3-48f0-bf27-f91b5c99c69b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.443842 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef48097-03d3-48f0-bf27-f91b5c99c69b None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.444715 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef48097-03d3-48f0-bf27-f91b5c99c69b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:11.445020 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef48097-03d3-48f0-bf27-f91b5c99c69b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:11.446491 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef48097-03d3-48f0-bf27-f91b5c99c69b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:11.464050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 535/1072] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 15 00:23:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:11.469980 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20fda4-a29f-4eff-80ea-a1ce9cdb4b88 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:11.553915 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:11.571623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20fda4-a29f-4eff-80ea-a1ce9cdb4b88 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:11.606839 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4c2ec-8aab-4811-a27a-7ddf76968df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:11.607651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4c2ec-8aab-4811-a27a-7ddf76968df3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.607936 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4c2ec-8aab-4811-a27a-7ddf76968df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.608216 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4c2ec-8aab-4811-a27a-7ddf76968df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.618608 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4c2ec-8aab-4811-a27a-7ddf76968df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:11.620057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e4c2ec-8aab-4811-a27a-7ddf76968df3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:11.637270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-78e4c2ec-8aab-4811-a27a-7ddf76968df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:11.637270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:11.637270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:11.637270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:11.637270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:11.637270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:11.637270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:11.637270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:11.637270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:11.637270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:11.637270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:11.637270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:11.637270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:11.637270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:11.637270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:11.638287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:11.639219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:11.639219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:11.639219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:11.639219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:11.639219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 538/1073] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:11.644483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef48097-03d3-48f0-bf27-f91b5c99c69b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:11.701516 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:11.748954 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef48097-03d3-48f0-bf27-f91b5c99c69b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:11.785270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01a97f-40dd-48f0-9809-1caee32e253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:11.785973 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01a97f-40dd-48f0-9809-1caee32e253b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.786252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01a97f-40dd-48f0-9809-1caee32e253b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.786551 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01a97f-40dd-48f0-9809-1caee32e253b None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.787337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01a97f-40dd-48f0-9809-1caee32e253b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:11.787793 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01a97f-40dd-48f0-9809-1caee32e253b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:11.789082 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01a97f-40dd-48f0-9809-1caee32e253b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:11.800393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 536/1074] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:11.806210 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4c2ec-8aab-4811-a27a-7ddf76968df3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:11.909121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4c2ec-8aab-4811-a27a-7ddf76968df3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:11.948013 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c7430-5277-4056-b6b2-43f8da5b0655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:11.948818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c7430-5277-4056-b6b2-43f8da5b0655 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:11.949097 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c7430-5277-4056-b6b2-43f8da5b0655 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:11.949475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c7430-5277-4056-b6b2-43f8da5b0655 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:11.952304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:11.957651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c7430-5277-4056-b6b2-43f8da5b0655 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:11.959295 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c7430-5277-4056-b6b2-43f8da5b0655 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:11.973312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-434c7430-5277-4056-b6b2-43f8da5b0655 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:11.973312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:11.973312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:11.973312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:11.973312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:11.973312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:11.973312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:11.973312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:11.973312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:11.973312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:11.973312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:11.973312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:11.973312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:11.973312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:11.973312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:11.974511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:11.975454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:11.975454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:11.975454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:11.975454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:11.975454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:11.975454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:11.975454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:11.975454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:11.977684 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 539/1075] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:11.980509 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01a97f-40dd-48f0-9809-1caee32e253b None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:12.087611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01a97f-40dd-48f0-9809-1caee32e253b None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:12.103364 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:12.122291 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97968969-89c0-4865-9b2c-77964c173f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:12.122957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97968969-89c0-4865-9b2c-77964c173f72 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:12.123242 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97968969-89c0-4865-9b2c-77964c173f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:12.123521 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97968969-89c0-4865-9b2c-77964c173f72 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:12.124313 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97968969-89c0-4865-9b2c-77964c173f72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:12.124625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97968969-89c0-4865-9b2c-77964c173f72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:12.126105 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97968969-89c0-4865-9b2c-77964c173f72 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:12.138806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 537/1076] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:12.145057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c7430-5277-4056-b6b2-43f8da5b0655 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:12.249578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c7430-5277-4056-b6b2-43f8da5b0655 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:12.287816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c63237-1b29-4b13-a4ed-84ca60483987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:12.288724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c63237-1b29-4b13-a4ed-84ca60483987 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:12.289006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c63237-1b29-4b13-a4ed-84ca60483987 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:12.289277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c63237-1b29-4b13-a4ed-84ca60483987 None admin] PATH_INFO: `/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/6d0ae1707c7041a0989889dbefeaf267/roles/6e721ce489704e1fbef73a459c754865` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:12.291653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c63237-1b29-4b13-a4ed-84ca60483987 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc0f2a3e075946f1ad06146dfa252aa6, user_id=6d0ae1707c7041a0989889dbefeaf267, role_id=6e721ce489704e1fbef73a459c754865)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:12.293100 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c63237-1b29-4b13-a4ed-84ca60483987 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:12.308599 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 540/1077] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:23:12 2022] PUT /identity/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/6d0ae1707c7041a0989889dbefeaf267/roles/6e721ce489704e1fbef73a459c754865 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:23:12.778102 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329fde4-73fb-4ff4-9bf8-8f21a271e14b None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:12.778691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329fde4-73fb-4ff4-9bf8-8f21a271e14b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:12.778691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329fde4-73fb-4ff4-9bf8-8f21a271e14b None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:12.780076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 538/1078] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:12.785571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f36ca-8ed8-476b-bb22-a53372ec5537 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:12.785962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f36ca-8ed8-476b-bb22-a53372ec5537 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:12.786165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f36ca-8ed8-476b-bb22-a53372ec5537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:12.803975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b36f36ca-8ed8-476b-bb22-a53372ec5537 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:12.805159 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b36f36ca-8ed8-476b-bb22-a53372ec5537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:12.857547 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:12.876610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 541/1079] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:12.899800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329fde4-73fb-4ff4-9bf8-8f21a271e14b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:13.007269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329fde4-73fb-4ff4-9bf8-8f21a271e14b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:13.044093 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35845210-c624-4c31-b79d-1b80f86a2e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:13.044817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35845210-c624-4c31-b79d-1b80f86a2e7e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:13.045106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35845210-c624-4c31-b79d-1b80f86a2e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:13.045390 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35845210-c624-4c31-b79d-1b80f86a2e7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:13.055777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35845210-c624-4c31-b79d-1b80f86a2e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:13.064799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-35845210-c624-4c31-b79d-1b80f86a2e7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:13.064799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:13.064799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:13.064799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:13.064799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:13.064799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:13.064799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:13.064799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:13.064799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:13.064799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:13.064799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:13.064799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:13.064799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:13.064799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:13.064799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:13.064799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:13.065872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:13.065872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:13.065872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:13.065872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:13.065872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:13.065872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:13.065872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:13.065872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:13.065872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:13.065872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:13.065872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:13.065872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:13.065872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:13.065872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:13.065872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:13.065872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:13.066733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:13.066733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:13.066733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:13.066733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:13.066733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:13.066733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:13.066733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:13.066733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:13.066733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:13.066733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:13.066733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:13.066733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:23:13.066733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 539/1080] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:13.071693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f36ca-8ed8-476b-bb22-a53372ec5537 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:13.181923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f36ca-8ed8-476b-bb22-a53372ec5537 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:13.219263 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111167b0-6e1c-4e8e-afc5-679b4028c597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:13.219968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111167b0-6e1c-4e8e-afc5-679b4028c597 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:13.220192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111167b0-6e1c-4e8e-afc5-679b4028c597 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:13.220493 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111167b0-6e1c-4e8e-afc5-679b4028c597 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:13.221248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111167b0-6e1c-4e8e-afc5-679b4028c597 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:13.221587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111167b0-6e1c-4e8e-afc5-679b4028c597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:13.222968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111167b0-6e1c-4e8e-afc5-679b4028c597 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:13.231365 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 542/1081] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:13.237733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35845210-c624-4c31-b79d-1b80f86a2e7e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:13.274678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:13.346690 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35845210-c624-4c31-b79d-1b80f86a2e7e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:13.383038 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b991f-3ee2-41e7-8ad3-2f6a88cff8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:13.383940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b991f-3ee2-41e7-8ad3-2f6a88cff8fd None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:13.384221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b991f-3ee2-41e7-8ad3-2f6a88cff8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:13.384492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b991f-3ee2-41e7-8ad3-2f6a88cff8fd None admin] PATH_INFO: `/v3/users/10ac2ca182fb4c068eb359f9f2a17a38` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:13.385896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b991f-3ee2-41e7-8ad3-2f6a88cff8fd None admin] RBAC: Authorizing `identity:get_user(user_id=10ac2ca182fb4c068eb359f9f2a17a38)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:13.387376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b991f-3ee2-41e7-8ad3-2f6a88cff8fd None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:13.389326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 540/1082] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:23:13 2022] GET /identity/v3/users/10ac2ca182fb4c068eb359f9f2a17a38 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:13.395757 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111167b0-6e1c-4e8e-afc5-679b4028c597 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:13.450004 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:13.504573 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111167b0-6e1c-4e8e-afc5-679b4028c597 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:13.545356 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22982392-28c7-4b4e-848f-1a5f3b802291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:13.546289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22982392-28c7-4b4e-848f-1a5f3b802291 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:13.546715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22982392-28c7-4b4e-848f-1a5f3b802291 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:13.547203 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22982392-28c7-4b4e-848f-1a5f3b802291 None admin] PATH_INFO: `/v3/projects/862e61b731f8486d95faeca2fa08d34b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:13.548860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22982392-28c7-4b4e-848f-1a5f3b802291 None admin] RBAC: Authorizing `identity:get_project(project_id=862e61b731f8486d95faeca2fa08d34b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:13.550472 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22982392-28c7-4b4e-848f-1a5f3b802291 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:13.552354 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 543/1083] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:23:13 2022] GET /identity/v3/projects/862e61b731f8486d95faeca2fa08d34b => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:13.561495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b991f-3ee2-41e7-8ad3-2f6a88cff8fd None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:13.673439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b991f-3ee2-41e7-8ad3-2f6a88cff8fd None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:13.675728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:13.708687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62e142-295e-4938-b281-ae13b011b397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:13.709614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62e142-295e-4938-b281-ae13b011b397 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:13.709899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62e142-295e-4938-b281-ae13b011b397 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:13.710174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62e142-295e-4938-b281-ae13b011b397 None admin] PATH_INFO: `/v3/projects/862e61b731f8486d95faeca2fa08d34b/users/10ac2ca182fb4c068eb359f9f2a17a38/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:13.712263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62e142-295e-4938-b281-ae13b011b397 None admin] RBAC: Authorizing `identity:create_grant(project_id=862e61b731f8486d95faeca2fa08d34b, user_id=10ac2ca182fb4c068eb359f9f2a17a38, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:13.713750 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62e142-295e-4938-b281-ae13b011b397 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:13.728597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 541/1084] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:23:13 2022] PUT /identity/v3/projects/862e61b731f8486d95faeca2fa08d34b/users/10ac2ca182fb4c068eb359f9f2a17a38/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:23:14.451186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32797fc-b152-4d1e-94ec-192e499a0a4d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:14.451728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32797fc-b152-4d1e-94ec-192e499a0a4d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:14.451728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32797fc-b152-4d1e-94ec-192e499a0a4d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:14.453122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 544/1085] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:14.458445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6256-65b3-4459-b9a6-9487b9571a80 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:14.458972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6256-65b3-4459-b9a6-9487b9571a80 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:14.458972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e6256-65b3-4459-b9a6-9487b9571a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:14.476451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-663e6256-65b3-4459-b9a6-9487b9571a80 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:14.477661 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-663e6256-65b3-4459-b9a6-9487b9571a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:14.546878 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 542/1086] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:14.570025 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32797fc-b152-4d1e-94ec-192e499a0a4d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:14.674306 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32797fc-b152-4d1e-94ec-192e499a0a4d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:14.690191 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:14.709292 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f8ae0-bf7e-4ec4-9da4-7421b4a39fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:14.710089 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f8ae0-bf7e-4ec4-9da4-7421b4a39fab None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:14.710372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f8ae0-bf7e-4ec4-9da4-7421b4a39fab None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:14.710655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f8ae0-bf7e-4ec4-9da4-7421b4a39fab None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:14.721258 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f8ae0-bf7e-4ec4-9da4-7421b4a39fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:14.729714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-ab2f8ae0-bf7e-4ec4-9da4-7421b4a39fab None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:14.729714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:14.729714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:14.729714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:14.729714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:14.729714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:14.729714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:14.729714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:14.729714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:14.729714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:14.729714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:14.729714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:14.729714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:14.729714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:14.729714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:14.729714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:14.730863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:14.730863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:14.730863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:14.730863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:14.730863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:14.730863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:14.730863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:14.730863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:14.730863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:14.730863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:14.730863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:14.730863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:14.730863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:14.730863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:14.730863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:14.730863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:14.731762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:14.731762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:14.731762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:14.731762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:14.731762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:14.731762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:14.731762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:14.731762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:14.731762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:14.731762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:14.731762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 15 00:23:14.731762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:14.731762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 545/1087] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Jun 15 00:23:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:14.737103 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e6256-65b3-4459-b9a6-9487b9571a80 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:14.831238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:14.839084 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e6256-65b3-4459-b9a6-9487b9571a80 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:14.872271 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29876c1-3590-4361-a8db-95b83a7d0033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:14.872947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29876c1-3590-4361-a8db-95b83a7d0033 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:14.873231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29876c1-3590-4361-a8db-95b83a7d0033 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:14.873537 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29876c1-3590-4361-a8db-95b83a7d0033 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:14.874293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29876c1-3590-4361-a8db-95b83a7d0033 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:14.874600 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29876c1-3590-4361-a8db-95b83a7d0033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:14.875974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29876c1-3590-4361-a8db-95b83a7d0033 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:14.888761 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 543/1088] 10.222.0.36 () {56 vars in 1115 bytes} [Wed Jun 15 00:23:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:14.890115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f8ae0-bf7e-4ec4-9da4-7421b4a39fab None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:14.994369 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f8ae0-bf7e-4ec4-9da4-7421b4a39fab None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:15.028953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e16e1-58ff-434a-b5b1-103328ac778f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:15.029779 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e16e1-58ff-434a-b5b1-103328ac778f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.030064 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e16e1-58ff-434a-b5b1-103328ac778f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.030339 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e16e1-58ff-434a-b5b1-103328ac778f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.040613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e16e1-58ff-434a-b5b1-103328ac778f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:15.042081 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e16e1-58ff-434a-b5b1-103328ac778f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:15.060555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-031e16e1-58ff-434a-b5b1-103328ac778f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:15.060555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:15.060555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:15.060555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:15.060555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:15.060555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:15.060555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:15.060555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:15.060555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:15.060555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:15.060555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:15.060555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:15.060555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:15.060555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:15.060555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:15.061512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:15.062520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:15.062520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:15.062520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:15.062520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:15.069551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 546/1089] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:15.071130 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29876c1-3590-4361-a8db-95b83a7d0033 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:15.176416 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29876c1-3590-4361-a8db-95b83a7d0033 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:15.210524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58ff62-33e9-45fa-8ca5-7016d9588dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:15.211197 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58ff62-33e9-45fa-8ca5-7016d9588dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.211483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58ff62-33e9-45fa-8ca5-7016d9588dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.211757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58ff62-33e9-45fa-8ca5-7016d9588dd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.212480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58ff62-33e9-45fa-8ca5-7016d9588dd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:15.212788 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58ff62-33e9-45fa-8ca5-7016d9588dd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:15.214177 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58ff62-33e9-45fa-8ca5-7016d9588dd5 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:15.226407 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 544/1090] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:15.232055 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e16e1-58ff-434a-b5b1-103328ac778f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:15.261502 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:15.334167 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e16e1-58ff-434a-b5b1-103328ac778f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:15.370695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93250f1e-7281-485d-8738-feda0e2be397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:15.371507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93250f1e-7281-485d-8738-feda0e2be397 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.371789 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93250f1e-7281-485d-8738-feda0e2be397 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.372067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93250f1e-7281-485d-8738-feda0e2be397 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.379537 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93250f1e-7281-485d-8738-feda0e2be397 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:15.381013 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93250f1e-7281-485d-8738-feda0e2be397 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:15.395412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-93250f1e-7281-485d-8738-feda0e2be397 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:15.395412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:15.395412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:15.395412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:15.395412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:15.395412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:15.395412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:15.395412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:15.395412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:15.395412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:15.395412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:15.395412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:15.395412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:23:15.395412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:23:15.395412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:23:15.395412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:15.396506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:15.397532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:15.397532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:15.397532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:23:15.397532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:23:15.397532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:23:15.397532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:23:15.397532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:23:15.397532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:23:15.397532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 15 00:23:15.397532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:15.397532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 547/1091] 10.222.0.36 () {56 vars in 1093 bytes} [Wed Jun 15 00:23:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:15.402724 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58ff62-33e9-45fa-8ca5-7016d9588dd5 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:15.422472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:15.508193 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58ff62-33e9-45fa-8ca5-7016d9588dd5 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:15.543156 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da85d1-d635-4dcf-86bc-5f3da3e53ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:15.543760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da85d1-d635-4dcf-86bc-5f3da3e53ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.544046 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da85d1-d635-4dcf-86bc-5f3da3e53ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.544324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da85d1-d635-4dcf-86bc-5f3da3e53ad7 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.545162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da85d1-d635-4dcf-86bc-5f3da3e53ad7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:15.545498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da85d1-d635-4dcf-86bc-5f3da3e53ad7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:15.546945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da85d1-d635-4dcf-86bc-5f3da3e53ad7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:15.564116 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 545/1092] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Jun 15 00:23:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:15.569995 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93250f1e-7281-485d-8738-feda0e2be397 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:15.658052 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:15.672245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93250f1e-7281-485d-8738-feda0e2be397 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:15.707411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537d4ca-dbbd-4b4e-90c1-4761ba9c2374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:15.708061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537d4ca-dbbd-4b4e-90c1-4761ba9c2374 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.708349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537d4ca-dbbd-4b4e-90c1-4761ba9c2374 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.708623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537d4ca-dbbd-4b4e-90c1-4761ba9c2374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.779411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537d4ca-dbbd-4b4e-90c1-4761ba9c2374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:15.780926 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537d4ca-dbbd-4b4e-90c1-4761ba9c2374 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:15.832988 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44968e-d219-4b3f-8e66-9608373b67d1 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.833388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44968e-d219-4b3f-8e66-9608373b67d1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.833678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44968e-d219-4b3f-8e66-9608373b67d1 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.835080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 546/1093] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:15.840163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caba73-f0de-4c9a-961c-b46758441d24 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:15.840449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caba73-f0de-4c9a-961c-b46758441d24 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:15.840736 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9caba73-f0de-4c9a-961c-b46758441d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:15.857525 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b9caba73-f0de-4c9a-961c-b46758441d24 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:15.858725 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b9caba73-f0de-4c9a-961c-b46758441d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:15.873424 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:15.886592 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 548/1094] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:23:15.892317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537d4ca-dbbd-4b4e-90c1-4761ba9c2374 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:15.926490 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 547/1095] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:15.949527 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caba73-f0de-4c9a-961c-b46758441d24 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:15.952475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:15.987871 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537d4ca-dbbd-4b4e-90c1-4761ba9c2374 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.022204 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10988da0-3a0b-4538-87d3-d80292efe56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.023010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10988da0-3a0b-4538-87d3-d80292efe56f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.023319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10988da0-3a0b-4538-87d3-d80292efe56f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.023592 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10988da0-3a0b-4538-87d3-d80292efe56f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.034368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10988da0-3a0b-4538-87d3-d80292efe56f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.035863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10988da0-3a0b-4538-87d3-d80292efe56f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.049657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9caba73-f0de-4c9a-961c-b46758441d24 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.053121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-10988da0-3a0b-4538-87d3-d80292efe56f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:16.053121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:16.053121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:16.053121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:16.053121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:16.053121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:16.053121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:16.053121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:16.053121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:16.053121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:16.053121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:16.053121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:16.053121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:16.053121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:16.053121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:16.054215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:16.055165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:23:16.055165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:16.055165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:23:16.055165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:16.055165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 549/1096] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:16.060158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10988da0-3a0b-4538-87d3-d80292efe56f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:16.092515 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83341b0-dac8-4d0f-86a0-c6b17284b3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.093296 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83341b0-dac8-4d0f-86a0-c6b17284b3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.093617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83341b0-dac8-4d0f-86a0-c6b17284b3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.093900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83341b0-dac8-4d0f-86a0-c6b17284b3e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.102194 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:16.104179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83341b0-dac8-4d0f-86a0-c6b17284b3e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:16.112018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-d83341b0-dac8-4d0f-86a0-c6b17284b3e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:16.112018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:16.112018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:16.112018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:16.112018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:16.112018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:16.112018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:16.112018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:16.112018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:16.112018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:16.112018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:16.112018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:16.112018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:16.112018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:16.112018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:16.112018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:16.113159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:16.113159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:16.113159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:16.113159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:16.113159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:16.113159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:16.113159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:16.113159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:16.113159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:16.113159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:16.113159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:16.113159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:16.113159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:16.113159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:16.113159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:16.113159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:16.114974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:16.114974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:16.114974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:16.114974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:16.114974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:16.114974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:16.114974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:16.114974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:16.114974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:16.114974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:16.114974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:16.114974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:23:16.114974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 548/1097] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:16.119625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83341b0-dac8-4d0f-86a0-c6b17284b3e0 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:16.160837 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10988da0-3a0b-4538-87d3-d80292efe56f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.181159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:16.195217 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdb865-518b-4439-8b75-c13efbee81c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.195890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdb865-518b-4439-8b75-c13efbee81c8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.196177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdb865-518b-4439-8b75-c13efbee81c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.196457 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdb865-518b-4439-8b75-c13efbee81c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.197188 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdb865-518b-4439-8b75-c13efbee81c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:16.197540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdb865-518b-4439-8b75-c13efbee81c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.198916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdb865-518b-4439-8b75-c13efbee81c8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.210953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 550/1098] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:16.216514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdb865-518b-4439-8b75-c13efbee81c8 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:16.223068 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83341b0-dac8-4d0f-86a0-c6b17284b3e0 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.256898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6bccc-afee-4d2b-9103-d240c277cc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.257597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6bccc-afee-4d2b-9103-d240c277cc5d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.257868 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6bccc-afee-4d2b-9103-d240c277cc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.258139 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6bccc-afee-4d2b-9103-d240c277cc5d None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.258892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6bccc-afee-4d2b-9103-d240c277cc5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:16.259214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6bccc-afee-4d2b-9103-d240c277cc5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.260577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6bccc-afee-4d2b-9103-d240c277cc5d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.269162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 549/1099] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:16.275190 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6bccc-afee-4d2b-9103-d240c277cc5d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:16.312917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:16.316181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdb865-518b-4439-8b75-c13efbee81c8 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.349842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccafe8-bcfa-4006-a600-dd5e2aed8e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.350570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccafe8-bcfa-4006-a600-dd5e2aed8e66 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.350854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccafe8-bcfa-4006-a600-dd5e2aed8e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.351128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ccafe8-bcfa-4006-a600-dd5e2aed8e66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.358620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccafe8-bcfa-4006-a600-dd5e2aed8e66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.360065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ccafe8-bcfa-4006-a600-dd5e2aed8e66 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.374831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-40ccafe8-bcfa-4006-a600-dd5e2aed8e66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:16.374831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:16.374831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:16.374831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:16.374831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:16.374831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:16.374831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:16.374831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:16.374831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:16.374831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:16.374831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:16.374831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:16.374831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:23:16.374831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:23:16.374831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:16.375940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:16.376857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:23:16.376857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:23:16.376857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:16.376857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:16.376857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:16.376857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:16.376857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:23:16.376857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:16.376857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 551/1100] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:23:16.377713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6bccc-afee-4d2b-9103-d240c277cc5d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.381926 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccafe8-bcfa-4006-a600-dd5e2aed8e66 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:16.406033 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:16.416277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df65427-3b1a-4156-ab2d-034c12e2f68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.417185 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df65427-3b1a-4156-ab2d-034c12e2f68c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.417535 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df65427-3b1a-4156-ab2d-034c12e2f68c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.417801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df65427-3b1a-4156-ab2d-034c12e2f68c None admin] PATH_INFO: `/v3/users/10ac2ca182fb4c068eb359f9f2a17a38` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.419031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df65427-3b1a-4156-ab2d-034c12e2f68c None admin] RBAC: Authorizing `identity:get_user(user_id=10ac2ca182fb4c068eb359f9f2a17a38)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.420478 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df65427-3b1a-4156-ab2d-034c12e2f68c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.422205 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 550/1101] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/users/10ac2ca182fb4c068eb359f9f2a17a38 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:16.427886 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df65427-3b1a-4156-ab2d-034c12e2f68c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:16.483155 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ccafe8-bcfa-4006-a600-dd5e2aed8e66 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.518652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3ef5b-6667-461c-a9af-a76e5aa52844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.519321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3ef5b-6667-461c-a9af-a76e5aa52844 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.519616 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3ef5b-6667-461c-a9af-a76e5aa52844 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.519897 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3ef5b-6667-461c-a9af-a76e5aa52844 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.520716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3ef5b-6667-461c-a9af-a76e5aa52844 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:16.521028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3ef5b-6667-461c-a9af-a76e5aa52844 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.522526 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3ef5b-6667-461c-a9af-a76e5aa52844 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.523806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df65427-3b1a-4156-ab2d-034c12e2f68c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.534326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 552/1102] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:16.540430 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3ef5b-6667-461c-a9af-a76e5aa52844 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:16.559264 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d83472-4bc3-4e09-80a7-085a3ff31199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.559920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d83472-4bc3-4e09-80a7-085a3ff31199 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.560208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d83472-4bc3-4e09-80a7-085a3ff31199 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.560489 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d83472-4bc3-4e09-80a7-085a3ff31199 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.562529 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:16.622332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:16.630012 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d83472-4bc3-4e09-80a7-085a3ff31199 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.631495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d83472-4bc3-4e09-80a7-085a3ff31199 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.640111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3ef5b-6667-461c-a9af-a76e5aa52844 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.677783 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301221b0-4c46-457a-a5bc-d5760d81df19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.678419 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301221b0-4c46-457a-a5bc-d5760d81df19 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.678700 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301221b0-4c46-457a-a5bc-d5760d81df19 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.678976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301221b0-4c46-457a-a5bc-d5760d81df19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.679812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301221b0-4c46-457a-a5bc-d5760d81df19 None admin] RBAC: Adding query filter params (role.id=6e721ce489704e1fbef73a459c754865, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=6d0ae1707c7041a0989889dbefeaf267) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:16.680125 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301221b0-4c46-457a-a5bc-d5760d81df19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.681574 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301221b0-4c46-457a-a5bc-d5760d81df19 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.687505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 553/1103] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/role_assignments?user.id=6d0ae1707c7041a0989889dbefeaf267&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=6e721ce489704e1fbef73a459c754865 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:23:16.733425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 551/1104] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 00:23:16.740017 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301221b0-4c46-457a-a5bc-d5760d81df19 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:16.832603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:16.851858 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301221b0-4c46-457a-a5bc-d5760d81df19 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:16.889888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53ef12-7cc5-49f7-940e-ad05280bd4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:16.890698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53ef12-7cc5-49f7-940e-ad05280bd4df None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:16.890982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53ef12-7cc5-49f7-940e-ad05280bd4df None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:16.891246 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53ef12-7cc5-49f7-940e-ad05280bd4df None admin] PATH_INFO: `/v3/projects/862e61b731f8486d95faeca2fa08d34b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:16.892468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53ef12-7cc5-49f7-940e-ad05280bd4df None admin] RBAC: Authorizing `identity:get_project(project_id=862e61b731f8486d95faeca2fa08d34b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:16.893976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53ef12-7cc5-49f7-940e-ad05280bd4df None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:16.895757 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 554/1105] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/projects/862e61b731f8486d95faeca2fa08d34b => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:16.902282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d83472-4bc3-4e09-80a7-085a3ff31199 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:17.000149 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:17.007247 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d83472-4bc3-4e09-80a7-085a3ff31199 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:17.043222 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a058d-7c82-42a1-b205-64f5d9e07850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:17.043901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a058d-7c82-42a1-b205-64f5d9e07850 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:17.044181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a058d-7c82-42a1-b205-64f5d9e07850 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:17.044457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a058d-7c82-42a1-b205-64f5d9e07850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:17.045337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a058d-7c82-42a1-b205-64f5d9e07850 None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=862e61b731f8486d95faeca2fa08d34b, user.id=10ac2ca182fb4c068eb359f9f2a17a38) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:17.045685 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a058d-7c82-42a1-b205-64f5d9e07850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:17.047129 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a058d-7c82-42a1-b205-64f5d9e07850 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:17.053468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 552/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:16 2022] GET /identity/v3/role_assignments?user.id=10ac2ca182fb4c068eb359f9f2a17a38&scope.project.id=862e61b731f8486d95faeca2fa08d34b&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:19.167302 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfd47f-6765-4512-955f-ddfa13dc5d19 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:19.167903 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfd47f-6765-4512-955f-ddfa13dc5d19 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:19.167903 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfd47f-6765-4512-955f-ddfa13dc5d19 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:19.170043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 555/1107] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:19.178345 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b880bf-ab70-4be0-925f-7763a29ed101 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:19.178740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b880bf-ab70-4be0-925f-7763a29ed101 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:19.178905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b880bf-ab70-4be0-925f-7763a29ed101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:19.197955 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-41b880bf-ab70-4be0-925f-7763a29ed101 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:19.199162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-41b880bf-ab70-4be0-925f-7763a29ed101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:19.275198 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 553/1108] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:19.300615 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfd47f-6765-4512-955f-ddfa13dc5d19 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:19.416559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfd47f-6765-4512-955f-ddfa13dc5d19 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:19.453902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490dda5-f4f2-4229-89f9-a8c3aa12d076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:19.454699 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490dda5-f4f2-4229-89f9-a8c3aa12d076 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:19.454977 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490dda5-f4f2-4229-89f9-a8c3aa12d076 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:19.455250 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490dda5-f4f2-4229-89f9-a8c3aa12d076 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:19.456439 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490dda5-f4f2-4229-89f9-a8c3aa12d076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:19.457912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c490dda5-f4f2-4229-89f9-a8c3aa12d076 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:19.459548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 556/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:19.468797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b880bf-ab70-4be0-925f-7763a29ed101 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:19.560794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:19.574277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b880bf-ab70-4be0-925f-7763a29ed101 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:19.609994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdd4ba-dce1-41b4-a515-be1dc8201576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:19.610671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdd4ba-dce1-41b4-a515-be1dc8201576 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:19.610957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdd4ba-dce1-41b4-a515-be1dc8201576 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:19.611230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdd4ba-dce1-41b4-a515-be1dc8201576 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:19.611944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdd4ba-dce1-41b4-a515-be1dc8201576 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:19.613394 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdd4ba-dce1-41b4-a515-be1dc8201576 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:19.638148 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 554/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:23:19 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:21.745194 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ec1ac-0854-4465-927f-34db334e9db8 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:21.745824 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ec1ac-0854-4465-927f-34db334e9db8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:21.745824 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ec1ac-0854-4465-927f-34db334e9db8 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:21.747165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 557/1111] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:21.753741 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dbc52-7487-476c-8a8a-b668f61ae12b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:21.754498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dbc52-7487-476c-8a8a-b668f61ae12b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:21.754635 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dbc52-7487-476c-8a8a-b668f61ae12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:21.773712 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-179dbc52-7487-476c-8a8a-b668f61ae12b None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:21.774895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-179dbc52-7487-476c-8a8a-b668f61ae12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:21.845695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 555/1112] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:21.876582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ec1ac-0854-4465-927f-34db334e9db8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:21.900112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:21.984382 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ec1ac-0854-4465-927f-34db334e9db8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:22.019729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946bd72-186f-487b-96ab-f14aaf65ea3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:22.020596 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946bd72-186f-487b-96ab-f14aaf65ea3d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:22.020877 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946bd72-186f-487b-96ab-f14aaf65ea3d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:22.021150 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946bd72-186f-487b-96ab-f14aaf65ea3d None admin] PATH_INFO: `/v3/roles/1be1544572744e849ed04df01cdca3fb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:22.022756 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946bd72-186f-487b-96ab-f14aaf65ea3d None admin] RBAC: Authorizing `identity:get_role(role_id=1be1544572744e849ed04df01cdca3fb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:22.024125 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946bd72-186f-487b-96ab-f14aaf65ea3d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:22.025523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 558/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:23:21 2022] GET /identity/v3/roles/1be1544572744e849ed04df01cdca3fb => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:22.031783 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dbc52-7487-476c-8a8a-b668f61ae12b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:22.111869 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:22.145630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dbc52-7487-476c-8a8a-b668f61ae12b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:22.184695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbd4c7-0fd0-41df-adca-10f0d52f4f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:22.185605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbd4c7-0fd0-41df-adca-10f0d52f4f38 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:22.185889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbd4c7-0fd0-41df-adca-10f0d52f4f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:22.186166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbd4c7-0fd0-41df-adca-10f0d52f4f38 None admin] PATH_INFO: `/v3/users/02dc68a146634946acb1337a9c52a8dc` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:22.199707 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbd4c7-0fd0-41df-adca-10f0d52f4f38 None admin] RBAC: Authorizing `identity:get_user(user_id=02dc68a146634946acb1337a9c52a8dc)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:22.201147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbd4c7-0fd0-41df-adca-10f0d52f4f38 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:22.202832 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 556/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:23:22 2022] GET /identity/v3/users/02dc68a146634946acb1337a9c52a8dc => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:22.209597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946bd72-186f-487b-96ab-f14aaf65ea3d None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:22.317838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:22.330832 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946bd72-186f-487b-96ab-f14aaf65ea3d None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:22.367292 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941485ef-af30-4723-84bf-0e22084125e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:22.367934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941485ef-af30-4723-84bf-0e22084125e1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:22.368222 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941485ef-af30-4723-84bf-0e22084125e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:22.368499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941485ef-af30-4723-84bf-0e22084125e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:22.440850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941485ef-af30-4723-84bf-0e22084125e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:22.442386 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941485ef-af30-4723-84bf-0e22084125e1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:22.531202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:22.551411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 559/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:23:22.558123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbd4c7-0fd0-41df-adca-10f0d52f4f38 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:22.682961 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbd4c7-0fd0-41df-adca-10f0d52f4f38 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:22.722850 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:22.730002 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dbef2-9251-4974-81c9-d943c4c23aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:22.730898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dbef2-9251-4974-81c9-d943c4c23aab None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:22.731188 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dbef2-9251-4974-81c9-d943c4c23aab None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:22.731468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dbef2-9251-4974-81c9-d943c4c23aab None admin] PATH_INFO: `/v3/projects/862e61b731f8486d95faeca2fa08d34b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:22.732745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64dbef2-9251-4974-81c9-d943c4c23aab None admin] RBAC: Authorizing `identity:get_project(project_id=862e61b731f8486d95faeca2fa08d34b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:22.734246 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64dbef2-9251-4974-81c9-d943c4c23aab None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:22.735970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 557/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:23:22 2022] GET /identity/v3/projects/862e61b731f8486d95faeca2fa08d34b => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:22.743114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941485ef-af30-4723-84bf-0e22084125e1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:22.849859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941485ef-af30-4723-84bf-0e22084125e1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:22.886127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e89e5-7c21-4950-b875-5db1b0e14e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:22.886777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e89e5-7c21-4950-b875-5db1b0e14e74 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:22.887068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e89e5-7c21-4950-b875-5db1b0e14e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:22.887342 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e89e5-7c21-4950-b875-5db1b0e14e74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:22.888184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e89e5-7c21-4950-b875-5db1b0e14e74 None admin] RBAC: Adding query filter params (role.id=1be1544572744e849ed04df01cdca3fb, scope.project.id=862e61b731f8486d95faeca2fa08d34b, user.id=02dc68a146634946acb1337a9c52a8dc) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:22.888500 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e89e5-7c21-4950-b875-5db1b0e14e74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:22.889973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e89e5-7c21-4950-b875-5db1b0e14e74 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:22.895688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 560/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:22 2022] GET /identity/v3/role_assignments?user.id=02dc68a146634946acb1337a9c52a8dc&scope.project.id=862e61b731f8486d95faeca2fa08d34b&role.id=1be1544572744e849ed04df01cdca3fb => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:24.966422 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9acd1-d40c-49eb-854d-00a01862e30e None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:24.967022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9acd1-d40c-49eb-854d-00a01862e30e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:24.967022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9acd1-d40c-49eb-854d-00a01862e30e None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:24.968382 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 558/1118] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:24.974892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0496c-a3e6-4b80-90da-6af8d836b0a2 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:24.975633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0496c-a3e6-4b80-90da-6af8d836b0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:24.975811 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0496c-a3e6-4b80-90da-6af8d836b0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:24.999544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-91d0496c-a3e6-4b80-90da-6af8d836b0a2 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:25.000724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-91d0496c-a3e6-4b80-90da-6af8d836b0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:25.060137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:25.083665 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 561/1119] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:25.106060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9acd1-d40c-49eb-854d-00a01862e30e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:25.219875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9acd1-d40c-49eb-854d-00a01862e30e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:25.256211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5ae43-16ae-433f-83b0-0baec13b7fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:25.257071 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5ae43-16ae-433f-83b0-0baec13b7fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:25.257386 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5ae43-16ae-433f-83b0-0baec13b7fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:25.257661 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5ae43-16ae-433f-83b0-0baec13b7fe8 None admin] PATH_INFO: `/v3/roles/1be1544572744e849ed04df01cdca3fb` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:25.259280 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5ae43-16ae-433f-83b0-0baec13b7fe8 None admin] RBAC: Authorizing `identity:get_role(role_id=1be1544572744e849ed04df01cdca3fb)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:25.260661 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5ae43-16ae-433f-83b0-0baec13b7fe8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:25.262075 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 559/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:23:25 2022] GET /identity/v3/roles/1be1544572744e849ed04df01cdca3fb => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:25.269072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0496c-a3e6-4b80-90da-6af8d836b0a2 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:25.377851 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0496c-a3e6-4b80-90da-6af8d836b0a2 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:25.413371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5005d31-9414-4b40-8969-e087357aaf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:25.414246 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5005d31-9414-4b40-8969-e087357aaf9f None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:25.414528 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5005d31-9414-4b40-8969-e087357aaf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:25.414802 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5005d31-9414-4b40-8969-e087357aaf9f None admin] PATH_INFO: `/v3/users/02dc68a146634946acb1337a9c52a8dc` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:25.416115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5005d31-9414-4b40-8969-e087357aaf9f None admin] RBAC: Authorizing `identity:get_user(user_id=02dc68a146634946acb1337a9c52a8dc)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:25.417587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5005d31-9414-4b40-8969-e087357aaf9f None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:25.419198 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 562/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:23:25 2022] GET /identity/v3/users/02dc68a146634946acb1337a9c52a8dc => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:25.425909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5ae43-16ae-433f-83b0-0baec13b7fe8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:25.511578 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:25.547348 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5ae43-16ae-433f-83b0-0baec13b7fe8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:25.582793 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b3dec-45bd-4467-b32c-f19d0d7bbdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:25.583720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b3dec-45bd-4467-b32c-f19d0d7bbdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:25.584005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b3dec-45bd-4467-b32c-f19d0d7bbdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:25.584286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b3dec-45bd-4467-b32c-f19d0d7bbdb9 None admin] PATH_INFO: `/v3/projects/862e61b731f8486d95faeca2fa08d34b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:25.585552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b3dec-45bd-4467-b32c-f19d0d7bbdb9 None admin] RBAC: Authorizing `identity:get_project(project_id=862e61b731f8486d95faeca2fa08d34b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:25.587012 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b3dec-45bd-4467-b32c-f19d0d7bbdb9 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:25.588718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 560/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:23:25 2022] GET /identity/v3/projects/862e61b731f8486d95faeca2fa08d34b => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:25.594970 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5005d31-9414-4b40-8969-e087357aaf9f None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:25.650095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:25.698094 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5005d31-9414-4b40-8969-e087357aaf9f None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:25.735997 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb8291-8e4c-4118-b6eb-66500f26f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:25.736893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb8291-8e4c-4118-b6eb-66500f26f43c None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:25.737175 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb8291-8e4c-4118-b6eb-66500f26f43c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:25.737474 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb8291-8e4c-4118-b6eb-66500f26f43c None admin] PATH_INFO: `/v3/projects/862e61b731f8486d95faeca2fa08d34b/users/02dc68a146634946acb1337a9c52a8dc/roles/1be1544572744e849ed04df01cdca3fb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:25.740411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb8291-8e4c-4118-b6eb-66500f26f43c None admin] RBAC: Authorizing `identity:create_grant(project_id=862e61b731f8486d95faeca2fa08d34b, user_id=02dc68a146634946acb1337a9c52a8dc, role_id=1be1544572744e849ed04df01cdca3fb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:25.741885 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb8291-8e4c-4118-b6eb-66500f26f43c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:25.761874 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 563/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:23:25 2022] PUT /identity/v3/projects/862e61b731f8486d95faeca2fa08d34b/users/02dc68a146634946acb1337a9c52a8dc/roles/1be1544572744e849ed04df01cdca3fb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:23:27.847862 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a5ab-75cc-4f6e-92b7-6e128aac8a9c None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:27.848775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a5ab-75cc-4f6e-92b7-6e128aac8a9c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:27.848775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88a5ab-75cc-4f6e-92b7-6e128aac8a9c None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:27.851019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 561/1124] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:27.857257 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a17985-6dc5-4c9b-b3fc-9dc6882990dc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:27.857743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a17985-6dc5-4c9b-b3fc-9dc6882990dc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:27.857862 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a17985-6dc5-4c9b-b3fc-9dc6882990dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:27.879059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e7a17985-6dc5-4c9b-b3fc-9dc6882990dc None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:27.880256 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e7a17985-6dc5-4c9b-b3fc-9dc6882990dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:27.953769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 564/1125] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:27.977484 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88a5ab-75cc-4f6e-92b7-6e128aac8a9c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:28.109683 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88a5ab-75cc-4f6e-92b7-6e128aac8a9c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:28.149678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb66e10-8944-490c-aa38-52979bd1b697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:28.150547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb66e10-8944-490c-aa38-52979bd1b697 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:28.150827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb66e10-8944-490c-aa38-52979bd1b697 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:28.151102 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb66e10-8944-490c-aa38-52979bd1b697 None admin] PATH_INFO: `/v3/roles/1be1544572744e849ed04df01cdca3fb` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:28.152686 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb66e10-8944-490c-aa38-52979bd1b697 None admin] RBAC: Authorizing `identity:get_role(role_id=1be1544572744e849ed04df01cdca3fb)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:28.154092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb66e10-8944-490c-aa38-52979bd1b697 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:28.155490 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 562/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:23:27 2022] GET /identity/v3/roles/1be1544572744e849ed04df01cdca3fb => generated 223 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:28.162097 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a17985-6dc5-4c9b-b3fc-9dc6882990dc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:28.202956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:28.261693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a17985-6dc5-4c9b-b3fc-9dc6882990dc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:28.296699 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b684271-cca1-4660-9891-2a3400568472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:28.297610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b684271-cca1-4660-9891-2a3400568472 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:28.297894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b684271-cca1-4660-9891-2a3400568472 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:28.298172 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b684271-cca1-4660-9891-2a3400568472 None admin] PATH_INFO: `/v3/users/02dc68a146634946acb1337a9c52a8dc` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:28.299407 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b684271-cca1-4660-9891-2a3400568472 None admin] RBAC: Authorizing `identity:get_user(user_id=02dc68a146634946acb1337a9c52a8dc)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:28.300885 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b684271-cca1-4660-9891-2a3400568472 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:28.302546 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 565/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:23:28 2022] GET /identity/v3/users/02dc68a146634946acb1337a9c52a8dc => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:28.308921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb66e10-8944-490c-aa38-52979bd1b697 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:28.313179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:28.409960 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb66e10-8944-490c-aa38-52979bd1b697 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:28.445084 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4ed43-650d-4574-9c44-6795dfde9125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:28.445750 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4ed43-650d-4574-9c44-6795dfde9125 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:28.446040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4ed43-650d-4574-9c44-6795dfde9125 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:28.446306 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4ed43-650d-4574-9c44-6795dfde9125 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:28.514272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4ed43-650d-4574-9c44-6795dfde9125 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:28.515710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4ed43-650d-4574-9c44-6795dfde9125 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:28.518289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:28.614946 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 563/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:23:28.621188 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b684271-cca1-4660-9891-2a3400568472 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:28.730377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b684271-cca1-4660-9891-2a3400568472 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:28.740048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:28.768246 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a55d6-063a-4ffc-bb5d-455ad39b9516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:28.769112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a55d6-063a-4ffc-bb5d-455ad39b9516 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:28.769388 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a55d6-063a-4ffc-bb5d-455ad39b9516 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:28.769697 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a55d6-063a-4ffc-bb5d-455ad39b9516 None admin] PATH_INFO: `/v3/projects/862e61b731f8486d95faeca2fa08d34b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:28.770939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a55d6-063a-4ffc-bb5d-455ad39b9516 None admin] RBAC: Authorizing `identity:get_project(project_id=862e61b731f8486d95faeca2fa08d34b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:28.772475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a55d6-063a-4ffc-bb5d-455ad39b9516 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:28.774204 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 566/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:23:28 2022] GET /identity/v3/projects/862e61b731f8486d95faeca2fa08d34b => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:28.780825 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4ed43-650d-4574-9c44-6795dfde9125 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:28.882061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4ed43-650d-4574-9c44-6795dfde9125 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:28.884564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:28.923540 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95364938-bfb6-458a-8096-99abf287b432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:28.924199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95364938-bfb6-458a-8096-99abf287b432 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:28.924483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95364938-bfb6-458a-8096-99abf287b432 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:28.924760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95364938-bfb6-458a-8096-99abf287b432 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:28.925649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95364938-bfb6-458a-8096-99abf287b432 None admin] RBAC: Adding query filter params (role.id=1be1544572744e849ed04df01cdca3fb, scope.project.id=862e61b731f8486d95faeca2fa08d34b, user.id=02dc68a146634946acb1337a9c52a8dc) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:28.925971 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95364938-bfb6-458a-8096-99abf287b432 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:28.927415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95364938-bfb6-458a-8096-99abf287b432 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:28.933285 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 564/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:28 2022] GET /identity/v3/role_assignments?user.id=02dc68a146634946acb1337a9c52a8dc&scope.project.id=862e61b731f8486d95faeca2fa08d34b&role.id=1be1544572744e849ed04df01cdca3fb => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:31.033879 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a7d36-a4ab-4f5d-920a-d0a14bd5a7bb None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:31.034752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a7d36-a4ab-4f5d-920a-d0a14bd5a7bb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:31.034752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a7d36-a4ab-4f5d-920a-d0a14bd5a7bb None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:31.036962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 567/1131] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:31.043218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16eb29-35cc-41b4-9acd-2bd1e5764281 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:31.043664 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16eb29-35cc-41b4-9acd-2bd1e5764281 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:31.043780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16eb29-35cc-41b4-9acd-2bd1e5764281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:31.064985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-3a16eb29-35cc-41b4-9acd-2bd1e5764281 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:31.066210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3a16eb29-35cc-41b4-9acd-2bd1e5764281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:31.143960 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 565/1132] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:31.175555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a7d36-a4ab-4f5d-920a-d0a14bd5a7bb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:31.293448 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a7d36-a4ab-4f5d-920a-d0a14bd5a7bb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:31.337971 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a474739-3aab-46e6-9fa3-1362f3eea43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:31.338774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a474739-3aab-46e6-9fa3-1362f3eea43c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:31.339056 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a474739-3aab-46e6-9fa3-1362f3eea43c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:31.339330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a474739-3aab-46e6-9fa3-1362f3eea43c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:31.340644 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a474739-3aab-46e6-9fa3-1362f3eea43c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:31.342120 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a474739-3aab-46e6-9fa3-1362f3eea43c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:31.343741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 568/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:31.350595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16eb29-35cc-41b4-9acd-2bd1e5764281 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:31.453253 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:31.458714 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16eb29-35cc-41b4-9acd-2bd1e5764281 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:31.502480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bed8d-725e-4ed6-b9b0-92477c0e1086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:31.503143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bed8d-725e-4ed6-b9b0-92477c0e1086 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:31.503421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bed8d-725e-4ed6-b9b0-92477c0e1086 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:31.503695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bed8d-725e-4ed6-b9b0-92477c0e1086 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:31.504400 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bed8d-725e-4ed6-b9b0-92477c0e1086 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:31.505959 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bed8d-725e-4ed6-b9b0-92477c0e1086 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:31.541738 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 566/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 15 00:23:31 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:33.638420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f862ccc-bc8b-4b13-92df-48a7c0b8dceb None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:33.638984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f862ccc-bc8b-4b13-92df-48a7c0b8dceb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:33.638984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f862ccc-bc8b-4b13-92df-48a7c0b8dceb None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:33.640349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 569/1135] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:33.646761 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e121e8-6a2a-4fd2-aeb8-ff0a80a9a142 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:33.647464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e121e8-6a2a-4fd2-aeb8-ff0a80a9a142 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:33.647662 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e121e8-6a2a-4fd2-aeb8-ff0a80a9a142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:33.671014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a9e121e8-6a2a-4fd2-aeb8-ff0a80a9a142 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:33.672209 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a9e121e8-6a2a-4fd2-aeb8-ff0a80a9a142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:33.750006 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 567/1136] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:33.775447 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f862ccc-bc8b-4b13-92df-48a7c0b8dceb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:33.827982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:33.884420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f862ccc-bc8b-4b13-92df-48a7c0b8dceb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:33.919267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ccc1a-2e77-4393-a6cd-f445351d79fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:33.919993 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ccc1a-2e77-4393-a6cd-f445351d79fb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:33.920272 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ccc1a-2e77-4393-a6cd-f445351d79fb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:33.920545 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ccc1a-2e77-4393-a6cd-f445351d79fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:33.921856 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ccc1a-2e77-4393-a6cd-f445351d79fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:33.923287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ccc1a-2e77-4393-a6cd-f445351d79fb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:33.924883 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 570/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:23:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:33.931518 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e121e8-6a2a-4fd2-aeb8-ff0a80a9a142 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:34.022475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:34.049802 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e121e8-6a2a-4fd2-aeb8-ff0a80a9a142 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:34.085223 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a666e3d-cb9d-4382-acad-37f26213821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:34.085943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a666e3d-cb9d-4382-acad-37f26213821f None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:34.086232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a666e3d-cb9d-4382-acad-37f26213821f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:34.086511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a666e3d-cb9d-4382-acad-37f26213821f None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:34.087226 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a666e3d-cb9d-4382-acad-37f26213821f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:34.088678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a666e3d-cb9d-4382-acad-37f26213821f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:34.111235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 568/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:23:33 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:36.243157 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a36a1a-f893-40f2-9c2a-1e1583f93a7e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.243753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a36a1a-f893-40f2-9c2a-1e1583f93a7e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.243753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a36a1a-f893-40f2-9c2a-1e1583f93a7e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.245109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 571/1139] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:36.251641 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68b505-6d36-45de-91a5-009550298c77 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.252406 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68b505-6d36-45de-91a5-009550298c77 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.252544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68b505-6d36-45de-91a5-009550298c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.277803 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ff68b505-6d36-45de-91a5-009550298c77 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:36.278982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ff68b505-6d36-45de-91a5-009550298c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:36.349501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 569/1140] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:36.372785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a36a1a-f893-40f2-9c2a-1e1583f93a7e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:36.476233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a36a1a-f893-40f2-9c2a-1e1583f93a7e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:36.489615 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:36.514007 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a7163-9ece-4863-87f0-f1eb49c55ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:36.514793 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a7163-9ece-4863-87f0-f1eb49c55ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.515072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a7163-9ece-4863-87f0-f1eb49c55ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.515339 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a7163-9ece-4863-87f0-f1eb49c55ea4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.525966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a7163-9ece-4863-87f0-f1eb49c55ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:36.535882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5d3a7163-9ece-4863-87f0-f1eb49c55ea4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:36.535882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:36.535882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:36.535882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:36.535882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:36.535882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:36.535882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:36.535882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:36.535882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:36.535882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:36.535882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:36.535882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:36.535882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:36.535882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:36.535882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:36.535882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:36.536984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:36.536984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:36.536984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:36.536984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:36.536984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:36.536984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:36.536984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:36.536984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:36.536984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:36.536984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:36.536984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:36.536984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:36.536984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:36.536984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:36.536984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:36.536984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:36.538214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:36.538214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:36.538214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:36.538214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:36.538214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:36.538214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:36.538214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:36.538214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:36.538214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:36.538214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:36.538214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:36.538214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:36.538214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 572/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:36.544711 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68b505-6d36-45de-91a5-009550298c77 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:36.619760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:36.656682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68b505-6d36-45de-91a5-009550298c77 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:36.691905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0c69b-238a-4005-add7-e7e5607a84a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:36.692567 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0c69b-238a-4005-add7-e7e5607a84a7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.692851 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0c69b-238a-4005-add7-e7e5607a84a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.693125 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0c69b-238a-4005-add7-e7e5607a84a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.693911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0c69b-238a-4005-add7-e7e5607a84a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:36.694291 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0c69b-238a-4005-add7-e7e5607a84a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:36.695669 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0c69b-238a-4005-add7-e7e5607a84a7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:36.703751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 570/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:36.710467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a7163-9ece-4863-87f0-f1eb49c55ea4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:36.824476 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a7163-9ece-4863-87f0-f1eb49c55ea4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:36.861026 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187658a1-b2ab-447c-8412-7ef341bc83f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:36.861957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187658a1-b2ab-447c-8412-7ef341bc83f3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:36.862238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187658a1-b2ab-447c-8412-7ef341bc83f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:36.862511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187658a1-b2ab-447c-8412-7ef341bc83f3 None admin] PATH_INFO: `/v3/users/45527317e71d4bcbaf45ec3aac9d613c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:36.877994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187658a1-b2ab-447c-8412-7ef341bc83f3 None admin] RBAC: Authorizing `identity:get_user(user_id=45527317e71d4bcbaf45ec3aac9d613c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:36.879379 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187658a1-b2ab-447c-8412-7ef341bc83f3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:36.881062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 573/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:23:36 2022] GET /identity/v3/users/45527317e71d4bcbaf45ec3aac9d613c => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:36.887263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0c69b-238a-4005-add7-e7e5607a84a7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:36.993790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0c69b-238a-4005-add7-e7e5607a84a7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:37.027434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:37.037634 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7e77c-7054-4f3c-8efa-e036f4b4d94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:37.038297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7e77c-7054-4f3c-8efa-e036f4b4d94c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:37.038583 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7e77c-7054-4f3c-8efa-e036f4b4d94c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:37.038871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7e77c-7054-4f3c-8efa-e036f4b4d94c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:37.109160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7e77c-7054-4f3c-8efa-e036f4b4d94c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:37.110671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7e77c-7054-4f3c-8efa-e036f4b4d94c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:37.211472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 571/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:23:37.217885 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187658a1-b2ab-447c-8412-7ef341bc83f3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:37.254524 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:37.332778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187658a1-b2ab-447c-8412-7ef341bc83f3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:37.369093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f639a-dd24-42c3-9361-4fb6cb71667c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:37.369997 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f639a-dd24-42c3-9361-4fb6cb71667c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:37.370282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f639a-dd24-42c3-9361-4fb6cb71667c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:37.370556 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f639a-dd24-42c3-9361-4fb6cb71667c None admin] PATH_INFO: `/v3/projects/98d3d0bb216343459dca2eb85294bb76` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:37.371868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f639a-dd24-42c3-9361-4fb6cb71667c None admin] RBAC: Authorizing `identity:get_project(project_id=98d3d0bb216343459dca2eb85294bb76)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:37.373297 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f639a-dd24-42c3-9361-4fb6cb71667c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:37.375022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 574/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:23:37 2022] GET /identity/v3/projects/98d3d0bb216343459dca2eb85294bb76 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:37.381673 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7e77c-7054-4f3c-8efa-e036f4b4d94c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:37.412069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:37.498316 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7e77c-7054-4f3c-8efa-e036f4b4d94c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:37.535087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec1fc6-a235-46b1-b959-e781efc95842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:37.535731 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec1fc6-a235-46b1-b959-e781efc95842 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:37.536018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec1fc6-a235-46b1-b959-e781efc95842 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:37.536292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec1fc6-a235-46b1-b959-e781efc95842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:37.537106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec1fc6-a235-46b1-b959-e781efc95842 None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=98d3d0bb216343459dca2eb85294bb76, user.id=45527317e71d4bcbaf45ec3aac9d613c) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:37.537452 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec1fc6-a235-46b1-b959-e781efc95842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:37.538907 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec1fc6-a235-46b1-b959-e781efc95842 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:37.544439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 572/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:37 2022] GET /identity/v3/role_assignments?user.id=45527317e71d4bcbaf45ec3aac9d613c&scope.project.id=98d3d0bb216343459dca2eb85294bb76&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:39.603670 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd2360-1c99-4c18-a84d-68767917bb3c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:39.604368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd2360-1c99-4c18-a84d-68767917bb3c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:39.604368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd2360-1c99-4c18-a84d-68767917bb3c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:39.606081 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 575/1147] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:39.614268 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38283270-5027-47e1-b499-cc19b0d0261c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:39.615014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38283270-5027-47e1-b499-cc19b0d0261c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:39.615167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38283270-5027-47e1-b499-cc19b0d0261c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:39.640053 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-38283270-5027-47e1-b499-cc19b0d0261c None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:39.641220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-38283270-5027-47e1-b499-cc19b0d0261c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:39.715144 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 573/1148] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:39.737882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd2360-1c99-4c18-a84d-68767917bb3c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:39.843612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:39.850139 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd2360-1c99-4c18-a84d-68767917bb3c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:39.894578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce2e49-1cb6-45a9-bae1-5e555529025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:39.895317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce2e49-1cb6-45a9-bae1-5e555529025c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:39.895601 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce2e49-1cb6-45a9-bae1-5e555529025c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:39.895878 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce2e49-1cb6-45a9-bae1-5e555529025c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:39.906359 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce2e49-1cb6-45a9-bae1-5e555529025c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:39.914036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-14ce2e49-1cb6-45a9-bae1-5e555529025c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:39.914036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:39.914036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:39.914036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:39.914036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:39.914036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:39.914036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:39.914036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:39.914036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:39.914036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:39.914036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:39.914036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:39.914036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:39.914036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:39.914036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:39.914036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:39.915122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:39.915122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:39.915122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:39.915122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:39.915122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:39.915122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:39.915122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:39.915122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:39.915122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:39.915122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:39.915122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:39.915122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:39.915122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:39.915122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:39.915122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:39.915122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:39.916260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:39.916260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:39.916260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:39.916260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:39.916260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:39.916260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:39.916260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:39.916260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:39.916260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:39.916260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:39.916260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:39.916260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:39.917514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 576/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:39.921692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38283270-5027-47e1-b499-cc19b0d0261c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:39.946876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:40.026128 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38283270-5027-47e1-b499-cc19b0d0261c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:40.061104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53680e4b-a260-44df-86e0-126cc5bde887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:40.061816 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53680e4b-a260-44df-86e0-126cc5bde887 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:40.062099 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53680e4b-a260-44df-86e0-126cc5bde887 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:40.062379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53680e4b-a260-44df-86e0-126cc5bde887 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:40.063150 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53680e4b-a260-44df-86e0-126cc5bde887 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:40.063453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53680e4b-a260-44df-86e0-126cc5bde887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:40.064850 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53680e4b-a260-44df-86e0-126cc5bde887 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:40.077012 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 574/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:40.085753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce2e49-1cb6-45a9-bae1-5e555529025c None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:40.190004 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce2e49-1cb6-45a9-bae1-5e555529025c None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:40.226461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a187b3-0a40-4cc9-8d2d-e9f7c6987ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:40.227419 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a187b3-0a40-4cc9-8d2d-e9f7c6987ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:40.227700 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a187b3-0a40-4cc9-8d2d-e9f7c6987ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:40.227968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a187b3-0a40-4cc9-8d2d-e9f7c6987ab6 None admin] PATH_INFO: `/v3/users/45527317e71d4bcbaf45ec3aac9d613c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:40.229130 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a187b3-0a40-4cc9-8d2d-e9f7c6987ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=45527317e71d4bcbaf45ec3aac9d613c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:40.230599 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a187b3-0a40-4cc9-8d2d-e9f7c6987ab6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:40.232173 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 577/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:23:40 2022] GET /identity/v3/users/45527317e71d4bcbaf45ec3aac9d613c => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:40.238004 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53680e4b-a260-44df-86e0-126cc5bde887 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:40.325865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:40.353553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53680e4b-a260-44df-86e0-126cc5bde887 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:40.390217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c199aa9-8e86-4d41-b0fc-0e61492cd157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:40.391098 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c199aa9-8e86-4d41-b0fc-0e61492cd157 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:40.391384 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c199aa9-8e86-4d41-b0fc-0e61492cd157 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:40.391660 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c199aa9-8e86-4d41-b0fc-0e61492cd157 None admin] PATH_INFO: `/v3/projects/98d3d0bb216343459dca2eb85294bb76` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:40.392985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c199aa9-8e86-4d41-b0fc-0e61492cd157 None admin] RBAC: Authorizing `identity:get_project(project_id=98d3d0bb216343459dca2eb85294bb76)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:40.394475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c199aa9-8e86-4d41-b0fc-0e61492cd157 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:40.396194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 575/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:23:40 2022] GET /identity/v3/projects/98d3d0bb216343459dca2eb85294bb76 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:40.402315 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a187b3-0a40-4cc9-8d2d-e9f7c6987ab6 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:40.432171 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:40.511884 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a187b3-0a40-4cc9-8d2d-e9f7c6987ab6 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:40.546528 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728351d4-6d60-4957-98b3-14f1a638bdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:40.547418 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728351d4-6d60-4957-98b3-14f1a638bdd6 None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:40.547698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728351d4-6d60-4957-98b3-14f1a638bdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:40.547965 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728351d4-6d60-4957-98b3-14f1a638bdd6 None admin] PATH_INFO: `/v3/projects/98d3d0bb216343459dca2eb85294bb76/users/45527317e71d4bcbaf45ec3aac9d613c/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:40.550211 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728351d4-6d60-4957-98b3-14f1a638bdd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=98d3d0bb216343459dca2eb85294bb76, user_id=45527317e71d4bcbaf45ec3aac9d613c, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:40.551640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728351d4-6d60-4957-98b3-14f1a638bdd6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:40.567459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 578/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:23:40 2022] PUT /identity/v3/projects/98d3d0bb216343459dca2eb85294bb76/users/45527317e71d4bcbaf45ec3aac9d613c/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:23:42.646111 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05e50a-e3fb-44cb-8dbd-887e270390d4 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:42.646691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05e50a-e3fb-44cb-8dbd-887e270390d4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:42.646691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05e50a-e3fb-44cb-8dbd-887e270390d4 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:42.648066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 576/1154] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:42.654427 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eb1f2-8279-4272-bfa5-5b495120c36e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:42.655123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eb1f2-8279-4272-bfa5-5b495120c36e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:42.655325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eb1f2-8279-4272-bfa5-5b495120c36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:42.676350 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-157eb1f2-8279-4272-bfa5-5b495120c36e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:42.677574 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-157eb1f2-8279-4272-bfa5-5b495120c36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:42.748525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 579/1155] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:42.771947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05e50a-e3fb-44cb-8dbd-887e270390d4 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:42.897539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05e50a-e3fb-44cb-8dbd-887e270390d4 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:42.933284 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e1bc8-899b-4e20-924e-d2a113bfb168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:42.934123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e1bc8-899b-4e20-924e-d2a113bfb168 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:42.934413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e1bc8-899b-4e20-924e-d2a113bfb168 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:42.934700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e1bc8-899b-4e20-924e-d2a113bfb168 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:42.946761 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e1bc8-899b-4e20-924e-d2a113bfb168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:42.954493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-9b1e1bc8-899b-4e20-924e-d2a113bfb168 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:42.954493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:42.954493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:42.954493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:42.954493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:42.954493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:42.954493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:42.954493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:42.954493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:42.954493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:42.954493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:42.954493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:42.954493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:42.954493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:42.954493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:42.954493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:42.955552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:42.955552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:42.955552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:42.955552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:42.955552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:42.955552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:42.955552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:42.955552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:42.955552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:42.955552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:42.955552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:42.955552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:42.955552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:42.955552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:42.955552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:42.955552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:42.956438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:42.956438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:42.956438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:42.956438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:42.956438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:42.956438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:42.956438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:42.956438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:42.956438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:42.956438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:42.956438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:42.956438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:23:42.956438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 577/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:42.964134 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157eb1f2-8279-4272-bfa5-5b495120c36e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:42.982057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:43.069908 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157eb1f2-8279-4272-bfa5-5b495120c36e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:43.105744 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239eb771-3d61-45a7-9605-717de6d0182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:43.106412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eb771-3d61-45a7-9605-717de6d0182a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:43.106695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eb771-3d61-45a7-9605-717de6d0182a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:43.106967 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eb771-3d61-45a7-9605-717de6d0182a None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:43.107716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239eb771-3d61-45a7-9605-717de6d0182a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:43.108024 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239eb771-3d61-45a7-9605-717de6d0182a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:43.109398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239eb771-3d61-45a7-9605-717de6d0182a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:43.118090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 580/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:43.124237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e1bc8-899b-4e20-924e-d2a113bfb168 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:43.140198 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:43.232612 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e1bc8-899b-4e20-924e-d2a113bfb168 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:43.271135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a4a87-cde9-472b-93a1-4c03b865af7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:43.272008 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a4a87-cde9-472b-93a1-4c03b865af7d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:43.272292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a4a87-cde9-472b-93a1-4c03b865af7d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:43.272564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a4a87-cde9-472b-93a1-4c03b865af7d None admin] PATH_INFO: `/v3/users/45527317e71d4bcbaf45ec3aac9d613c` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:43.273829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a4a87-cde9-472b-93a1-4c03b865af7d None admin] RBAC: Authorizing `identity:get_user(user_id=45527317e71d4bcbaf45ec3aac9d613c)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:43.275264 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a4a87-cde9-472b-93a1-4c03b865af7d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:43.276933 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 578/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:23:43 2022] GET /identity/v3/users/45527317e71d4bcbaf45ec3aac9d613c => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:43.283319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239eb771-3d61-45a7-9605-717de6d0182a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:43.381130 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:43.405387 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239eb771-3d61-45a7-9605-717de6d0182a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:43.440160 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbfaae-d6b7-46a7-b0b0-ce9d6ffb8f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:43.440807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbfaae-d6b7-46a7-b0b0-ce9d6ffb8f4a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:43.441089 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbfaae-d6b7-46a7-b0b0-ce9d6ffb8f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:43.441388 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbfaae-d6b7-46a7-b0b0-ce9d6ffb8f4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:43.511954 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbfaae-d6b7-46a7-b0b0-ce9d6ffb8f4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:43.513326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbfaae-d6b7-46a7-b0b0-ce9d6ffb8f4a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:43.590269 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:43.617206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 581/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:23:43.624293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a4a87-cde9-472b-93a1-4c03b865af7d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:43.712385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:43.734414 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a4a87-cde9-472b-93a1-4c03b865af7d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:43.769992 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4c0b4-b820-4bda-a855-a461e0b32f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:43.770787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4c0b4-b820-4bda-a855-a461e0b32f81 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:43.771076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4c0b4-b820-4bda-a855-a461e0b32f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:43.771344 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4c0b4-b820-4bda-a855-a461e0b32f81 None admin] PATH_INFO: `/v3/projects/98d3d0bb216343459dca2eb85294bb76` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:43.772632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4c0b4-b820-4bda-a855-a461e0b32f81 None admin] RBAC: Authorizing `identity:get_project(project_id=98d3d0bb216343459dca2eb85294bb76)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:43.774108 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4c0b4-b820-4bda-a855-a461e0b32f81 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:43.775925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 579/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:23:43 2022] GET /identity/v3/projects/98d3d0bb216343459dca2eb85294bb76 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:43.782976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbfaae-d6b7-46a7-b0b0-ce9d6ffb8f4a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:43.893372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbfaae-d6b7-46a7-b0b0-ce9d6ffb8f4a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:43.929254 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d447a-8a87-4693-a019-c69e14b7c36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:43.930233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d447a-8a87-4693-a019-c69e14b7c36e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:43.930611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d447a-8a87-4693-a019-c69e14b7c36e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:43.930992 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d447a-8a87-4693-a019-c69e14b7c36e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:43.932825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d447a-8a87-4693-a019-c69e14b7c36e None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=98d3d0bb216343459dca2eb85294bb76, user.id=45527317e71d4bcbaf45ec3aac9d613c) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:43.933258 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d447a-8a87-4693-a019-c69e14b7c36e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:43.935511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d447a-8a87-4693-a019-c69e14b7c36e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:43.946689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 582/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:43 2022] GET /identity/v3/role_assignments?user.id=45527317e71d4bcbaf45ec3aac9d613c&scope.project.id=98d3d0bb216343459dca2eb85294bb76&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:46.060857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e656078-1622-47f2-816e-9de8d8d90bc7 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:46.061493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e656078-1622-47f2-816e-9de8d8d90bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:46.061493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e656078-1622-47f2-816e-9de8d8d90bc7 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:46.062850 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 580/1162] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:46.069145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11fdbe-0a57-4530-b49a-93c701ad5888 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:46.069589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11fdbe-0a57-4530-b49a-93c701ad5888 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:46.069747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11fdbe-0a57-4530-b49a-93c701ad5888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:46.087011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8c11fdbe-0a57-4530-b49a-93c701ad5888 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:46.088213 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8c11fdbe-0a57-4530-b49a-93c701ad5888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:46.125230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:46.162794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 583/1163] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:46.185893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e656078-1622-47f2-816e-9de8d8d90bc7 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:46.298792 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e656078-1622-47f2-816e-9de8d8d90bc7 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:46.336181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938ad4a-f8c9-4ca5-b892-a9403acda749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:46.336762 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938ad4a-f8c9-4ca5-b892-a9403acda749 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:46.337047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938ad4a-f8c9-4ca5-b892-a9403acda749 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:46.337310 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938ad4a-f8c9-4ca5-b892-a9403acda749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:46.357308 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:46.408845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938ad4a-f8c9-4ca5-b892-a9403acda749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:46.410328 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938ad4a-f8c9-4ca5-b892-a9403acda749 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:46.515796 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 581/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:23:46.522773 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11fdbe-0a57-4530-b49a-93c701ad5888 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:46.625711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11fdbe-0a57-4530-b49a-93c701ad5888 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:46.660711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b6cb6-80fd-4538-b147-762836433a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:46.661545 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b6cb6-80fd-4538-b147-762836433a31 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:46.661830 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b6cb6-80fd-4538-b147-762836433a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:46.662107 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b6cb6-80fd-4538-b147-762836433a31 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:46.669103 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b6cb6-80fd-4538-b147-762836433a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:46.670621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b6cb6-80fd-4538-b147-762836433a31 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-8e8b6cb6-80fd-4538-b147-762836433a31 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:46.685182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:46.686397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:46.686397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:46.686397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:46.686397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:46.686397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:46.686397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:46.686397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:23:46.686397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:23:46.686397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:23:46.686397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:23:46.686397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:46.686397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:46.686397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:46.686397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:46.686397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:46.686397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:46.687499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:46.687499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:46.687499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:46.687499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:46.687499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:46.687499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:46.687499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:46.687499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:46.687499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:46.687499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:46.687499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 15 00:23:46.687499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:23:46.687499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 15 00:23:46.687499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:23:46.687499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 584/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 15 00:23:46 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:46.694225 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938ad4a-f8c9-4ca5-b892-a9403acda749 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:46.751770 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:46.810229 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938ad4a-f8c9-4ca5-b892-a9403acda749 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:46.846075 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6fef1c-d110-4244-b7c3-62423cffc455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:46.846744 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fef1c-d110-4244-b7c3-62423cffc455 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:46.847025 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fef1c-d110-4244-b7c3-62423cffc455 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:46.847302 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6fef1c-d110-4244-b7c3-62423cffc455 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:46.848015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fef1c-d110-4244-b7c3-62423cffc455 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:46.848324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fef1c-d110-4244-b7c3-62423cffc455 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:46.849735 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6fef1c-d110-4244-b7c3-62423cffc455 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:46.857039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 582/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Wed Jun 15 00:23:46 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:48.946367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66803535-852e-4202-899e-7da1a1293104 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:48.947041 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66803535-852e-4202-899e-7da1a1293104 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:48.947041 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66803535-852e-4202-899e-7da1a1293104 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:48.948344 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 585/1167] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:48.954689 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1e638-7033-49e3-ab21-2f260c8c4bee None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:48.955451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1e638-7033-49e3-ab21-2f260c8c4bee None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:48.955620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1e638-7033-49e3-ab21-2f260c8c4bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:48.977011 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-94a1e638-7033-49e3-ab21-2f260c8c4bee None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:48.978230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-94a1e638-7033-49e3-ab21-2f260c8c4bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:49.057887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 583/1168] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:49.080927 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66803535-852e-4202-899e-7da1a1293104 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:49.115429 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:49.207848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66803535-852e-4202-899e-7da1a1293104 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:49.243498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c15a0d-91ff-4d9d-8306-4988756bf6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:49.244163 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c15a0d-91ff-4d9d-8306-4988756bf6ad None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:49.244448 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c15a0d-91ff-4d9d-8306-4988756bf6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:49.244734 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c15a0d-91ff-4d9d-8306-4988756bf6ad None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:49.245504 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c15a0d-91ff-4d9d-8306-4988756bf6ad None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:49.246889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c15a0d-91ff-4d9d-8306-4988756bf6ad None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:49.265651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 586/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Wed Jun 15 00:23:49 2022] POST /identity/v3/domains => generated 267 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:51.391653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d1d98-3649-44d0-9055-796729754084 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:51.392211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d1d98-3649-44d0-9055-796729754084 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:51.392211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d1d98-3649-44d0-9055-796729754084 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:51.393529 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 584/1170] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:51.399837 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbace3-61a4-421e-a069-6bf1b5be4d94 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:51.400565 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbace3-61a4-421e-a069-6bf1b5be4d94 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:51.400760 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbace3-61a4-421e-a069-6bf1b5be4d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:51.424792 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-57bbace3-61a4-421e-a069-6bf1b5be4d94 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:51.426014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-57bbace3-61a4-421e-a069-6bf1b5be4d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:51.499129 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 587/1171] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:51.527046 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d1d98-3649-44d0-9055-796729754084 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:51.572817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:51.630801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d1d98-3649-44d0-9055-796729754084 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:51.665430 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af41e2-869b-40d8-92d7-15b544b22981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:51.666240 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af41e2-869b-40d8-92d7-15b544b22981 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:51.666550 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af41e2-869b-40d8-92d7-15b544b22981 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:51.666825 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af41e2-869b-40d8-92d7-15b544b22981 None admin] PATH_INFO: `/v3/domains/eb3b354fed3d43e3958c6c334235d5fa` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:51.677582 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af41e2-869b-40d8-92d7-15b544b22981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=eb3b354fed3d43e3958c6c334235d5fa)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:51.679023 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af41e2-869b-40d8-92d7-15b544b22981 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:51.680637 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 585/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Wed Jun 15 00:23:51 2022] GET /identity/v3/domains/eb3b354fed3d43e3958c6c334235d5fa => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:51.687243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbace3-61a4-421e-a069-6bf1b5be4d94 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:51.722111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:51.802645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbace3-61a4-421e-a069-6bf1b5be4d94 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:51.839095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d918720-309d-40c5-97e8-059c53bbb8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:51.839749 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d918720-309d-40c5-97e8-059c53bbb8e7 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:51.840030 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d918720-309d-40c5-97e8-059c53bbb8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:51.840305 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d918720-309d-40c5-97e8-059c53bbb8e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:51.841018 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d918720-309d-40c5-97e8-059c53bbb8e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:51.842505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d918720-309d-40c5-97e8-059c53bbb8e7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:51.872023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 588/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 15 00:23:51 2022] POST /identity/v3/projects => generated 361 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:54.029626 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c13a9-761c-4270-b9a8-f4d24f7ad378 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:54.030232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c13a9-761c-4270-b9a8-f4d24f7ad378 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:54.030232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c13a9-761c-4270-b9a8-f4d24f7ad378 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:54.031545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 586/1174] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:54.037192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b4bd7-1454-4b8d-9eb0-77836aea9159 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:54.037684 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b4bd7-1454-4b8d-9eb0-77836aea9159 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:54.037798 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b4bd7-1454-4b8d-9eb0-77836aea9159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:54.055589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-831b4bd7-1454-4b8d-9eb0-77836aea9159 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:54.056779 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-831b4bd7-1454-4b8d-9eb0-77836aea9159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:54.127718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 589/1175] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:54.154199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c13a9-761c-4270-b9a8-f4d24f7ad378 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:54.257151 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c13a9-761c-4270-b9a8-f4d24f7ad378 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:54.258821 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:54.293398 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8dfc7e-8701-4be4-acdd-9c2c4ffb6da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:54.294204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dfc7e-8701-4be4-acdd-9c2c4ffb6da4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:54.294487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dfc7e-8701-4be4-acdd-9c2c4ffb6da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:54.294766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8dfc7e-8701-4be4-acdd-9c2c4ffb6da4 None admin] PATH_INFO: `/v3/domains/eb3b354fed3d43e3958c6c334235d5fa` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:54.296075 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8dfc7e-8701-4be4-acdd-9c2c4ffb6da4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=eb3b354fed3d43e3958c6c334235d5fa)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:54.297558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8dfc7e-8701-4be4-acdd-9c2c4ffb6da4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:54.299180 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 587/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Wed Jun 15 00:23:54 2022] GET /identity/v3/domains/eb3b354fed3d43e3958c6c334235d5fa => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:54.308673 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b4bd7-1454-4b8d-9eb0-77836aea9159 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:54.313722 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:54.415623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b4bd7-1454-4b8d-9eb0-77836aea9159 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:54.464484 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760173ab-35ff-4f03-af6e-0b019758e187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:54.465154 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760173ab-35ff-4f03-af6e-0b019758e187 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:54.465462 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760173ab-35ff-4f03-af6e-0b019758e187 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:54.465736 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760173ab-35ff-4f03-af6e-0b019758e187 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:54.466443 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760173ab-35ff-4f03-af6e-0b019758e187 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:54.467876 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760173ab-35ff-4f03-af6e-0b019758e187 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:54.489218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 590/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:23:54 2022] POST /identity/v3/users => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:23:56.642828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cebfc0-df81-4bf3-94e6-9c07bd4c0bb2 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:56.643722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cebfc0-df81-4bf3-94e6-9c07bd4c0bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:56.643722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cebfc0-df81-4bf3-94e6-9c07bd4c0bb2 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:56.645960 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 588/1178] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:23:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:23:56.654674 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f84412-6e55-4ffa-a806-0569249c9993 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:56.655108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f84412-6e55-4ffa-a806-0569249c9993 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:56.655278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f84412-6e55-4ffa-a806-0569249c9993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:56.676667 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-46f84412-6e55-4ffa-a806-0569249c9993 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:23:56.677892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-46f84412-6e55-4ffa-a806-0569249c9993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:23:56.747247 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:56.762346 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 591/1179] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:23:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:23:56.786006 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cebfc0-df81-4bf3-94e6-9c07bd4c0bb2 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:56.904124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cebfc0-df81-4bf3-94e6-9c07bd4c0bb2 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:56.942298 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038936f4-b0f2-4a4e-8d90-18e2441b85cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:56.943100 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038936f4-b0f2-4a4e-8d90-18e2441b85cd None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:56.943391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038936f4-b0f2-4a4e-8d90-18e2441b85cd None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:56.943673 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038936f4-b0f2-4a4e-8d90-18e2441b85cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:56.955650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038936f4-b0f2-4a4e-8d90-18e2441b85cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:23:56.963464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-038936f4-b0f2-4a4e-8d90-18e2441b85cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:56.963464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:23:56.963464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:23:56.963464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:23:56.963464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:23:56.963464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:23:56.963464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:23:56.963464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:23:56.963464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:23:56.963464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:23:56.963464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:23:56.963464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:23:56.963464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:23:56.963464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:23:56.963464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:23:56.963464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:23:56.964676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:23:56.964676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:23:56.964676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:23:56.964676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:23:56.964676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:23:56.964676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:23:56.964676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:23:56.964676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:23:56.964676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:23:56.964676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:23:56.964676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:23:56.964676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:23:56.964676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:23:56.964676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:23:56.964676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:23:56.964676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:23:56.965841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:23:56.965841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:23:56.965841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:23:56.965841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:23:56.965841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:23:56.965841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:23:56.965841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:23:56.965841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:23:56.965841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:23:56.965841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:23:56.965841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:23:56.965841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:23:56.965841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 589/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:23:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:23:56.971279 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f84412-6e55-4ffa-a806-0569249c9993 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:57.086240 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f84412-6e55-4ffa-a806-0569249c9993 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:57.121577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dc9ec-7daf-488e-848b-44a642e2f241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:57.122250 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dc9ec-7daf-488e-848b-44a642e2f241 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:57.122536 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dc9ec-7daf-488e-848b-44a642e2f241 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:57.122811 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dc9ec-7daf-488e-848b-44a642e2f241 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:57.123559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2dc9ec-7daf-488e-848b-44a642e2f241 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:57.123867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2dc9ec-7daf-488e-848b-44a642e2f241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:57.125244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2dc9ec-7daf-488e-848b-44a642e2f241 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:57.133665 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 592/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:23:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:57.143546 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038936f4-b0f2-4a4e-8d90-18e2441b85cd None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:57.178231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:57.253159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038936f4-b0f2-4a4e-8d90-18e2441b85cd None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:57.289370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f850b8c-2900-464f-8b29-78861757c95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:57.290255 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f850b8c-2900-464f-8b29-78861757c95d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:57.290537 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f850b8c-2900-464f-8b29-78861757c95d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:57.290809 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f850b8c-2900-464f-8b29-78861757c95d None admin] PATH_INFO: `/v3/users/37caecb18a544fd8bd56df54090b428a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:57.305995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f850b8c-2900-464f-8b29-78861757c95d None admin] RBAC: Authorizing `identity:get_user(user_id=37caecb18a544fd8bd56df54090b428a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:57.307472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f850b8c-2900-464f-8b29-78861757c95d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:57.309190 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 590/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:23:57 2022] GET /identity/v3/users/37caecb18a544fd8bd56df54090b428a => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:57.315384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dc9ec-7daf-488e-848b-44a642e2f241 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:57.375909 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:57.425168 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dc9ec-7daf-488e-848b-44a642e2f241 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:57.460877 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a185aa-e1b2-48f8-be2d-d55393cffd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:57.461546 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a185aa-e1b2-48f8-be2d-d55393cffd5e None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:57.461826 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a185aa-e1b2-48f8-be2d-d55393cffd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:57.462105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a185aa-e1b2-48f8-be2d-d55393cffd5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:57.534636 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a185aa-e1b2-48f8-be2d-d55393cffd5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:57.536075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a185aa-e1b2-48f8-be2d-d55393cffd5e None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:57.586951 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:57.662308 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 593/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:23:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:23:57.669301 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f850b8c-2900-464f-8b29-78861757c95d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:57.769978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:23:57.783765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f850b8c-2900-464f-8b29-78861757c95d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:57.818917 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544d5dd-fe4b-4397-ab06-acddf9be4edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:57.819777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544d5dd-fe4b-4397-ab06-acddf9be4edb None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:57.820058 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544d5dd-fe4b-4397-ab06-acddf9be4edb None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:57.820333 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544d5dd-fe4b-4397-ab06-acddf9be4edb None admin] PATH_INFO: `/v3/projects/f3405afff58e4b59b53402e93ac8c6a3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:57.821575 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544d5dd-fe4b-4397-ab06-acddf9be4edb None admin] RBAC: Authorizing `identity:get_project(project_id=f3405afff58e4b59b53402e93ac8c6a3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:57.823065 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544d5dd-fe4b-4397-ab06-acddf9be4edb None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:57.824755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 591/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:23:57 2022] GET /identity/v3/projects/f3405afff58e4b59b53402e93ac8c6a3 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:23:57.834602 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a185aa-e1b2-48f8-be2d-d55393cffd5e None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:23:57.937988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a185aa-e1b2-48f8-be2d-d55393cffd5e None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:23:57.975564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c04ee-f1bf-4b61-9ddd-07e17a4ef038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:23:57.976567 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c04ee-f1bf-4b61-9ddd-07e17a4ef038 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:23:57.976996 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c04ee-f1bf-4b61-9ddd-07e17a4ef038 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:23:57.977428 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c04ee-f1bf-4b61-9ddd-07e17a4ef038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:23:57.978833 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c04ee-f1bf-4b61-9ddd-07e17a4ef038 None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=f3405afff58e4b59b53402e93ac8c6a3, user.id=37caecb18a544fd8bd56df54090b428a) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:23:57.979334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c04ee-f1bf-4b61-9ddd-07e17a4ef038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:23:57.981694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c04ee-f1bf-4b61-9ddd-07e17a4ef038 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:23:57.991428 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 594/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:23:57 2022] GET /identity/v3/role_assignments?user.id=37caecb18a544fd8bd56df54090b428a&scope.project.id=f3405afff58e4b59b53402e93ac8c6a3&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:00.073115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74504816-7c23-44aa-adec-a5cf61cbbaf3 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:00.073604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74504816-7c23-44aa-adec-a5cf61cbbaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:00.073697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74504816-7c23-44aa-adec-a5cf61cbbaf3 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:00.075106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 592/1186] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:00.081709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd91c39-98c5-4067-85c8-20a4bfe13d3e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:00.082440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd91c39-98c5-4067-85c8-20a4bfe13d3e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:00.082612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd91c39-98c5-4067-85c8-20a4bfe13d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:00.102733 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0dd91c39-98c5-4067-85c8-20a4bfe13d3e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:00.103921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0dd91c39-98c5-4067-85c8-20a4bfe13d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:00.115304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:00.183450 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 595/1187] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:00.211937 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74504816-7c23-44aa-adec-a5cf61cbbaf3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:00.324064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74504816-7c23-44aa-adec-a5cf61cbbaf3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:00.361216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819071a-c462-4acf-b717-53e7304e067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:00.362043 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819071a-c462-4acf-b717-53e7304e067f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:00.362331 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819071a-c462-4acf-b717-53e7304e067f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:00.362594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819071a-c462-4acf-b717-53e7304e067f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:00.372981 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819071a-c462-4acf-b717-53e7304e067f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:24:00.380719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-5819071a-c462-4acf-b717-53e7304e067f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:24:00.380719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:24:00.380719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:24:00.380719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:24:00.380719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:24:00.380719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:24:00.380719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:24:00.380719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:24:00.380719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:24:00.380719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:24:00.380719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:24:00.380719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:24:00.380719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:24:00.380719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:24:00.380719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:24:00.380719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:24:00.381717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:24:00.381717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:24:00.381717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:24:00.381717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:24:00.381717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:24:00.381717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:24:00.381717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:24:00.381717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:24:00.381717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:24:00.381717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:24:00.381717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:24:00.381717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:24:00.381717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:24:00.381717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:24:00.381717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:24:00.381717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:24:00.382618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:24:00.382618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:24:00.382618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:24:00.382618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:24:00.382618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:24:00.382618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:24:00.382618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:24:00.382618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:24:00.382618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:24:00.382618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:24:00.382618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:24:00.382618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:24:00.382618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 593/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:24:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:24:00.388428 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd91c39-98c5-4067-85c8-20a4bfe13d3e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:00.493388 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd91c39-98c5-4067-85c8-20a4bfe13d3e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:00.529437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1416212-6743-4a6b-82fe-92744f9c3d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:00.530111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1416212-6743-4a6b-82fe-92744f9c3d46 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:00.530404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1416212-6743-4a6b-82fe-92744f9c3d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:00.530677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1416212-6743-4a6b-82fe-92744f9c3d46 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:00.531427 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1416212-6743-4a6b-82fe-92744f9c3d46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:24:00.531737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1416212-6743-4a6b-82fe-92744f9c3d46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:00.533120 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1416212-6743-4a6b-82fe-92744f9c3d46 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:00.541438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 596/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:24:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:00.548018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819071a-c462-4acf-b717-53e7304e067f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:00.577448 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:00.662351 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819071a-c462-4acf-b717-53e7304e067f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:00.697056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fcf6-cd81-478c-91e9-9c40321db3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:00.697993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fcf6-cd81-478c-91e9-9c40321db3ca None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:00.698274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fcf6-cd81-478c-91e9-9c40321db3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:00.698532 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fcf6-cd81-478c-91e9-9c40321db3ca None admin] PATH_INFO: `/v3/users/37caecb18a544fd8bd56df54090b428a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:00.699746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710fcf6-cd81-478c-91e9-9c40321db3ca None admin] RBAC: Authorizing `identity:get_user(user_id=37caecb18a544fd8bd56df54090b428a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:00.701191 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710fcf6-cd81-478c-91e9-9c40321db3ca None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:00.702860 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 594/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:24:00 2022] GET /identity/v3/users/37caecb18a544fd8bd56df54090b428a => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:00.708791 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1416212-6743-4a6b-82fe-92744f9c3d46 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:00.721158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:00.823462 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1416212-6743-4a6b-82fe-92744f9c3d46 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:00.858288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1226e-eacd-424f-af08-3c03122c867b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:00.859088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1226e-eacd-424f-af08-3c03122c867b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:00.859373 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1226e-eacd-424f-af08-3c03122c867b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:00.859645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1226e-eacd-424f-af08-3c03122c867b None admin] PATH_INFO: `/v3/projects/f3405afff58e4b59b53402e93ac8c6a3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:00.860946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1226e-eacd-424f-af08-3c03122c867b None admin] RBAC: Authorizing `identity:get_project(project_id=f3405afff58e4b59b53402e93ac8c6a3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:00.862410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1226e-eacd-424f-af08-3c03122c867b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:00.864471 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 597/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:24:00 2022] GET /identity/v3/projects/f3405afff58e4b59b53402e93ac8c6a3 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:00.871151 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fcf6-cd81-478c-91e9-9c40321db3ca None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:00.967995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:00.986110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fcf6-cd81-478c-91e9-9c40321db3ca None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:01.020955 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92f497-0c48-4139-bf41-7a7fc39e6f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:01.021952 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92f497-0c48-4139-bf41-7a7fc39e6f43 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:01.022222 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92f497-0c48-4139-bf41-7a7fc39e6f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:01.022499 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92f497-0c48-4139-bf41-7a7fc39e6f43 None admin] PATH_INFO: `/v3/projects/f3405afff58e4b59b53402e93ac8c6a3/users/37caecb18a544fd8bd56df54090b428a/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:01.024492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92f497-0c48-4139-bf41-7a7fc39e6f43 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3405afff58e4b59b53402e93ac8c6a3, user_id=37caecb18a544fd8bd56df54090b428a, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:01.026015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92f497-0c48-4139-bf41-7a7fc39e6f43 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:01.041752 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 595/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:24:00 2022] PUT /identity/v3/projects/f3405afff58e4b59b53402e93ac8c6a3/users/37caecb18a544fd8bd56df54090b428a/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:24:03.094463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33966163-8287-474e-8562-3acdf6f22a1f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:03.094912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33966163-8287-474e-8562-3acdf6f22a1f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:03.095003 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33966163-8287-474e-8562-3acdf6f22a1f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:03.096416 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 598/1193] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:24:03.102622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602621e5-9fc4-4ca9-b414-3c416b8daf43 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:03.103368 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602621e5-9fc4-4ca9-b414-3c416b8daf43 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:03.103462 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602621e5-9fc4-4ca9-b414-3c416b8daf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:03.127610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-602621e5-9fc4-4ca9-b414-3c416b8daf43 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:24:03.128815 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-602621e5-9fc4-4ca9-b414-3c416b8daf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:24:03.200142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 596/1194] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:24:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:24:03.227968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33966163-8287-474e-8562-3acdf6f22a1f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:03.311869 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:03.341658 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33966163-8287-474e-8562-3acdf6f22a1f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:03.377131 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e73d00-5a90-4f97-867c-13e82d0b5b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:03.377967 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e73d00-5a90-4f97-867c-13e82d0b5b30 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:03.378256 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e73d00-5a90-4f97-867c-13e82d0b5b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:03.378536 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e73d00-5a90-4f97-867c-13e82d0b5b30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:03.389864 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e73d00-5a90-4f97-867c-13e82d0b5b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:24:03.397543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-05e73d00-5a90-4f97-867c-13e82d0b5b30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:24:03.397543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:24:03.397543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:24:03.397543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:24:03.397543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:24:03.397543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:24:03.397543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:24:03.397543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:24:03.397543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:24:03.397543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:24:03.397543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:24:03.397543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:24:03.397543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:24:03.397543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:24:03.397543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:24:03.397543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:24:03.398624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:24:03.398624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:24:03.398624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:24:03.398624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:24:03.398624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:24:03.398624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:24:03.398624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:24:03.398624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:24:03.398624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:24:03.398624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:24:03.398624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:24:03.398624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:24:03.398624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:24:03.398624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:24:03.398624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:24:03.398624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:24:03.399631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:24:03.399631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:24:03.399631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:24:03.399631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:24:03.399631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:24:03.399631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:24:03.399631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:24:03.399631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:24:03.399631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:24:03.399631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:24:03.399631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:24:03.399631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:24:03.399631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 599/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:24:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:24:03.405073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602621e5-9fc4-4ca9-b414-3c416b8daf43 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:03.480204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:03.516741 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602621e5-9fc4-4ca9-b414-3c416b8daf43 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:03.552513 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd252e9-abe5-49d0-b077-26cc8cdaad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:03.553172 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd252e9-abe5-49d0-b077-26cc8cdaad22 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:03.553483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd252e9-abe5-49d0-b077-26cc8cdaad22 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:03.553757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd252e9-abe5-49d0-b077-26cc8cdaad22 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:03.554504 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd252e9-abe5-49d0-b077-26cc8cdaad22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:24:03.554814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd252e9-abe5-49d0-b077-26cc8cdaad22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:03.556178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd252e9-abe5-49d0-b077-26cc8cdaad22 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:03.564327 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 597/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:24:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:24:03.571293 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e73d00-5a90-4f97-867c-13e82d0b5b30 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:03.676463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e73d00-5a90-4f97-867c-13e82d0b5b30 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:03.716935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e230742-bd91-47df-a94d-ec1e062a1edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:03.717839 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e230742-bd91-47df-a94d-ec1e062a1edd None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:03.718122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e230742-bd91-47df-a94d-ec1e062a1edd None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:03.718395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e230742-bd91-47df-a94d-ec1e062a1edd None admin] PATH_INFO: `/v3/users/37caecb18a544fd8bd56df54090b428a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:03.719627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e230742-bd91-47df-a94d-ec1e062a1edd None admin] RBAC: Authorizing `identity:get_user(user_id=37caecb18a544fd8bd56df54090b428a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:03.721059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e230742-bd91-47df-a94d-ec1e062a1edd None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:03.722713 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 600/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Wed Jun 15 00:24:03 2022] GET /identity/v3/users/37caecb18a544fd8bd56df54090b428a => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:03.731115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd252e9-abe5-49d0-b077-26cc8cdaad22 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:03.861976 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd252e9-abe5-49d0-b077-26cc8cdaad22 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:03.897629 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba25f77-7293-4d1b-9af3-6604ef315f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:03.898283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba25f77-7293-4d1b-9af3-6604ef315f35 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:03.898564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba25f77-7293-4d1b-9af3-6604ef315f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:03.898845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba25f77-7293-4d1b-9af3-6604ef315f35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:03.902542 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:03.969528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba25f77-7293-4d1b-9af3-6604ef315f35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:03.971089 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba25f77-7293-4d1b-9af3-6604ef315f35 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:04.085076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 598/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:24:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:24:04.091328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e230742-bd91-47df-a94d-ec1e062a1edd None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:04.095595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:04.208000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e230742-bd91-47df-a94d-ec1e062a1edd None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:04.243490 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57774ed1-a742-4148-aa7f-13e85d9ec55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:04.244283 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57774ed1-a742-4148-aa7f-13e85d9ec55d None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:04.244567 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57774ed1-a742-4148-aa7f-13e85d9ec55d None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:04.244883 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57774ed1-a742-4148-aa7f-13e85d9ec55d None admin] PATH_INFO: `/v3/projects/f3405afff58e4b59b53402e93ac8c6a3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:04.246147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57774ed1-a742-4148-aa7f-13e85d9ec55d None admin] RBAC: Authorizing `identity:get_project(project_id=f3405afff58e4b59b53402e93ac8c6a3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:04.247600 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57774ed1-a742-4148-aa7f-13e85d9ec55d None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:04.249315 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 601/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Wed Jun 15 00:24:04 2022] GET /identity/v3/projects/f3405afff58e4b59b53402e93ac8c6a3 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:04.256448 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba25f77-7293-4d1b-9af3-6604ef315f35 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:24:04.296393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:04.361295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba25f77-7293-4d1b-9af3-6604ef315f35 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:24:04.399868 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e603a-9ab8-419f-8e1f-c901d181565b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:24:04.400613 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e603a-9ab8-419f-8e1f-c901d181565b None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:24:04.400900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e603a-9ab8-419f-8e1f-c901d181565b None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:24:04.401185 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e603a-9ab8-419f-8e1f-c901d181565b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:24:04.402068 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e603a-9ab8-419f-8e1f-c901d181565b None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=f3405afff58e4b59b53402e93ac8c6a3, user.id=37caecb18a544fd8bd56df54090b428a) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:24:04.402384 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e603a-9ab8-419f-8e1f-c901d181565b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:24:04.403836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e603a-9ab8-419f-8e1f-c901d181565b None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:24:04.409923 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 599/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:24:04 2022] GET /identity/v3/role_assignments?user.id=37caecb18a544fd8bd56df54090b428a&scope.project.id=f3405afff58e4b59b53402e93ac8c6a3&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:24:14.238708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=64 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:24:14.407147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=50 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:00.420396 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac2d81-06cf-4a36-8f7e-ecd831afee50 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:00.421014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac2d81-06cf-4a36-8f7e-ecd831afee50 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:00.421125 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac2d81-06cf-4a36-8f7e-ecd831afee50 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:00.422696 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 602/1201] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:25:00.428861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745cc92-8ecf-463b-97ca-2873aa1f0f3e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:00.429475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745cc92-8ecf-463b-97ca-2873aa1f0f3e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:00.429655 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745cc92-8ecf-463b-97ca-2873aa1f0f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:00.457756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d745cc92-8ecf-463b-97ca-2873aa1f0f3e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:25:00.459178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d745cc92-8ecf-463b-97ca-2873aa1f0f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:25:00.545415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 600/1202] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:25:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:25:00.570712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac2d81-06cf-4a36-8f7e-ecd831afee50 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:00.707720 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac2d81-06cf-4a36-8f7e-ecd831afee50 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:00.753375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e40ebc-d1ec-45f3-8ed3-04a07d4e6734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:00.754272 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e40ebc-d1ec-45f3-8ed3-04a07d4e6734 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:00.754518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e40ebc-d1ec-45f3-8ed3-04a07d4e6734 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:00.754784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e40ebc-d1ec-45f3-8ed3-04a07d4e6734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:00.769032 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e40ebc-d1ec-45f3-8ed3-04a07d4e6734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:00.770807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e40ebc-d1ec-45f3-8ed3-04a07d4e6734 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:00.791128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-a2e40ebc-d1ec-45f3-8ed3-04a07d4e6734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:00.791128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:00.791128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:00.791128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:00.791128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:00.791128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:00.791128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:00.791128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:00.791128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:00.791128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:00.791128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:00.791128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:00.791128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:25:00.791128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:25:00.791128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:00.792534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:00.794585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:25:00.794585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:25:00.794585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:00.794585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:25:00.794585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 603/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:00.799319 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745cc92-8ecf-463b-97ca-2873aa1f0f3e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:00.930460 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745cc92-8ecf-463b-97ca-2873aa1f0f3e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:00.973879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:00.982482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cbb4c-f816-4520-91f3-ac67c209ec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:00.982482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cbb4c-f816-4520-91f3-ac67c209ec26 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:00.982482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cbb4c-f816-4520-91f3-ac67c209ec26 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:00.982482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cbb4c-f816-4520-91f3-ac67c209ec26 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:00.982980 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cbb4c-f816-4520-91f3-ac67c209ec26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:00.983285 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cbb4c-f816-4520-91f3-ac67c209ec26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:00.984762 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cbb4c-f816-4520-91f3-ac67c209ec26 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:01.003399 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 601/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:01.004789 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e40ebc-d1ec-45f3-8ed3-04a07d4e6734 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:01.080012 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:01.143894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e40ebc-d1ec-45f3-8ed3-04a07d4e6734 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:01.189444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236ce1b-1aef-4f22-91c3-3991735b31f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:01.190224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236ce1b-1aef-4f22-91c3-3991735b31f0 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:01.190659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236ce1b-1aef-4f22-91c3-3991735b31f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:01.191122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236ce1b-1aef-4f22-91c3-3991735b31f0 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:01.192132 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236ce1b-1aef-4f22-91c3-3991735b31f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:01.193963 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236ce1b-1aef-4f22-91c3-3991735b31f0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:01.229469 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 604/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Wed Jun 15 00:25:01 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:25:03.564652 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94854d-704b-4727-9af8-98b9d4d4a513 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:03.565245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94854d-704b-4727-9af8-98b9d4d4a513 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:03.565245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94854d-704b-4727-9af8-98b9d4d4a513 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:03.566640 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 602/1206] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:25:03.572640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042597d-71c3-46e2-a525-76cbb76de75d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:03.573099 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042597d-71c3-46e2-a525-76cbb76de75d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:03.573188 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042597d-71c3-46e2-a525-76cbb76de75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:03.591377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0042597d-71c3-46e2-a525-76cbb76de75d None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:25:03.592823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0042597d-71c3-46e2-a525-76cbb76de75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:25:03.670859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 605/1207] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:25:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:25:03.694037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94854d-704b-4727-9af8-98b9d4d4a513 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:03.805420 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94854d-704b-4727-9af8-98b9d4d4a513 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:03.843400 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6828ef0-6f0f-4294-8b86-a88843db78f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:03.844304 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6828ef0-6f0f-4294-8b86-a88843db78f3 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:03.844685 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6828ef0-6f0f-4294-8b86-a88843db78f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:03.845061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6828ef0-6f0f-4294-8b86-a88843db78f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:03.862459 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6828ef0-6f0f-4294-8b86-a88843db78f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:25:03.871000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-f6828ef0-6f0f-4294-8b86-a88843db78f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:25:03.871000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:03.871000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:03.871000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:03.871000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:03.871000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:03.871000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:03.871000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:03.871000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:03.871000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:03.871000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:03.871000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:03.871000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:25:03.871000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:25:03.871000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:25:03.871000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:25:03.872196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:25:03.872196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:25:03.872196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:25:03.872196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:25:03.872196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:03.872196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:03.872196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:03.872196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:03.872196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:03.872196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:03.872196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:03.872196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:03.872196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:03.872196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:03.872196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:03.872196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:03.873079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:03.873079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:03.873079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:03.873079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:03.873079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:25:03.873079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:25:03.873079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:25:03.873079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:25:03.873079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:25:03.873079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:25:03.873079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:25:03.873079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:03.873079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 603/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:25:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:25:03.879025 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042597d-71c3-46e2-a525-76cbb76de75d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:03.925037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:03.996327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042597d-71c3-46e2-a525-76cbb76de75d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:04.032105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeec94a-17f6-4e75-bfe0-04c3b5726290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:04.032776 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeec94a-17f6-4e75-bfe0-04c3b5726290 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:04.033081 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeec94a-17f6-4e75-bfe0-04c3b5726290 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:04.033398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeec94a-17f6-4e75-bfe0-04c3b5726290 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:04.034161 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeec94a-17f6-4e75-bfe0-04c3b5726290 None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:04.034481 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeec94a-17f6-4e75-bfe0-04c3b5726290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:04.035839 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeec94a-17f6-4e75-bfe0-04c3b5726290 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:04.045403 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 606/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:25:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:04.050892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6828ef0-6f0f-4294-8b86-a88843db78f3 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:04.109715 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:04.183088 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6828ef0-6f0f-4294-8b86-a88843db78f3 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:04.222090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b89ae-fa7e-4ca7-a228-8e321bd46bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:04.222852 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b89ae-fa7e-4ca7-a228-8e321bd46bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:04.223138 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b89ae-fa7e-4ca7-a228-8e321bd46bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:04.223412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b89ae-fa7e-4ca7-a228-8e321bd46bb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:04.235307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b89ae-fa7e-4ca7-a228-8e321bd46bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:04.237201 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b89ae-fa7e-4ca7-a228-8e321bd46bb6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:04.256890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-1e4b89ae-fa7e-4ca7-a228-8e321bd46bb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:04.256890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:04.256890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:04.256890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:04.256890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:04.256890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:04.256890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:04.256890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:04.256890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:04.256890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:04.256890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:04.256890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:04.256890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:25:04.256890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:25:04.256890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:04.258181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:04.259165 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:25:04.259165 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:25:04.259165 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:04.259165 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:04.259165 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 604/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:04.264584 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeec94a-17f6-4e75-bfe0-04c3b5726290 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:04.381991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:04.386958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeec94a-17f6-4e75-bfe0-04c3b5726290 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:04.429556 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbe423-b863-4ad9-94ed-65c3672bb93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:04.430267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe423-b863-4ad9-94ed-65c3672bb93a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:04.430556 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe423-b863-4ad9-94ed-65c3672bb93a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:04.430863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe423-b863-4ad9-94ed-65c3672bb93a None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:04.431937 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbe423-b863-4ad9-94ed-65c3672bb93a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:04.432289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbe423-b863-4ad9-94ed-65c3672bb93a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:04.433900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbe423-b863-4ad9-94ed-65c3672bb93a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:04.450331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 607/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:04.456545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b89ae-fa7e-4ca7-a228-8e321bd46bb6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:04.575857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b89ae-fa7e-4ca7-a228-8e321bd46bb6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:04.578255 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:04.615524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d78f0b-b69d-4576-9d87-f5df396f283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:04.616410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d78f0b-b69d-4576-9d87-f5df396f283a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:04.616693 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d78f0b-b69d-4576-9d87-f5df396f283a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:04.616965 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d78f0b-b69d-4576-9d87-f5df396f283a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:04.625118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d78f0b-b69d-4576-9d87-f5df396f283a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:04.626605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d78f0b-b69d-4576-9d87-f5df396f283a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:04.644371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c6d78f0b-b69d-4576-9d87-f5df396f283a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:25:04.644371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:04.644371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:04.644371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:04.644371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:04.644371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:04.644371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:04.644371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:04.644371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:04.644371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:04.644371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:04.644371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:04.644371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:25:04.644371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:25:04.644371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:25:04.644371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:04.650680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:04.651898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:04.651898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:04.651898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:25:04.651898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:25:04.651898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:25:04.651898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:25:04.651898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:25:04.651898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:25:04.651898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:25:04.651898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:04.651898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 605/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:04.653775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbe423-b863-4ad9-94ed-65c3672bb93a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:04.770116 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbe423-b863-4ad9-94ed-65c3672bb93a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:04.811439 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d112f-c19f-4e0e-a319-8d7caf58a3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:04.812255 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d112f-c19f-4e0e-a319-8d7caf58a3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:04.812635 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d112f-c19f-4e0e-a319-8d7caf58a3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:04.812948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d112f-c19f-4e0e-a319-8d7caf58a3d3 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:04.815575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d112f-c19f-4e0e-a319-8d7caf58a3d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:04.815575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d112f-c19f-4e0e-a319-8d7caf58a3d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:04.817232 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d112f-c19f-4e0e-a319-8d7caf58a3d3 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:04.836957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 608/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Jun 15 00:25:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:04.842884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d78f0b-b69d-4576-9d87-f5df396f283a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:04.960054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d78f0b-b69d-4576-9d87-f5df396f283a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:05.007857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d4052-1796-4735-81ef-588db69068b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:05.008606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d4052-1796-4735-81ef-588db69068b0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:05.008900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d4052-1796-4735-81ef-588db69068b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:05.009222 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d4052-1796-4735-81ef-588db69068b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:05.055953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:05.102320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d4052-1796-4735-81ef-588db69068b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:05.104457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d4052-1796-4735-81ef-588db69068b0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:05.222844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 606/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:25:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 00:25:05.229336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d112f-c19f-4e0e-a319-8d7caf58a3d3 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:05.254329 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:05.339951 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d112f-c19f-4e0e-a319-8d7caf58a3d3 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:05.388068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d79e6-71e4-426b-979d-2cd7e9113e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:05.389080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d79e6-71e4-426b-979d-2cd7e9113e90 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:05.389418 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d79e6-71e4-426b-979d-2cd7e9113e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:05.389734 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d79e6-71e4-426b-979d-2cd7e9113e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:05.404075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d79e6-71e4-426b-979d-2cd7e9113e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:05.405758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d79e6-71e4-426b-979d-2cd7e9113e90 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:05.428280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-f56d79e6-71e4-426b-979d-2cd7e9113e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:05.428280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:05.428280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:05.428280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:05.428280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:05.428280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:05.428280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:05.428280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:05.428280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:05.428280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:05.428280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:05.428280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:05.428280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:25:05.428280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:25:05.428280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:05.429737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:05.430829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:25:05.430829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:25:05.430829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:05.430829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:25:05.430829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 609/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:05.435952 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d4052-1796-4735-81ef-588db69068b0 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:05.505655 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:05.550070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d4052-1796-4735-81ef-588db69068b0 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:05.590106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631e6fd-c975-4124-b794-9d494e9c9bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:05.590806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631e6fd-c975-4124-b794-9d494e9c9bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:05.591058 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631e6fd-c975-4124-b794-9d494e9c9bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:05.591335 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631e6fd-c975-4124-b794-9d494e9c9bc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:05.592064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631e6fd-c975-4124-b794-9d494e9c9bc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:05.592378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631e6fd-c975-4124-b794-9d494e9c9bc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:05.593902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631e6fd-c975-4124-b794-9d494e9c9bc2 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:05.607235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 607/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:05.613967 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d79e6-71e4-426b-979d-2cd7e9113e90 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:05.697722 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:05.735408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d79e6-71e4-426b-979d-2cd7e9113e90 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:05.774730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965287d5-ee39-462c-804d-b0001caae779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:05.775914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965287d5-ee39-462c-804d-b0001caae779 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:05.776397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965287d5-ee39-462c-804d-b0001caae779 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:05.776849 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965287d5-ee39-462c-804d-b0001caae779 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:05.783980 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965287d5-ee39-462c-804d-b0001caae779 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:05.785682 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965287d5-ee39-462c-804d-b0001caae779 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:05.802262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-965287d5-ee39-462c-804d-b0001caae779 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:25:05.802262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:05.802262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:05.802262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:05.802262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:05.802262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:05.802262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:05.802262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:05.802262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:05.802262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:05.802262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:05.802262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:05.802262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:25:05.802262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:25:05.802262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:05.803503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:05.805143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:25:05.805143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:25:05.805143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:25:05.805143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:25:05.805143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:25:05.805143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:25:05.805143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:25:05.805143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:25:05.807641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 610/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:25:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:05.814432 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631e6fd-c975-4124-b794-9d494e9c9bc2 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:05.930877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631e6fd-c975-4124-b794-9d494e9c9bc2 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:05.966133 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:05.980655 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d3aee-e141-4194-b503-6b2306c75cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:05.981592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d3aee-e141-4194-b503-6b2306c75cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:05.981905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d3aee-e141-4194-b503-6b2306c75cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:05.982201 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d3aee-e141-4194-b503-6b2306c75cb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:05.983139 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d3aee-e141-4194-b503-6b2306c75cb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:05.983491 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d3aee-e141-4194-b503-6b2306c75cb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:05.985054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d3aee-e141-4194-b503-6b2306c75cb2 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:05.999672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 608/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:25:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:06.005594 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965287d5-ee39-462c-804d-b0001caae779 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:06.132417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965287d5-ee39-462c-804d-b0001caae779 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:06.167693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:06.175025 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759f216-9f42-4884-bd38-8aae8811089c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:06.175828 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759f216-9f42-4884-bd38-8aae8811089c None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:06.176213 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759f216-9f42-4884-bd38-8aae8811089c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:06.176591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759f216-9f42-4884-bd38-8aae8811089c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:06.177648 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759f216-9f42-4884-bd38-8aae8811089c None admin] RBAC: Adding query filter params (role.id=4afb8bd8c6354dd9b143ef4aaa8284fa, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=24e6dd029a3d45f6aeb4da06db9753dc) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:06.178034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759f216-9f42-4884-bd38-8aae8811089c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:06.179904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759f216-9f42-4884-bd38-8aae8811089c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:06.197379 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 611/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:25:06 2022] GET /identity/v3/role_assignments?user.id=24e6dd029a3d45f6aeb4da06db9753dc&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=4afb8bd8c6354dd9b143ef4aaa8284fa => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:08.318781 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbbb63-1bb8-4747-b23e-60506ef34da9 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:08.319554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbbb63-1bb8-4747-b23e-60506ef34da9 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:08.319554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbbb63-1bb8-4747-b23e-60506ef34da9 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:08.320663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 609/1220] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:25:08.326199 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179559e9-410f-4cd4-a76f-c9dba38c8686 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:08.326671 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179559e9-410f-4cd4-a76f-c9dba38c8686 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:08.326770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179559e9-410f-4cd4-a76f-c9dba38c8686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:08.346025 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-179559e9-410f-4cd4-a76f-c9dba38c8686 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:25:08.347384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-179559e9-410f-4cd4-a76f-c9dba38c8686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:25:08.432066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 612/1221] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:25:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:25:08.454904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbbb63-1bb8-4747-b23e-60506ef34da9 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:08.562403 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbbb63-1bb8-4747-b23e-60506ef34da9 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:08.601325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea71b3-e40f-4fc4-816e-42f5aab0208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:08.602087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea71b3-e40f-4fc4-816e-42f5aab0208e None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:08.602371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea71b3-e40f-4fc4-816e-42f5aab0208e None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:08.602643 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea71b3-e40f-4fc4-816e-42f5aab0208e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:08.613031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea71b3-e40f-4fc4-816e-42f5aab0208e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:25:08.621270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-f8ea71b3-e40f-4fc4-816e-42f5aab0208e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:25:08.621270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:08.621270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:08.621270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:08.621270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:08.621270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:08.621270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:08.621270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:08.621270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:08.621270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:08.621270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:08.621270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:08.621270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:25:08.621270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:25:08.621270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:25:08.621270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:25:08.622470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:25:08.622470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:25:08.622470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:25:08.622470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:25:08.622470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:08.622470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:08.622470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:08.622470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:08.622470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:08.622470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:08.622470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:08.622470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:08.622470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:08.622470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:08.622470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:08.622470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:08.629654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:08.629654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:08.629654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:08.629654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:08.629654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:25:08.629654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:25:08.629654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:25:08.629654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:25:08.629654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:25:08.629654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:25:08.629654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:25:08.629654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:08.629654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 610/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:25:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:08.630525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179559e9-410f-4cd4-a76f-c9dba38c8686 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:08.737809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179559e9-410f-4cd4-a76f-c9dba38c8686 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:08.761125 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:08.776874 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d849f6e-d944-4318-8845-d4e6e47b93ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:08.777597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d849f6e-d944-4318-8845-d4e6e47b93ce None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:08.777881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d849f6e-d944-4318-8845-d4e6e47b93ce None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:08.778156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d849f6e-d944-4318-8845-d4e6e47b93ce None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:08.778910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d849f6e-d944-4318-8845-d4e6e47b93ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:08.779227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d849f6e-d944-4318-8845-d4e6e47b93ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:08.780590 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d849f6e-d944-4318-8845-d4e6e47b93ce None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:08.788825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 613/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:25:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:08.795353 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea71b3-e40f-4fc4-816e-42f5aab0208e None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:08.850587 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:08.913880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea71b3-e40f-4fc4-816e-42f5aab0208e None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:08.949949 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27368e42-16c9-45ab-acfa-4533ce456415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:08.950770 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27368e42-16c9-45ab-acfa-4533ce456415 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:08.951055 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27368e42-16c9-45ab-acfa-4533ce456415 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:08.951331 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27368e42-16c9-45ab-acfa-4533ce456415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:08.962441 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27368e42-16c9-45ab-acfa-4533ce456415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:08.964038 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27368e42-16c9-45ab-acfa-4533ce456415 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:08.982320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-27368e42-16c9-45ab-acfa-4533ce456415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:08.982320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:08.982320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:08.982320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:08.982320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:08.982320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:08.982320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:08.982320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:08.982320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:08.982320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:08.982320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:08.982320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:08.982320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:25:08.982320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:25:08.982320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:08.983480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:08.989779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:25:08.989779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:25:08.989779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:08.989779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:08.989779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 611/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:08.990139 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d849f6e-d944-4318-8845-d4e6e47b93ce None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:09.098054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d849f6e-d944-4318-8845-d4e6e47b93ce None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:09.136371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0644f4-5eff-4eb3-aff0-c904369a21d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:09.137075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0644f4-5eff-4eb3-aff0-c904369a21d1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:09.137415 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0644f4-5eff-4eb3-aff0-c904369a21d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:09.137770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0644f4-5eff-4eb3-aff0-c904369a21d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:09.138539 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0644f4-5eff-4eb3-aff0-c904369a21d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:09.138889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0644f4-5eff-4eb3-aff0-c904369a21d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:09.140481 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0644f4-5eff-4eb3-aff0-c904369a21d1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:09.154988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 614/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:25:09.162915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27368e42-16c9-45ab-acfa-4533ce456415 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:09.271943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:09.280662 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27368e42-16c9-45ab-acfa-4533ce456415 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:09.318152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da19d9-37a2-45b7-8b3d-24a6fdebb636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:09.318968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da19d9-37a2-45b7-8b3d-24a6fdebb636 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:09.319604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da19d9-37a2-45b7-8b3d-24a6fdebb636 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:09.319604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da19d9-37a2-45b7-8b3d-24a6fdebb636 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:09.326986 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da19d9-37a2-45b7-8b3d-24a6fdebb636 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:09.328440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da19d9-37a2-45b7-8b3d-24a6fdebb636 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:09.342975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-26da19d9-37a2-45b7-8b3d-24a6fdebb636 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:25:09.342975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:09.342975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:09.342975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:09.342975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:09.342975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:09.342975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:09.342975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:09.342975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:09.342975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:09.342975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:09.342975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:09.342975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:25:09.342975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:25:09.342975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:25:09.342975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:09.344254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:09.345624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:09.345624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:09.345624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:25:09.345624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:25:09.345624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:25:09.345624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:25:09.345624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:25:09.345624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:25:09.345624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:25:09.345624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:09.345624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 612/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:09.350261 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0644f4-5eff-4eb3-aff0-c904369a21d1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:09.401365 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:09.456201 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0644f4-5eff-4eb3-aff0-c904369a21d1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:09.492513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014a4f6-be09-48f5-8d70-654c87421d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:09.493191 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014a4f6-be09-48f5-8d70-654c87421d37 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:09.493514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014a4f6-be09-48f5-8d70-654c87421d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:09.493787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014a4f6-be09-48f5-8d70-654c87421d37 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:09.494645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014a4f6-be09-48f5-8d70-654c87421d37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:09.494935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014a4f6-be09-48f5-8d70-654c87421d37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:09.496405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014a4f6-be09-48f5-8d70-654c87421d37 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:09.514628 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 615/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Jun 15 00:25:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:09.520868 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da19d9-37a2-45b7-8b3d-24a6fdebb636 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:09.638089 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da19d9-37a2-45b7-8b3d-24a6fdebb636 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:09.676152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9070e0-dd6e-4431-a8d9-daaf3515f1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:09.677057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9070e0-dd6e-4431-a8d9-daaf3515f1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:09.677717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9070e0-dd6e-4431-a8d9-daaf3515f1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:09.678098 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9070e0-dd6e-4431-a8d9-daaf3515f1e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:09.689564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9070e0-dd6e-4431-a8d9-daaf3515f1e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:09.690996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9070e0-dd6e-4431-a8d9-daaf3515f1e8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:09.709269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-fe9070e0-dd6e-4431-a8d9-daaf3515f1e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:09.709269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:09.709269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:09.709269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:09.709269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:09.709269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:09.709269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:09.709269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:09.709269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:09.709269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:09.709269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:09.709269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:09.709269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:25:09.709269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:25:09.709269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:09.710412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:09.711342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:25:09.711342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:25:09.711342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:09.711342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:09.711342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 613/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:09.716787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014a4f6-be09-48f5-8d70-654c87421d37 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:09.833685 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014a4f6-be09-48f5-8d70-654c87421d37 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:09.836358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:09.871877 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fce4f5-ddf5-4afd-b56c-985150c83ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:09.872551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fce4f5-ddf5-4afd-b56c-985150c83ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:09.872832 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fce4f5-ddf5-4afd-b56c-985150c83ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:09.873151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fce4f5-ddf5-4afd-b56c-985150c83ef4 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:09.873958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fce4f5-ddf5-4afd-b56c-985150c83ef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:09.874222 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fce4f5-ddf5-4afd-b56c-985150c83ef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:09.875776 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fce4f5-ddf5-4afd-b56c-985150c83ef4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:09.888194 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 616/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:09.894595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9070e0-dd6e-4431-a8d9-daaf3515f1e8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:09.904468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:10.001900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9070e0-dd6e-4431-a8d9-daaf3515f1e8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:10.038181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0728a-4cfa-4461-a217-26ad006ef6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:10.038993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0728a-4cfa-4461-a217-26ad006ef6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:10.039274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0728a-4cfa-4461-a217-26ad006ef6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:10.039548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0728a-4cfa-4461-a217-26ad006ef6c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:10.046835 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0728a-4cfa-4461-a217-26ad006ef6c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:10.048496 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0728a-4cfa-4461-a217-26ad006ef6c3 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:10.064204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-09a0728a-4cfa-4461-a217-26ad006ef6c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:25:10.064204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:10.064204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:10.064204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:10.064204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:10.064204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:10.064204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:10.064204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:10.064204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:10.064204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:10.064204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:10.064204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:10.064204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:25:10.064204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:25:10.064204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:10.065391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:10.066307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:25:10.066307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:25:10.066307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:25:10.066307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:25:10.066307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:25:10.066307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:25:10.066307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:25:10.066307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:10.066307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 614/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:25:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:25:10.071849 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fce4f5-ddf5-4afd-b56c-985150c83ef4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:10.177091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fce4f5-ddf5-4afd-b56c-985150c83ef4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:10.210668 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ef4aa-70da-4b14-b83c-e45368677157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:10.211336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ef4aa-70da-4b14-b83c-e45368677157 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:10.211620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ef4aa-70da-4b14-b83c-e45368677157 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:10.211902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ef4aa-70da-4b14-b83c-e45368677157 None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:10.212689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ef4aa-70da-4b14-b83c-e45368677157 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:10.212990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ef4aa-70da-4b14-b83c-e45368677157 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:10.214458 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ef4aa-70da-4b14-b83c-e45368677157 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:10.226723 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 617/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:25:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:10.233746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0728a-4cfa-4461-a217-26ad006ef6c3 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:10.310132 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:10.347581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0728a-4cfa-4461-a217-26ad006ef6c3 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:10.390779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee7d91-c976-4573-a703-3bbba4e0e420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:10.391942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee7d91-c976-4573-a703-3bbba4e0e420 None admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:10.392298 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee7d91-c976-4573-a703-3bbba4e0e420 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:10.392576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee7d91-c976-4573-a703-3bbba4e0e420 None admin] PATH_INFO: `/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/24e6dd029a3d45f6aeb4da06db9753dc/roles/4afb8bd8c6354dd9b143ef4aaa8284fa` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:10.408952 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee7d91-c976-4573-a703-3bbba4e0e420 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc0f2a3e075946f1ad06146dfa252aa6, user_id=24e6dd029a3d45f6aeb4da06db9753dc, role_id=4afb8bd8c6354dd9b143ef4aaa8284fa)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:10.410938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee7d91-c976-4573-a703-3bbba4e0e420 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:10.425734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 615/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:25:10 2022] PUT /identity/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/24e6dd029a3d45f6aeb4da06db9753dc/roles/4afb8bd8c6354dd9b143ef4aaa8284fa => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:25:12.704818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8bd2b-85fb-447f-b5c9-3d0dda32d6f7 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:12.705453 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8bd2b-85fb-447f-b5c9-3d0dda32d6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:12.705453 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8bd2b-85fb-447f-b5c9-3d0dda32d6f7 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:12.706787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 618/1233] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:25:12.712505 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bdded-e586-4f9e-9637-70aa807c6692 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:12.712891 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bdded-e586-4f9e-9637-70aa807c6692 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:12.713091 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bdded-e586-4f9e-9637-70aa807c6692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:12.731049 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-713bdded-e586-4f9e-9637-70aa807c6692 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:25:12.732271 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-713bdded-e586-4f9e-9637-70aa807c6692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:25:12.809451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 616/1234] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:25:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 15 00:25:12.838194 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8bd2b-85fb-447f-b5c9-3d0dda32d6f7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:12.868442 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:12.952964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8bd2b-85fb-447f-b5c9-3d0dda32d6f7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:12.989610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc6a18-b323-4663-a1c2-64a8e876526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:12.990351 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc6a18-b323-4663-a1c2-64a8e876526a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:12.990639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc6a18-b323-4663-a1c2-64a8e876526a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:12.990918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc6a18-b323-4663-a1c2-64a8e876526a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:13.001535 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc6a18-b323-4663-a1c2-64a8e876526a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:25:13.009372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-7ebc6a18-b323-4663-a1c2-64a8e876526a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:25:13.009372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:13.009372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:13.009372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:13.009372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:13.009372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:13.009372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:13.009372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:13.009372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:13.009372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:13.009372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:13.009372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:13.009372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:25:13.009372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:25:13.009372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:25:13.009372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:25:13.010564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:25:13.010564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:25:13.010564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:25:13.010564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:25:13.010564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:13.010564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:13.010564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:13.010564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:13.010564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:13.010564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:13.010564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:13.010564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:13.010564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:13.010564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:13.010564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:13.010564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:13.011440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:13.011440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:13.011440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:13.011440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:13.011440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:25:13.011440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:25:13.011440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:25:13.011440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:25:13.011440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:25:13.011440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:25:13.011440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 15 00:25:13.011440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:25:13.011440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 619/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Wed Jun 15 00:25:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:13.017196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bdded-e586-4f9e-9637-70aa807c6692 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:13.068964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:13.122283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bdded-e586-4f9e-9637-70aa807c6692 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:13.157664 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459b9eb-db1f-45e1-a915-08bc1aa0272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:13.158346 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459b9eb-db1f-45e1-a915-08bc1aa0272d None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:13.158709 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459b9eb-db1f-45e1-a915-08bc1aa0272d None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:13.158990 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459b9eb-db1f-45e1-a915-08bc1aa0272d None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:13.159876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459b9eb-db1f-45e1-a915-08bc1aa0272d None admin] RBAC: Adding query filter params (name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:13.160217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459b9eb-db1f-45e1-a915-08bc1aa0272d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:13.161673 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459b9eb-db1f-45e1-a915-08bc1aa0272d None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:13.171377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 617/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Wed Jun 15 00:25:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:13.177900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc6a18-b323-4663-a1c2-64a8e876526a None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:13.275242 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:13.294519 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc6a18-b323-4663-a1c2-64a8e876526a None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:13.333819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e242b-ce8e-425f-8d52-747404987778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:13.334634 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e242b-ce8e-425f-8d52-747404987778 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:13.334988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e242b-ce8e-425f-8d52-747404987778 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:13.335304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e242b-ce8e-425f-8d52-747404987778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:13.347178 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e242b-ce8e-425f-8d52-747404987778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:13.348812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e242b-ce8e-425f-8d52-747404987778 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:13.369753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-094e242b-ce8e-425f-8d52-747404987778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:13.369753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:13.369753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:13.369753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:13.369753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:13.369753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:13.369753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:13.369753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:13.369753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:13.369753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:13.369753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:13.369753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:13.369753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:25:13.369753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:25:13.369753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:13.370795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:13.371705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:25:13.371705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:25:13.371705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:13.371705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:25:13.371705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 620/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:13.377254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459b9eb-db1f-45e1-a915-08bc1aa0272d None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:13.483606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459b9eb-db1f-45e1-a915-08bc1aa0272d None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:13.493444 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:13.519329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb84bd-2ec9-4e70-ad1f-10163d56bfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:13.520866 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb84bd-2ec9-4e70-ad1f-10163d56bfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:13.520866 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb84bd-2ec9-4e70-ad1f-10163d56bfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:13.520866 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb84bd-2ec9-4e70-ad1f-10163d56bfd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:13.521253 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb84bd-2ec9-4e70-ad1f-10163d56bfd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:13.521581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb84bd-2ec9-4e70-ad1f-10163d56bfd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:13.523012 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb84bd-2ec9-4e70-ad1f-10163d56bfd6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:13.537142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 618/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:13.540729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e242b-ce8e-425f-8d52-747404987778 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:13.646144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e242b-ce8e-425f-8d52-747404987778 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:13.683447 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26067925-653b-4178-b41f-2d3f0dd198b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:13.684258 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26067925-653b-4178-b41f-2d3f0dd198b7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:13.684531 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26067925-653b-4178-b41f-2d3f0dd198b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:13.684799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26067925-653b-4178-b41f-2d3f0dd198b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:13.687682 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:13.694374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26067925-653b-4178-b41f-2d3f0dd198b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:13.697127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26067925-653b-4178-b41f-2d3f0dd198b7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:13.712787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-26067925-653b-4178-b41f-2d3f0dd198b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:25:13.712787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:13.712787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:13.712787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:13.712787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:13.712787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:13.712787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:13.712787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:13.712787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:13.712787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:13.712787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:13.712787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:13.712787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:25:13.712787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:25:13.712787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:25:13.712787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:13.714627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:13.715646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:13.715646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:13.715646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:25:13.715646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:25:13.715646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:25:13.715646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:25:13.715646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:25:13.715646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:25:13.715646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:25:13.715646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:25:13.715646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 621/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:13.720630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb84bd-2ec9-4e70-ad1f-10163d56bfd6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:13.834066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb84bd-2ec9-4e70-ad1f-10163d56bfd6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:13.873389 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7254efd-0956-4b1d-91ba-01fd52652694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:13.874256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7254efd-0956-4b1d-91ba-01fd52652694 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:13.874610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7254efd-0956-4b1d-91ba-01fd52652694 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:13.874894 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7254efd-0956-4b1d-91ba-01fd52652694 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:13.876125 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7254efd-0956-4b1d-91ba-01fd52652694 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:13.876451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7254efd-0956-4b1d-91ba-01fd52652694 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:13.877998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7254efd-0956-4b1d-91ba-01fd52652694 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:13.897366 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 619/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Jun 15 00:25:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:13.903238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26067925-653b-4178-b41f-2d3f0dd198b7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:14.035033 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26067925-653b-4178-b41f-2d3f0dd198b7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:14.078867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d5fc8-1ab2-4b89-97ee-5ad703d29f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:14.079542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5fc8-1ab2-4b89-97ee-5ad703d29f83 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:14.079934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5fc8-1ab2-4b89-97ee-5ad703d29f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:14.080354 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d5fc8-1ab2-4b89-97ee-5ad703d29f83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:14.152392 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:14.159988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d5fc8-1ab2-4b89-97ee-5ad703d29f83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:14.161660 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d5fc8-1ab2-4b89-97ee-5ad703d29f83 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:14.276542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 622/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:25:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 15 00:25:14.283562 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7254efd-0956-4b1d-91ba-01fd52652694 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:14.315058 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:14.403433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7254efd-0956-4b1d-91ba-01fd52652694 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:14.439274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539a3c9-54b4-47da-b497-5922d4b960a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:14.440088 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539a3c9-54b4-47da-b497-5922d4b960a0 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:14.440372 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539a3c9-54b4-47da-b497-5922d4b960a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:14.440646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539a3c9-54b4-47da-b497-5922d4b960a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:14.452262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539a3c9-54b4-47da-b497-5922d4b960a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:14.453906 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539a3c9-54b4-47da-b497-5922d4b960a0 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:14.473480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-2539a3c9-54b4-47da-b497-5922d4b960a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:14.473480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:14.473480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:14.473480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:14.473480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:14.473480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:14.473480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:14.473480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:14.473480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:14.473480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:14.473480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:14.473480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:14.473480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:25:14.473480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:25:14.473480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:14.474580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:14.475668 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:25:14.475668 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:25:14.475668 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:14.475668 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:14.475668 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 620/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:25:14.481112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d5fc8-1ab2-4b89-97ee-5ad703d29f83 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:14.600481 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:14.607797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d5fc8-1ab2-4b89-97ee-5ad703d29f83 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:14.645234 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e0f38-3873-4b8d-a21a-48523730ec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:14.646091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e0f38-3873-4b8d-a21a-48523730ec30 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:14.646386 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e0f38-3873-4b8d-a21a-48523730ec30 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:14.646667 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e0f38-3873-4b8d-a21a-48523730ec30 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:14.647429 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e0f38-3873-4b8d-a21a-48523730ec30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:14.647743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e0f38-3873-4b8d-a21a-48523730ec30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:14.649232 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e0f38-3873-4b8d-a21a-48523730ec30 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:14.667331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 623/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:25:14.668737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539a3c9-54b4-47da-b497-5922d4b960a0 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:14.760522 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:14.788190 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539a3c9-54b4-47da-b497-5922d4b960a0 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:14.839442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900176e-6995-4848-a371-4999e0d7c00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:14.840433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900176e-6995-4848-a371-4999e0d7c00c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:14.840722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900176e-6995-4848-a371-4999e0d7c00c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:14.841044 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900176e-6995-4848-a371-4999e0d7c00c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:14.850069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900176e-6995-4848-a371-4999e0d7c00c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:14.851848 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900176e-6995-4848-a371-4999e0d7c00c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:14.869784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-6900176e-6995-4848-a371-4999e0d7c00c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:25:14.869784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:14.869784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:14.869784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:14.869784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:14.869784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:14.869784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:14.869784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:14.869784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:14.869784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:14.869784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:14.869784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:14.869784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:25:14.869784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:25:14.869784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:14.871001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:14.871945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:25:14.871945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:25:14.871945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:25:14.871945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:25:14.871945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:25:14.871945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:25:14.871945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:25:14.871945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:14.871945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 621/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:25:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:14.877540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e0f38-3873-4b8d-a21a-48523730ec30 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:15.002391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e0f38-3873-4b8d-a21a-48523730ec30 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:15.042009 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad1672-ce9e-4cd8-be79-33db0653f7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:15.042679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad1672-ce9e-4cd8-be79-33db0653f7eb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:15.042968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad1672-ce9e-4cd8-be79-33db0653f7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:15.043248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad1672-ce9e-4cd8-be79-33db0653f7eb None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:15.044054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad1672-ce9e-4cd8-be79-33db0653f7eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:15.044370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad1672-ce9e-4cd8-be79-33db0653f7eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:15.045840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad1672-ce9e-4cd8-be79-33db0653f7eb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:15.060806 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 624/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:25:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:15.067170 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900176e-6995-4848-a371-4999e0d7c00c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:15.184083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900176e-6995-4848-a371-4999e0d7c00c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:15.222737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31e092-4378-4ead-859e-3e07da8be50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:15.223386 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31e092-4378-4ead-859e-3e07da8be50a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:15.223695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31e092-4378-4ead-859e-3e07da8be50a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:15.223998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31e092-4378-4ead-859e-3e07da8be50a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:15.224849 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31e092-4378-4ead-859e-3e07da8be50a None admin] RBAC: Adding query filter params (role.id=4afb8bd8c6354dd9b143ef4aaa8284fa, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=24e6dd029a3d45f6aeb4da06db9753dc) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:15.225160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31e092-4378-4ead-859e-3e07da8be50a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:15.226689 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31e092-4378-4ead-859e-3e07da8be50a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:15.232607 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 622/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:25:15 2022] GET /identity/v3/role_assignments?user.id=24e6dd029a3d45f6aeb4da06db9753dc&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=4afb8bd8c6354dd9b143ef4aaa8284fa => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:25:17.451688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a60e13-142a-43d1-9354-b65fe56f98ce None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:17.452224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a60e13-142a-43d1-9354-b65fe56f98ce None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:17.452332 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a60e13-142a-43d1-9354-b65fe56f98ce None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:17.454037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 625/1247] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:25:17.459256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b36cc0-6df5-43e9-982c-c9d53b0b5d67 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:17.459791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b36cc0-6df5-43e9-982c-c9d53b0b5d67 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:17.459941 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b36cc0-6df5-43e9-982c-c9d53b0b5d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:17.465309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:17.482427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-18b36cc0-6df5-43e9-982c-c9d53b0b5d67 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:25:17.483657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-18b36cc0-6df5-43e9-982c-c9d53b0b5d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:25:17.558361 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 623/1248] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:25:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:25:17.581933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a60e13-142a-43d1-9354-b65fe56f98ce None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:17.600930 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:17.690966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a60e13-142a-43d1-9354-b65fe56f98ce None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:17.728493 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4144c-72c0-40ec-84e6-8378eaaef2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:17.729235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4144c-72c0-40ec-84e6-8378eaaef2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:17.729550 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4144c-72c0-40ec-84e6-8378eaaef2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:17.729852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4144c-72c0-40ec-84e6-8378eaaef2b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:17.741263 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4144c-72c0-40ec-84e6-8378eaaef2b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:25:17.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-5dd4144c-72c0-40ec-84e6-8378eaaef2b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:25:17.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:17.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:17.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:17.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:17.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:17.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:17.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:17.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:17.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:17.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:17.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:17.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:25:17.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:25:17.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:25:17.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:25:17.750887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:25:17.750887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:25:17.750887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:25:17.750887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:25:17.750887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:17.750887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:17.750887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:17.750887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:17.750887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:17.750887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:17.750887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:17.750887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:17.750887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:17.750887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:17.750887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:17.750887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:17.752109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:17.752109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:17.752109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:17.752109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:17.752109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:25:17.752109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:25:17.752109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:25:17.752109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:25:17.752109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:25:17.752109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:25:17.752109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:25:17.752109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:25:17.752109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 626/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:25:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:17.757448 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b36cc0-6df5-43e9-982c-c9d53b0b5d67 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:17.876857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b36cc0-6df5-43e9-982c-c9d53b0b5d67 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:17.913455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:17.920181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207afee-4e63-40f0-9769-23e7c14ded40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:17.920958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207afee-4e63-40f0-9769-23e7c14ded40 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:17.921243 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207afee-4e63-40f0-9769-23e7c14ded40 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:17.921605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207afee-4e63-40f0-9769-23e7c14ded40 None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:17.922463 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207afee-4e63-40f0-9769-23e7c14ded40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:17.922806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207afee-4e63-40f0-9769-23e7c14ded40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:17.924382 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207afee-4e63-40f0-9769-23e7c14ded40 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:17.934587 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 624/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:25:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:17.940566 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4144c-72c0-40ec-84e6-8378eaaef2b1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:18.026509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:18.050239 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4144c-72c0-40ec-84e6-8378eaaef2b1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:18.088064 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccaffe-1ecb-4a95-ab61-d8d32bab0145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:18.088922 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccaffe-1ecb-4a95-ab61-d8d32bab0145 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:18.089204 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccaffe-1ecb-4a95-ab61-d8d32bab0145 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:18.089547 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccaffe-1ecb-4a95-ab61-d8d32bab0145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:18.100444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccaffe-1ecb-4a95-ab61-d8d32bab0145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:18.101925 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccaffe-1ecb-4a95-ab61-d8d32bab0145 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:18.119836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-17ccaffe-1ecb-4a95-ab61-d8d32bab0145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:18.119836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:18.119836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:18.119836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:18.119836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:18.119836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:18.119836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:18.119836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:18.119836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:18.119836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:18.119836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:18.119836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:18.119836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:25:18.119836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:25:18.119836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:18.121077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:18.122304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:25:18.122304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:25:18.122304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:18.122304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:25:18.122304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 627/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 15 00:25:18.127193 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207afee-4e63-40f0-9769-23e7c14ded40 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:18.231534 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207afee-4e63-40f0-9769-23e7c14ded40 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:18.269362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5736c42-b791-4875-b23c-584190f379ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:18.270120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5736c42-b791-4875-b23c-584190f379ab None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:18.270409 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5736c42-b791-4875-b23c-584190f379ab None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:18.270801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5736c42-b791-4875-b23c-584190f379ab None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:18.271636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5736c42-b791-4875-b23c-584190f379ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:18.271951 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5736c42-b791-4875-b23c-584190f379ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:18.273492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5736c42-b791-4875-b23c-584190f379ab None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:18.286561 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 625/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:18.292585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccaffe-1ecb-4a95-ab61-d8d32bab0145 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:18.401112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccaffe-1ecb-4a95-ab61-d8d32bab0145 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:18.429963 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:18.438824 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e495af-fb40-44ae-b01e-eb4538e89362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:18.439674 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e495af-fb40-44ae-b01e-eb4538e89362 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:18.439941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e495af-fb40-44ae-b01e-eb4538e89362 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:18.440205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e495af-fb40-44ae-b01e-eb4538e89362 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:18.448656 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e495af-fb40-44ae-b01e-eb4538e89362 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:18.450154 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e495af-fb40-44ae-b01e-eb4538e89362 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:18.464591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-69e495af-fb40-44ae-b01e-eb4538e89362 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:25:18.464591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:18.464591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:18.464591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:18.464591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:18.464591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:18.464591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:18.464591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:18.464591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:18.464591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:18.464591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:18.464591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:18.464591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:25:18.464591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:25:18.464591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:25:18.464591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:18.466467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:18.467525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:18.467525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:18.467525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:25:18.467525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:25:18.467525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:25:18.467525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:25:18.467525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:25:18.467525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:25:18.467525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:25:18.467525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:25:18.467525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 628/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:18.471897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5736c42-b791-4875-b23c-584190f379ab None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:18.534273 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:18.581585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5736c42-b791-4875-b23c-584190f379ab None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:18.621679 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc22d1-60b8-409f-a22f-cd21cbffab61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:18.622373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc22d1-60b8-409f-a22f-cd21cbffab61 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:18.622658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc22d1-60b8-409f-a22f-cd21cbffab61 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:18.622979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc22d1-60b8-409f-a22f-cd21cbffab61 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:18.623787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc22d1-60b8-409f-a22f-cd21cbffab61 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:18.624101 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc22d1-60b8-409f-a22f-cd21cbffab61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:18.625629 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc22d1-60b8-409f-a22f-cd21cbffab61 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:18.648769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 626/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Jun 15 00:25:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:18.654836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e495af-fb40-44ae-b01e-eb4538e89362 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:18.774068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e495af-fb40-44ae-b01e-eb4538e89362 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:18.810284 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6ceaa-62c6-4574-a93a-fcfd2927d188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:18.811032 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6ceaa-62c6-4574-a93a-fcfd2927d188 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:18.811409 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6ceaa-62c6-4574-a93a-fcfd2927d188 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:18.811689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6ceaa-62c6-4574-a93a-fcfd2927d188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:18.883253 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:18.897372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6ceaa-62c6-4574-a93a-fcfd2927d188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:18.899049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6ceaa-62c6-4574-a93a-fcfd2927d188 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:19.003571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 629/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:25:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:25:19.009742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc22d1-60b8-409f-a22f-cd21cbffab61 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:19.121171 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc22d1-60b8-409f-a22f-cd21cbffab61 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:19.135232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:19.157207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1d772-dc18-4030-923f-e9adeb7e779c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:19.158186 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1d772-dc18-4030-923f-e9adeb7e779c None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:19.158507 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1d772-dc18-4030-923f-e9adeb7e779c None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:19.158869 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1d772-dc18-4030-923f-e9adeb7e779c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:19.170464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1d772-dc18-4030-923f-e9adeb7e779c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:19.171942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1d772-dc18-4030-923f-e9adeb7e779c None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:19.191275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-aac1d772-dc18-4030-923f-e9adeb7e779c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:19.191275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:19.191275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:19.191275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:19.191275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:19.191275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:19.191275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:19.191275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:19.191275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:19.191275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:19.191275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:19.191275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:19.191275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:25:19.191275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:25:19.191275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:19.192421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:19.193571 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:25:19.193571 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:25:19.193571 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:19.193571 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:19.193571 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 627/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:19.198615 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6ceaa-62c6-4574-a93a-fcfd2927d188 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:19.294691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:19.311346 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6ceaa-62c6-4574-a93a-fcfd2927d188 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:19.350260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827de81-5735-4d38-89ea-31215f513dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:19.351040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827de81-5735-4d38-89ea-31215f513dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:19.351416 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827de81-5735-4d38-89ea-31215f513dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:19.351736 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827de81-5735-4d38-89ea-31215f513dd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:19.352526 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827de81-5735-4d38-89ea-31215f513dd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:19.352875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827de81-5735-4d38-89ea-31215f513dd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:19.354519 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827de81-5735-4d38-89ea-31215f513dd5 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:19.367900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 630/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:19.374166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1d772-dc18-4030-923f-e9adeb7e779c None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:19.484499 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1d772-dc18-4030-923f-e9adeb7e779c None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:19.527746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74507485-4f8f-44bf-b390-798538b8159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:19.528599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74507485-4f8f-44bf-b390-798538b8159f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:19.528879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74507485-4f8f-44bf-b390-798538b8159f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:19.529153 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74507485-4f8f-44bf-b390-798538b8159f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:19.536649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74507485-4f8f-44bf-b390-798538b8159f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:19.538472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74507485-4f8f-44bf-b390-798538b8159f None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:19.553622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-74507485-4f8f-44bf-b390-798538b8159f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:25:19.553622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:19.553622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:19.553622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:19.553622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:19.553622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:19.553622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:19.553622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:19.553622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:19.553622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:19.553622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:19.553622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:19.553622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:25:19.553622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:25:19.553622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:19.554746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:19.555801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:25:19.555801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:25:19.555801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:25:19.555801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:25:19.555801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:25:19.555801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:25:19.555801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:25:19.555801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:19.555801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 628/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:25:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:19.561749 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827de81-5735-4d38-89ea-31215f513dd5 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:19.668357 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827de81-5735-4d38-89ea-31215f513dd5 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:19.706036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19170d28-2854-4d86-9456-a7140874748a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:19.706848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19170d28-2854-4d86-9456-a7140874748a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:19.707132 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19170d28-2854-4d86-9456-a7140874748a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:19.707532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19170d28-2854-4d86-9456-a7140874748a None admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:19.708566 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19170d28-2854-4d86-9456-a7140874748a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:19.708878 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19170d28-2854-4d86-9456-a7140874748a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:19.710807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19170d28-2854-4d86-9456-a7140874748a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:19.725464 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 631/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:25:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:19.731921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74507485-4f8f-44bf-b390-798538b8159f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:19.761335 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:19.854044 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74507485-4f8f-44bf-b390-798538b8159f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:19.889940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa464dc-5740-46bc-a14c-158ecab57144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:19.890599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa464dc-5740-46bc-a14c-158ecab57144 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:19.890879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa464dc-5740-46bc-a14c-158ecab57144 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:19.891162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa464dc-5740-46bc-a14c-158ecab57144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:19.891981 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa464dc-5740-46bc-a14c-158ecab57144 None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=24e6dd029a3d45f6aeb4da06db9753dc) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:19.892287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa464dc-5740-46bc-a14c-158ecab57144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:19.893762 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa464dc-5740-46bc-a14c-158ecab57144 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:19.899610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 629/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:25:19 2022] GET /identity/v3/role_assignments?user.id=24e6dd029a3d45f6aeb4da06db9753dc&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:22.032250 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93e11-efe0-427a-bbb9-c40cb76a8f12 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:22.032908 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93e11-efe0-427a-bbb9-c40cb76a8f12 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:22.032908 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b93e11-efe0-427a-bbb9-c40cb76a8f12 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:22.034250 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 632/1261] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:25:22.040756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ada989-865c-489d-94fa-62e837c3a0a2 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:22.041530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ada989-865c-489d-94fa-62e837c3a0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:22.041694 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ada989-865c-489d-94fa-62e837c3a0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:22.069463 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-75ada989-865c-489d-94fa-62e837c3a0a2 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:25:22.070675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-75ada989-865c-489d-94fa-62e837c3a0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:25:22.141566 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 630/1262] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:25:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:25:22.164947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b93e11-efe0-427a-bbb9-c40cb76a8f12 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:22.183037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:22.292760 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b93e11-efe0-427a-bbb9-c40cb76a8f12 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:22.328049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342da550-1dc0-40ba-bfc8-f1c42393a76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:22.328843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342da550-1dc0-40ba-bfc8-f1c42393a76b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:22.329128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342da550-1dc0-40ba-bfc8-f1c42393a76b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:22.329404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342da550-1dc0-40ba-bfc8-f1c42393a76b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:22.340202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342da550-1dc0-40ba-bfc8-f1c42393a76b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:25:22.347904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-342da550-1dc0-40ba-bfc8-f1c42393a76b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:25:22.347904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:22.347904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:22.347904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:22.347904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:22.347904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:22.347904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:22.347904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:22.347904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:22.347904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:22.347904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:22.347904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:22.347904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:25:22.347904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:25:22.347904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:25:22.347904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:25:22.349053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:25:22.349053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:25:22.349053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:25:22.349053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:25:22.349053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:22.349053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:22.349053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:22.349053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:22.349053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:22.349053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:22.349053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:22.349053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:22.349053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:22.349053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:22.349053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:22.349053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:22.350259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:22.350259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:22.350259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:22.350259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:22.350259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:25:22.350259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:25:22.350259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:25:22.350259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:25:22.350259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:25:22.350259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:25:22.350259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:25:22.350259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:25:22.350259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 633/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:25:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:22.355353 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ada989-865c-489d-94fa-62e837c3a0a2 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:22.374801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:22.463831 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ada989-865c-489d-94fa-62e837c3a0a2 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:22.505660 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4813177-a823-409f-9520-b6fde33d3f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:22.506352 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4813177-a823-409f-9520-b6fde33d3f2a None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:22.506630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4813177-a823-409f-9520-b6fde33d3f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:22.506904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4813177-a823-409f-9520-b6fde33d3f2a None admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:22.507663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4813177-a823-409f-9520-b6fde33d3f2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:22.507968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4813177-a823-409f-9520-b6fde33d3f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:22.509383 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4813177-a823-409f-9520-b6fde33d3f2a None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:22.518326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 631/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:25:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:22.525036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342da550-1dc0-40ba-bfc8-f1c42393a76b None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:22.606115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:22.643341 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342da550-1dc0-40ba-bfc8-f1c42393a76b None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:22.681726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b531fa-216c-48b5-94cd-54e1f08a8184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:22.682517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b531fa-216c-48b5-94cd-54e1f08a8184 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:22.682802 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b531fa-216c-48b5-94cd-54e1f08a8184 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:22.683082 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b531fa-216c-48b5-94cd-54e1f08a8184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:22.693857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b531fa-216c-48b5-94cd-54e1f08a8184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:22.695314 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b531fa-216c-48b5-94cd-54e1f08a8184 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:22.712323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-10b531fa-216c-48b5-94cd-54e1f08a8184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:22.712323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:22.712323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:22.712323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:22.712323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:22.712323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:22.712323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:22.712323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:22.712323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:22.712323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:22.712323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:22.712323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:22.712323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:25:22.712323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:25:22.712323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:22.713391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:22.714337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:25:22.714337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:25:22.714337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:22.714337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:25:22.714337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 634/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:22.722545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4813177-a823-409f-9520-b6fde33d3f2a None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:22.824488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:22.845637 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4813177-a823-409f-9520-b6fde33d3f2a None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:22.881989 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de29265-9f04-43e9-b61a-3c4b0628feee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:22.882556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de29265-9f04-43e9-b61a-3c4b0628feee None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:22.882883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de29265-9f04-43e9-b61a-3c4b0628feee None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:22.883124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de29265-9f04-43e9-b61a-3c4b0628feee None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:22.883855 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de29265-9f04-43e9-b61a-3c4b0628feee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:22.884179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de29265-9f04-43e9-b61a-3c4b0628feee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:22.885599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de29265-9f04-43e9-b61a-3c4b0628feee None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:22.897746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 632/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:22.903776 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b531fa-216c-48b5-94cd-54e1f08a8184 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:23.007862 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b531fa-216c-48b5-94cd-54e1f08a8184 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:23.027752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:23.044481 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da445d4c-6e22-4772-a519-9c6bdd468af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:23.045284 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da445d4c-6e22-4772-a519-9c6bdd468af1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:23.045602 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da445d4c-6e22-4772-a519-9c6bdd468af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:23.045877 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da445d4c-6e22-4772-a519-9c6bdd468af1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:23.054313 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da445d4c-6e22-4772-a519-9c6bdd468af1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:23.055762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da445d4c-6e22-4772-a519-9c6bdd468af1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:23.070054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-da445d4c-6e22-4772-a519-9c6bdd468af1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:25:23.070054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:23.070054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:23.070054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:23.070054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:23.070054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:23.070054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:23.070054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:23.070054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:23.070054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:23.070054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:23.070054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:23.070054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:25:23.070054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:25:23.070054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:25:23.070054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:23.071158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:23.072349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:23.072349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:23.072349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:25:23.072349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:25:23.072349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:25:23.072349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:25:23.072349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:25:23.072349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:25:23.072349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:25:23.072349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:25:23.073548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 635/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:23.077021 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de29265-9f04-43e9-b61a-3c4b0628feee None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:23.183467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de29265-9f04-43e9-b61a-3c4b0628feee None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:23.218579 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f7a0e-a3fb-4c0c-97ec-efc471269420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:23.219248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f7a0e-a3fb-4c0c-97ec-efc471269420 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:23.219530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f7a0e-a3fb-4c0c-97ec-efc471269420 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:23.219806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f7a0e-a3fb-4c0c-97ec-efc471269420 None admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:23.220639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f7a0e-a3fb-4c0c-97ec-efc471269420 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:23.220953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f7a0e-a3fb-4c0c-97ec-efc471269420 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:23.222418 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f7a0e-a3fb-4c0c-97ec-efc471269420 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:23.231039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:23.243726 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 633/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Jun 15 00:25:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:23.249619 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da445d4c-6e22-4772-a519-9c6bdd468af1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:23.350911 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da445d4c-6e22-4772-a519-9c6bdd468af1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:23.385203 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09b5d-8c9c-4b19-8e1b-b89a63bedbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:23.386016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09b5d-8c9c-4b19-8e1b-b89a63bedbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:23.386296 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09b5d-8c9c-4b19-8e1b-b89a63bedbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:23.386569 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09b5d-8c9c-4b19-8e1b-b89a63bedbc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:23.397189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f09b5d-8c9c-4b19-8e1b-b89a63bedbc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:23.398663 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f09b5d-8c9c-4b19-8e1b-b89a63bedbc4 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:23.415538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-04f09b5d-8c9c-4b19-8e1b-b89a63bedbc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:23.415538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:23.415538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:23.415538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:23.415538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:23.415538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:23.415538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:23.415538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:23.415538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:23.415538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:23.415538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:23.415538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:23.415538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:25:23.415538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:25:23.415538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:23.416582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:23.417973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:25:23.417973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:25:23.417973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:23.417973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:25:23.417973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 636/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:23.425588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f7a0e-a3fb-4c0c-97ec-efc471269420 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:23.533678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f7a0e-a3fb-4c0c-97ec-efc471269420 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:23.568723 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8f452-2706-4a61-b782-c14a3308e6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:23.569392 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8f452-2706-4a61-b782-c14a3308e6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:23.569704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8f452-2706-4a61-b782-c14a3308e6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:23.569979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8f452-2706-4a61-b782-c14a3308e6d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:23.570709 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8f452-2706-4a61-b782-c14a3308e6d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:23.571015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8f452-2706-4a61-b782-c14a3308e6d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:23.572398 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8f452-2706-4a61-b782-c14a3308e6d8 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:23.583716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 634/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:23.590022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09b5d-8c9c-4b19-8e1b-b89a63bedbc4 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:23.625645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:23.704015 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f09b5d-8c9c-4b19-8e1b-b89a63bedbc4 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:23.739595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fc7b4-7a65-4fd4-a50f-66fc032a0ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:23.740394 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fc7b4-7a65-4fd4-a50f-66fc032a0ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:23.740726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fc7b4-7a65-4fd4-a50f-66fc032a0ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:23.740964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fc7b4-7a65-4fd4-a50f-66fc032a0ec0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:23.748018 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fc7b4-7a65-4fd4-a50f-66fc032a0ec0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:23.749501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fc7b4-7a65-4fd4-a50f-66fc032a0ec0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:23.763972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-f55fc7b4-7a65-4fd4-a50f-66fc032a0ec0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:25:23.763972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:23.763972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:23.763972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:23.763972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:23.763972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:23.763972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:23.763972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:23.763972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:23.763972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:23.763972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:23.763972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:23.763972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:25:23.763972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:25:23.763972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:23.764956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:23.766022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:25:23.766022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:25:23.766022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:25:23.766022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:25:23.766022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:25:23.766022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:25:23.766022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:25:23.766022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:25:23.766022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 637/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:25:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:23.771549 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8f452-2706-4a61-b782-c14a3308e6d8 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:23.838011 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:23.882054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8f452-2706-4a61-b782-c14a3308e6d8 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:23.924853 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8e099-00af-4df9-b9bf-bfd1a68db112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:23.925940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8e099-00af-4df9-b9bf-bfd1a68db112 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:23.926383 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8e099-00af-4df9-b9bf-bfd1a68db112 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:23.926821 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8e099-00af-4df9-b9bf-bfd1a68db112 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:23.928174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8e099-00af-4df9-b9bf-bfd1a68db112 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:23.928494 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8e099-00af-4df9-b9bf-bfd1a68db112 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:23.929998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8e099-00af-4df9-b9bf-bfd1a68db112 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:23.942779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 635/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:25:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:23.949217 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fc7b4-7a65-4fd4-a50f-66fc032a0ec0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:24.042553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:24.052532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fc7b4-7a65-4fd4-a50f-66fc032a0ec0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:24.090206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67739106-7c80-457f-bcaa-0afd8befe35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:24.091047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67739106-7c80-457f-bcaa-0afd8befe35c None admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:24.091321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67739106-7c80-457f-bcaa-0afd8befe35c None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:24.091595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67739106-7c80-457f-bcaa-0afd8befe35c None admin] PATH_INFO: `/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/24e6dd029a3d45f6aeb4da06db9753dc/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:24.093760 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67739106-7c80-457f-bcaa-0afd8befe35c None admin] RBAC: Authorizing `identity:create_grant(project_id=fc0f2a3e075946f1ad06146dfa252aa6, user_id=24e6dd029a3d45f6aeb4da06db9753dc, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:24.095197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67739106-7c80-457f-bcaa-0afd8befe35c None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:24.110600 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 638/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Wed Jun 15 00:25:23 2022] PUT /identity/v3/projects/fc0f2a3e075946f1ad06146dfa252aa6/users/24e6dd029a3d45f6aeb4da06db9753dc/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:25:26.155914 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed9f97-2178-44e5-86a4-73e4cd5915ff None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:26.156487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed9f97-2178-44e5-86a4-73e4cd5915ff None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:26.156487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed9f97-2178-44e5-86a4-73e4cd5915ff None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:26.158684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 636/1274] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:25:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:25:26.167295 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463b51c-0358-4823-918e-2d434d67496e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:26.167699 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463b51c-0358-4823-918e-2d434d67496e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:26.167978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463b51c-0358-4823-918e-2d434d67496e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:26.189364 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8463b51c-0358-4823-918e-2d434d67496e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:25:26.190585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8463b51c-0358-4823-918e-2d434d67496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:25:26.261265 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 639/1275] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:25:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:25:26.288851 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed9f97-2178-44e5-86a4-73e4cd5915ff None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:26.402358 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed9f97-2178-44e5-86a4-73e4cd5915ff None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:26.421574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:26.439566 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d0203-2fe9-4a7b-8153-16d4c038af0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:26.440369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d0203-2fe9-4a7b-8153-16d4c038af0f None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:26.440649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d0203-2fe9-4a7b-8153-16d4c038af0f None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:26.440921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d0203-2fe9-4a7b-8153-16d4c038af0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:26.451466 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d0203-2fe9-4a7b-8153-16d4c038af0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 15 00:25:26.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-075d0203-2fe9-4a7b-8153-16d4c038af0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:25:26.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:26.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:26.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:26.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:26.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:26.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:26.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:26.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:26.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:26.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:26.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:26.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 15 00:25:26.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 15 00:25:26.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 15 00:25:26.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 15 00:25:26.460287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 15 00:25:26.460287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 15 00:25:26.460287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 15 00:25:26.460287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 15 00:25:26.460287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:26.460287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:26.460287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:26.460287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:26.460287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:26.460287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:26.460287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:26.460287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:26.460287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:26.460287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:26.460287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:26.460287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:26.461393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:26.461393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:26.461393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:26.461393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:26.461393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 15 00:25:26.461393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 15 00:25:26.461393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 15 00:25:26.461393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 15 00:25:26.461393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 15 00:25:26.461393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 15 00:25:26.461393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 15 00:25:26.461393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:26.461393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 637/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Wed Jun 15 00:25:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:26.466550 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463b51c-0358-4823-918e-2d434d67496e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:26.555886 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:26.575047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463b51c-0358-4823-918e-2d434d67496e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:26.609748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927bbdf-c565-4fff-9a2d-3e3b46d73896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:26.610416 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927bbdf-c565-4fff-9a2d-3e3b46d73896 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:26.610702 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927bbdf-c565-4fff-9a2d-3e3b46d73896 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:26.610977 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927bbdf-c565-4fff-9a2d-3e3b46d73896 None admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:26.612105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927bbdf-c565-4fff-9a2d-3e3b46d73896 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:26.612409 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927bbdf-c565-4fff-9a2d-3e3b46d73896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:26.613814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927bbdf-c565-4fff-9a2d-3e3b46d73896 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:26.622005 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 640/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Wed Jun 15 00:25:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:25:26.631305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d0203-2fe9-4a7b-8153-16d4c038af0f None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:26.730123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d0203-2fe9-4a7b-8153-16d4c038af0f None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:26.765445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a828a8c-d9e9-40db-854e-acaa09f18203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:26.766227 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a828a8c-d9e9-40db-854e-acaa09f18203 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:26.766508 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a828a8c-d9e9-40db-854e-acaa09f18203 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:26.766783 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a828a8c-d9e9-40db-854e-acaa09f18203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:26.778837 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a828a8c-d9e9-40db-854e-acaa09f18203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:26.780281 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a828a8c-d9e9-40db-854e-acaa09f18203 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:26.798112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-4a828a8c-d9e9-40db-854e-acaa09f18203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:26.798112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:26.798112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:26.798112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:26.798112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:26.798112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:26.798112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:26.798112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:26.798112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:26.798112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:26.798112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:26.798112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:26.798112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:25:26.798112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:25:26.798112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:26.799277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:26.800380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:25:26.800380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:25:26.800380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:26.800380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:26.800380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 638/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:26.805758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927bbdf-c565-4fff-9a2d-3e3b46d73896 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:26.910199 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927bbdf-c565-4fff-9a2d-3e3b46d73896 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:26.946747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b0a47-5b68-4aa7-9722-064321e5f4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:26.947399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0a47-5b68-4aa7-9722-064321e5f4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:26.947677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0a47-5b68-4aa7-9722-064321e5f4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:26.947949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b0a47-5b68-4aa7-9722-064321e5f4d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:26.948659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b0a47-5b68-4aa7-9722-064321e5f4d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:26.948967 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b0a47-5b68-4aa7-9722-064321e5f4d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:26.950362 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b0a47-5b68-4aa7-9722-064321e5f4d0 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:26.962666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 641/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:26.968662 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a828a8c-d9e9-40db-854e-acaa09f18203 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:27.002096 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:27.076315 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a828a8c-d9e9-40db-854e-acaa09f18203 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:27.111105 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d50ff-e17b-444f-a5e5-bf29ecfa6311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:27.112283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d50ff-e17b-444f-a5e5-bf29ecfa6311 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:27.112564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d50ff-e17b-444f-a5e5-bf29ecfa6311 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:27.112839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d50ff-e17b-444f-a5e5-bf29ecfa6311 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:27.120392 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d50ff-e17b-444f-a5e5-bf29ecfa6311 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:27.121863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d50ff-e17b-444f-a5e5-bf29ecfa6311 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:27.136054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c05d50ff-e17b-444f-a5e5-bf29ecfa6311 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:25:27.136054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:27.136054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:27.136054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:27.136054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:27.136054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:27.136054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:27.136054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:27.136054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:27.136054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:27.136054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:27.136054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:27.136054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 15 00:25:27.136054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 15 00:25:27.136054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 15 00:25:27.136054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:27.137119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:27.138374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:27.138374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:27.138374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 15 00:25:27.138374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 15 00:25:27.138374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 15 00:25:27.138374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 15 00:25:27.138374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 15 00:25:27.138374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 15 00:25:27.138374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 15 00:25:27.138374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:27.138374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 639/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:27.143415 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b0a47-5b68-4aa7-9722-064321e5f4d0 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:27.147636 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:27.250182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b0a47-5b68-4aa7-9722-064321e5f4d0 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:27.286085 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69cd881-36e7-48dd-a076-6386bf1e56b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:27.286690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cd881-36e7-48dd-a076-6386bf1e56b7 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:27.286973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cd881-36e7-48dd-a076-6386bf1e56b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:27.287344 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cd881-36e7-48dd-a076-6386bf1e56b7 None admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:27.288188 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69cd881-36e7-48dd-a076-6386bf1e56b7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:27.288505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69cd881-36e7-48dd-a076-6386bf1e56b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:27.289979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69cd881-36e7-48dd-a076-6386bf1e56b7 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:27.306944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 642/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Jun 15 00:25:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:27.313316 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d50ff-e17b-444f-a5e5-bf29ecfa6311 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:27.411577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:27.421991 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d50ff-e17b-444f-a5e5-bf29ecfa6311 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:27.456701 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe07d5a-5732-4dc0-9dd6-1bd1dc3f84a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:27.457370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe07d5a-5732-4dc0-9dd6-1bd1dc3f84a6 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:27.457651 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe07d5a-5732-4dc0-9dd6-1bd1dc3f84a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:27.457927 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe07d5a-5732-4dc0-9dd6-1bd1dc3f84a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:27.527327 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe07d5a-5732-4dc0-9dd6-1bd1dc3f84a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:27.528776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe07d5a-5732-4dc0-9dd6-1bd1dc3f84a6 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:27.634018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:27.644973 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 640/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Wed Jun 15 00:25:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 15 00:25:27.651165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69cd881-36e7-48dd-a076-6386bf1e56b7 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:27.716719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:27.764674 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69cd881-36e7-48dd-a076-6386bf1e56b7 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:27.811141 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db508bd-8601-41e0-8111-640fe78d40cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:27.811938 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db508bd-8601-41e0-8111-640fe78d40cb None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:27.812221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db508bd-8601-41e0-8111-640fe78d40cb None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:27.812557 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db508bd-8601-41e0-8111-640fe78d40cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:27.826774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db508bd-8601-41e0-8111-640fe78d40cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:27.828919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db508bd-8601-41e0-8111-640fe78d40cb None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:27.847782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-8db508bd-8601-41e0-8111-640fe78d40cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:27.847782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:27.847782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:27.847782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:27.847782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:27.847782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:27.847782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:27.847782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:27.847782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:27.847782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:27.847782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:27.847782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:27.847782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 15 00:25:27.847782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 15 00:25:27.847782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:27.848799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:27.849788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 15 00:25:27.849788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 15 00:25:27.849788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 15 00:25:27.849788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:25:27.849788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 643/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:27.855009 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe07d5a-5732-4dc0-9dd6-1bd1dc3f84a6 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:27.958752 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe07d5a-5732-4dc0-9dd6-1bd1dc3f84a6 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:27.993948 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc46d9-42d2-4f2a-af44-a78621b1f506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:27.994609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc46d9-42d2-4f2a-af44-a78621b1f506 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:27.994889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc46d9-42d2-4f2a-af44-a78621b1f506 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:27.995165 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc46d9-42d2-4f2a-af44-a78621b1f506 None admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:27.995883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc46d9-42d2-4f2a-af44-a78621b1f506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:27.996193 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc46d9-42d2-4f2a-af44-a78621b1f506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:27.997596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc46d9-42d2-4f2a-af44-a78621b1f506 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:28.008775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 641/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Wed Jun 15 00:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:28.014908 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db508bd-8601-41e0-8111-640fe78d40cb None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:28.119660 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db508bd-8601-41e0-8111-640fe78d40cb None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:28.133635 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:28.167113 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee92c3-5975-43f1-81ea-6712dc5c54a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:28.167924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee92c3-5975-43f1-81ea-6712dc5c54a1 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:28.168212 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee92c3-5975-43f1-81ea-6712dc5c54a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:28.168490 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee92c3-5975-43f1-81ea-6712dc5c54a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:28.175482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee92c3-5975-43f1-81ea-6712dc5c54a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:28.176946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee92c3-5975-43f1-81ea-6712dc5c54a1 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:28.190933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application [None req-3fee92c3-5975-43f1-81ea-6712dc5c54a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:25:28.190933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:28.190933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:28.190933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:28.190933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:28.190933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:28.190933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:28.190933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:28.190933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:28.190933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:28.190933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:28.190933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:28.190933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 15 00:25:28.190933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 15 00:25:28.190933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:28.191813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:28.192731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 15 00:25:28.192731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 15 00:25:28.192731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 15 00:25:28.192731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 15 00:25:28.192731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 15 00:25:28.192731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 15 00:25:28.192731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 15 00:25:28.192731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: ERROR keystone.server.flask.application Jun 15 00:25:28.192731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 644/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Wed Jun 15 00:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:28.202024 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc46d9-42d2-4f2a-af44-a78621b1f506 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:28.264485 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:28.317601 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc46d9-42d2-4f2a-af44-a78621b1f506 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:28.352146 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c83b6-9b36-47ea-bbf2-4414fd32f316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:28.352785 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c83b6-9b36-47ea-bbf2-4414fd32f316 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:28.353067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c83b6-9b36-47ea-bbf2-4414fd32f316 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:28.353373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c83b6-9b36-47ea-bbf2-4414fd32f316 None admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:28.354167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c83b6-9b36-47ea-bbf2-4414fd32f316 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:28.354478 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c83b6-9b36-47ea-bbf2-4414fd32f316 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:28.355920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c83b6-9b36-47ea-bbf2-4414fd32f316 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:28.368251 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 642/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Wed Jun 15 00:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:28.375054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee92c3-5975-43f1-81ea-6712dc5c54a1 None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:28.500576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee92c3-5975-43f1-81ea-6712dc5c54a1 None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:28.540693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f2de2-8b77-48cc-bb0b-edadb5944968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:28.541263 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f2de2-8b77-48cc-bb0b-edadb5944968 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:28.541582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f2de2-8b77-48cc-bb0b-edadb5944968 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:28.541858 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f2de2-8b77-48cc-bb0b-edadb5944968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:28.542679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f2de2-8b77-48cc-bb0b-edadb5944968 None admin] RBAC: Adding query filter params (role.id=6181294868a04e3890ff8a30bafdccf3, scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6, user.id=24e6dd029a3d45f6aeb4da06db9753dc) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:28.542993 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f2de2-8b77-48cc-bb0b-edadb5944968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:28.544428 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f2de2-8b77-48cc-bb0b-edadb5944968 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:28.551124 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 645/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Wed Jun 15 00:25:28 2022] GET /identity/v3/role_assignments?user.id=24e6dd029a3d45f6aeb4da06db9753dc&scope.project.id=fc0f2a3e075946f1ad06146dfa252aa6&role.id=6181294868a04e3890ff8a30bafdccf3 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:30.662011 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648b369-25fa-4b03-9a4b-e92e4af3f62e None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:30.662964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648b369-25fa-4b03-9a4b-e92e4af3f62e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:30.662964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648b369-25fa-4b03-9a4b-e92e4af3f62e None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:30.665105 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 643/1288] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:25:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:25:30.673903 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ef209-676c-4941-bb68-d4853ba0baa2 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:30.674307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ef209-676c-4941-bb68-d4853ba0baa2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:30.674507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ef209-676c-4941-bb68-d4853ba0baa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:30.694881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3b7ef209-676c-4941-bb68-d4853ba0baa2 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:25:30.696085 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3b7ef209-676c-4941-bb68-d4853ba0baa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:25:30.729177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:30.769770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 646/1289] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:25:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:25:30.803094 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648b369-25fa-4b03-9a4b-e92e4af3f62e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:30.921024 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648b369-25fa-4b03-9a4b-e92e4af3f62e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:30.931658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:30.958018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf51cd5-a7ca-496b-ac2c-6f8adb8ddac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:30.958844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf51cd5-a7ca-496b-ac2c-6f8adb8ddac4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:30.959127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf51cd5-a7ca-496b-ac2c-6f8adb8ddac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:30.959402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf51cd5-a7ca-496b-ac2c-6f8adb8ddac4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:30.960426 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf51cd5-a7ca-496b-ac2c-6f8adb8ddac4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:30.965730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf51cd5-a7ca-496b-ac2c-6f8adb8ddac4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-baf51cd5-a7ca-496b-ac2c-6f8adb8ddac4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:30.978602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:30.979958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:30.979958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:30.979958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:30.979958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:30.979958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:30.979958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:30.979958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:25:30.979958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:25:30.979958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:25:30.979958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:25:30.979958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:30.979958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:30.979958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:30.979958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:30.979958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:30.979958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:30.981036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:30.981036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:30.981036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:30.981036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:30.981036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:30.981036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:30.981036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:30.981036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:30.981036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:30.981036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:30.981036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:25:30.981036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:25:30.981036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:25:30.981036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:30.984898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 644/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 15 00:25:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:30.986083 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ef209-676c-4941-bb68-d4853ba0baa2 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:31.088492 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ef209-676c-4941-bb68-d4853ba0baa2 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:31.124057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9e105-e4af-4cf5-a706-eb6e9954a5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:31.124718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9e105-e4af-4cf5-a706-eb6e9954a5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:31.125005 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9e105-e4af-4cf5-a706-eb6e9954a5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:31.125281 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9e105-e4af-4cf5-a706-eb6e9954a5a8 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:31.126026 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9e105-e4af-4cf5-a706-eb6e9954a5a8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:31.126331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9e105-e4af-4cf5-a706-eb6e9954a5a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:31.127721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9e105-e4af-4cf5-a706-eb6e9954a5a8 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:31.132949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 647/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Wed Jun 15 00:25:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:31.139120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf51cd5-a7ca-496b-ac2c-6f8adb8ddac4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:31.244798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf51cd5-a7ca-496b-ac2c-6f8adb8ddac4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:31.279451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ae862-7bf7-47bf-bd23-9e648ac2f0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:31.280103 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ae862-7bf7-47bf-bd23-9e648ac2f0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:31.280390 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ae862-7bf7-47bf-bd23-9e648ac2f0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:31.280666 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ae862-7bf7-47bf-bd23-9e648ac2f0b1 None admin] PATH_INFO: `/v3/services` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:31.281389 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ae862-7bf7-47bf-bd23-9e648ac2f0b1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:31.281716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ae862-7bf7-47bf-bd23-9e648ac2f0b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:31.283092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ae862-7bf7-47bf-bd23-9e648ac2f0b1 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:31.287871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 645/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Wed Jun 15 00:25:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:33.383653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e7421-6663-4a61-8a1d-7ee2e0b97590 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:33.384468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e7421-6663-4a61-8a1d-7ee2e0b97590 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:33.384468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e7421-6663-4a61-8a1d-7ee2e0b97590 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:33.386657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 648/1293] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:25:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:25:33.392046 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab1ec4-57f7-4a30-8be1-9bc985c9a1fc None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:33.392496 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab1ec4-57f7-4a30-8be1-9bc985c9a1fc None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:33.392589 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab1ec4-57f7-4a30-8be1-9bc985c9a1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:33.411335 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-f0ab1ec4-57f7-4a30-8be1-9bc985c9a1fc None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:25:33.412515 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f0ab1ec4-57f7-4a30-8be1-9bc985c9a1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:25:33.445209 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:33.482773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 646/1294] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:25:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:25:33.506942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e7421-6663-4a61-8a1d-7ee2e0b97590 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:33.551143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:33.628006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e7421-6663-4a61-8a1d-7ee2e0b97590 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:33.663370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcc58d-263c-40bc-a424-845a12eed4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:33.664010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcc58d-263c-40bc-a424-845a12eed4b6 None admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:33.664290 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcc58d-263c-40bc-a424-845a12eed4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:33.664563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcc58d-263c-40bc-a424-845a12eed4b6 None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:33.665289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcc58d-263c-40bc-a424-845a12eed4b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:33.666880 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcc58d-263c-40bc-a424-845a12eed4b6 None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:33.681688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 649/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Wed Jun 15 00:25:33 2022] POST /identity/v3/services => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:25:35.752781 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f27fe3-0452-4207-a5b7-e8e5d1469bf6 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:35.753690 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f27fe3-0452-4207-a5b7-e8e5d1469bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:35.753690 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f27fe3-0452-4207-a5b7-e8e5d1469bf6 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:35.755927 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 647/1296] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:25:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:25:35.762427 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76347a58-af47-404a-b559-cfb39572fa90 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:35.763133 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76347a58-af47-404a-b559-cfb39572fa90 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:35.763248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76347a58-af47-404a-b559-cfb39572fa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:35.790460 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-76347a58-af47-404a-b559-cfb39572fa90 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:25:35.791638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-76347a58-af47-404a-b559-cfb39572fa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:25:35.877394 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 650/1297] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:25:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:25:35.898279 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f27fe3-0452-4207-a5b7-e8e5d1469bf6 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:36.005989 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f27fe3-0452-4207-a5b7-e8e5d1469bf6 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:36.041540 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffad62-9dbf-4d20-8dd3-5dceac7a13d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:36.042339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffad62-9dbf-4d20-8dd3-5dceac7a13d4 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:36.042619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffad62-9dbf-4d20-8dd3-5dceac7a13d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:36.042897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ffad62-9dbf-4d20-8dd3-5dceac7a13d4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:36.043550 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffad62-9dbf-4d20-8dd3-5dceac7a13d4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:36.044918 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ffad62-9dbf-4d20-8dd3-5dceac7a13d4 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-c9ffad62-9dbf-4d20-8dd3-5dceac7a13d4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:36.056890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:36.058083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:36.058083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:36.058083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:36.058083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:36.058083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:36.058083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:36.058083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:25:36.058083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:25:36.058083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:25:36.058083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:25:36.058083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:36.058083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:36.058083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:36.058083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:36.058083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:36.058083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:36.059152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:36.059152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:36.059152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:36.059152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:36.059152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:36.059152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:36.059152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:36.059152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:36.059152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:36.059152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:36.059152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:25:36.059152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:25:36.059152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:25:36.059152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:36.059152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 648/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 15 00:25:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:36.066342 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76347a58-af47-404a-b559-cfb39572fa90 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:36.087361 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:36.167944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76347a58-af47-404a-b559-cfb39572fa90 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:36.203471 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9246cd-67a4-4518-b54f-1966686f1dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:36.204132 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9246cd-67a4-4518-b54f-1966686f1dca None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:36.204411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9246cd-67a4-4518-b54f-1966686f1dca None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:36.204688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9246cd-67a4-4518-b54f-1966686f1dca None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:36.205410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9246cd-67a4-4518-b54f-1966686f1dca None admin] RBAC: Adding query filter params (name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:36.205725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9246cd-67a4-4518-b54f-1966686f1dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:36.207097 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9246cd-67a4-4518-b54f-1966686f1dca None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:36.212356 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 651/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Wed Jun 15 00:25:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:36.222140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffad62-9dbf-4d20-8dd3-5dceac7a13d4 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:36.257665 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:36.326772 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ffad62-9dbf-4d20-8dd3-5dceac7a13d4 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:36.361670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b67541-a94d-49e3-a373-f443e43ce4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:36.362320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b67541-a94d-49e3-a373-f443e43ce4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:36.362599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b67541-a94d-49e3-a373-f443e43ce4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:36.362876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b67541-a94d-49e3-a373-f443e43ce4e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:36.363673 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b67541-a94d-49e3-a373-f443e43ce4e5 None admin] RBAC: Adding query filter params (interface=public, service_id=6fddf43b8ec84908af5d22dbca24baed, region_id=RegionOne) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:36.363987 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b67541-a94d-49e3-a373-f443e43ce4e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:36.365390 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b67541-a94d-49e3-a373-f443e43ce4e5 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:36.372703 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 649/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Wed Jun 15 00:25:36 2022] GET /identity/v3/endpoints?service_id=6fddf43b8ec84908af5d22dbca24baed&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:36.380237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9246cd-67a4-4518-b54f-1966686f1dca None admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:36.467976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:36.487974 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9246cd-67a4-4518-b54f-1966686f1dca None admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:36.522584 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d529ed2-c780-49f8-b651-669ab4a97e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:36.523222 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d529ed2-c780-49f8-b651-669ab4a97e7a None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:36.523501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d529ed2-c780-49f8-b651-669ab4a97e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:36.523778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d529ed2-c780-49f8-b651-669ab4a97e7a None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:36.524463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d529ed2-c780-49f8-b651-669ab4a97e7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:36.525881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d529ed2-c780-49f8-b651-669ab4a97e7a None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:36.532672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 652/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Wed Jun 15 00:25:36 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:25:38.614568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed88788-aef0-4bf7-8417-608926297312 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:38.615482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed88788-aef0-4bf7-8417-608926297312 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:38.615482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed88788-aef0-4bf7-8417-608926297312 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:38.617725 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 650/1302] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:25:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:25:38.626496 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b448f-b1b6-43f0-976d-145d6e2de050 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:38.626901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b448f-b1b6-43f0-976d-145d6e2de050 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:38.627085 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b448f-b1b6-43f0-976d-145d6e2de050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:38.647724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-481b448f-b1b6-43f0-976d-145d6e2de050 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:25:38.648921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-481b448f-b1b6-43f0-976d-145d6e2de050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:25:38.720001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 653/1303] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:25:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 15 00:25:38.743697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed88788-aef0-4bf7-8417-608926297312 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:38.855082 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:38.863122 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed88788-aef0-4bf7-8417-608926297312 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:38.897462 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971f364-77d5-4546-943a-3368f01d6ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:38.898308 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971f364-77d5-4546-943a-3368f01d6ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:38.898596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971f364-77d5-4546-943a-3368f01d6ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:38.898874 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971f364-77d5-4546-943a-3368f01d6ad7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:38.899534 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971f364-77d5-4546-943a-3368f01d6ad7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:38.900910 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4971f364-77d5-4546-943a-3368f01d6ad7 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application [None req-4971f364-77d5-4546-943a-3368f01d6ad7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 15 00:25:38.913081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 15 00:25:38.914245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 15 00:25:38.914245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 15 00:25:38.914245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 15 00:25:38.914245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 15 00:25:38.914245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 15 00:25:38.914245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 15 00:25:38.914245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 15 00:25:38.914245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 15 00:25:38.914245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 15 00:25:38.914245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 15 00:25:38.914245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 15 00:25:38.914245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 15 00:25:38.914245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 15 00:25:38.914245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 15 00:25:38.914245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 15 00:25:38.914245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.get_or_create( Jun 15 00:25:38.915424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 15 00:25:38.915424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application with Lock( Jun 15 00:25:38.915424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 15 00:25:38.915424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self._enter() Jun 15 00:25:38.915424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 15 00:25:38.915424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 15 00:25:38.915424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 15 00:25:38.915424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application return self.creator() Jun 15 00:25:38.915424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 15 00:25:38.915424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application created_value = creator( Jun 15 00:25:38.915424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 15 00:25:38.915424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 15 00:25:38.915424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 15 00:25:38.915424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: ERROR keystone.server.flask.application Jun 15 00:25:38.917512 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 651/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Jun 15 00:25:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 15 00:25:38.920922 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b448f-b1b6-43f0-976d-145d6e2de050 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:39.001914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:39.028535 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b448f-b1b6-43f0-976d-145d6e2de050 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:39.063731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd1ad5-ab0c-450c-acc2-619da96fd71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:39.064401 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd1ad5-ab0c-450c-acc2-619da96fd71b None admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:39.064689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd1ad5-ab0c-450c-acc2-619da96fd71b None admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:39.064973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd1ad5-ab0c-450c-acc2-619da96fd71b None admin] PATH_INFO: `/v3/services` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:39.065714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd1ad5-ab0c-450c-acc2-619da96fd71b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:25:39.066022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd1ad5-ab0c-450c-acc2-619da96fd71b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:39.067398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd1ad5-ab0c-450c-acc2-619da96fd71b None admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:39.073233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 654/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Wed Jun 15 00:25:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:25:39.079230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971f364-77d5-4546-943a-3368f01d6ad7 None admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:25:39.186330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971f364-77d5-4546-943a-3368f01d6ad7 None admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:25:39.220620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91ee45-4ae9-4648-9356-e6d031ef6d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:25:39.221273 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91ee45-4ae9-4648-9356-e6d031ef6d68 None admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:25:39.221590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91ee45-4ae9-4648-9356-e6d031ef6d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:25:39.221867 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91ee45-4ae9-4648-9356-e6d031ef6d68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:25:39.222611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91ee45-4ae9-4648-9356-e6d031ef6d68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:25:39.223992 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91ee45-4ae9-4648-9356-e6d031ef6d68 None admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:25:39.246331 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 652/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Wed Jun 15 00:25:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:25:49.069948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=30 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:25:49.241670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:42.133390 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70871607-83b3-41b6-b097-54da8d2a83b6 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:42.133862 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70871607-83b3-41b6-b097-54da8d2a83b6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:42.133954 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70871607-83b3-41b6-b097-54da8d2a83b6 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:42.140570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffaaec-a1b0-45c5-b99a-57c5f3f8ce1e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:42.140982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffaaec-a1b0-45c5-b99a-57c5f3f8ce1e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:42.141143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffaaec-a1b0-45c5-b99a-57c5f3f8ce1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:42.144828 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 655/1307] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:26:42 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:26:42.259283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-74ffaaec-a1b0-45c5-b99a-57c5f3f8ce1e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:42.261700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-74ffaaec-a1b0-45c5-b99a-57c5f3f8ce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:42.403925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 653/1308] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:26:42.450955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122512a9-4b8c-4773-9bc0-39a6bcd021fb None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:42.451429 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122512a9-4b8c-4773-9bc0-39a6bcd021fb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:42.451975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122512a9-4b8c-4773-9bc0-39a6bcd021fb None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:42.453857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 656/1309] 10.222.0.36 () {54 vars in 964 bytes} [Wed Jun 15 00:26:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:26:42.460531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ea4fa-6342-476f-a657-7c6816d9e51d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:42.460833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ea4fa-6342-476f-a657-7c6816d9e51d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:42.461110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ea4fa-6342-476f-a657-7c6816d9e51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:42.549670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-566ea4fa-6342-476f-a657-7c6816d9e51d None None] MFA Rules not processed for user `46c398ec4dcc438895f054f616fc9e41`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:42.550909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-566ea4fa-6342-476f-a657-7c6816d9e51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:42.574545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:42.636364 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 654/1310] 10.222.0.36 () {58 vars in 1061 bytes} [Wed Jun 15 00:26:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:26:42.645722 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122512a9-4b8c-4773-9bc0-39a6bcd021fb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:42.647646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-122512a9-4b8c-4773-9bc0-39a6bcd021fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:42.764868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122512a9-4b8c-4773-9bc0-39a6bcd021fb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:42.842497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30d386-9bcb-41eb-9d09-7da772f3a3f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:42.843337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30d386-9bcb-41eb-9d09-7da772f3a3f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:42.843732 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30d386-9bcb-41eb-9d09-7da772f3a3f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:42.844122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30d386-9bcb-41eb-9d09-7da772f3a3f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:42.845929 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4f30d386-9bcb-41eb-9d09-7da772f3a3f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:42.899077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:42.957271 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30d386-9bcb-41eb-9d09-7da772f3a3f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:42.958966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30d386-9bcb-41eb-9d09-7da772f3a3f2 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:42.978316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 657/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:26:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:26:45.351326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38972fd-5d3d-4206-9d1c-303d7b6334d4 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:45.351843 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38972fd-5d3d-4206-9d1c-303d7b6334d4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:45.351843 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38972fd-5d3d-4206-9d1c-303d7b6334d4 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:45.353372 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 655/1312] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:26:45.358435 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a993f1-d9be-412b-ba87-328dee16c6e4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:45.358827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a993f1-d9be-412b-ba87-328dee16c6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:45.359005 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a993f1-d9be-412b-ba87-328dee16c6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:45.440978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-79a993f1-d9be-412b-ba87-328dee16c6e4 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:45.442295 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-79a993f1-d9be-412b-ba87-328dee16c6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:45.553601 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 658/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:26:45.604033 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba5177-d124-4bab-8306-94cd162f6329 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:45.604231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba5177-d124-4bab-8306-94cd162f6329 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:45.604490 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba5177-d124-4bab-8306-94cd162f6329 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:45.605967 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 656/1314] 10.222.0.36 () {54 vars in 964 bytes} [Wed Jun 15 00:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:26:45.612755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5da85f-1f4a-4c8c-86fd-98780a998f77 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:45.613052 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5da85f-1f4a-4c8c-86fd-98780a998f77 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:45.613333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5da85f-1f4a-4c8c-86fd-98780a998f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:45.624305 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:45.694817 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4b5da85f-1f4a-4c8c-86fd-98780a998f77 None None] MFA Rules not processed for user `46c398ec4dcc438895f054f616fc9e41`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:45.695876 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4b5da85f-1f4a-4c8c-86fd-98780a998f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:45.777032 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 659/1315] 10.222.0.36 () {58 vars in 1061 bytes} [Wed Jun 15 00:26:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:26:45.786358 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba5177-d124-4bab-8306-94cd162f6329 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:45.787878 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7bba5177-d124-4bab-8306-94cd162f6329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:45.898503 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba5177-d124-4bab-8306-94cd162f6329 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:45.973387 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:45.976109 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0232f-130f-40e8-a0e4-c9e0f14814c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:45.976946 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0232f-130f-40e8-a0e4-c9e0f14814c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:45.977477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0232f-130f-40e8-a0e4-c9e0f14814c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:45.977912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0232f-130f-40e8-a0e4-c9e0f14814c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:45.979567 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-90f0232f-130f-40e8-a0e4-c9e0f14814c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:46.099786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0232f-130f-40e8-a0e4-c9e0f14814c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:46.101270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0232f-130f-40e8-a0e4-c9e0f14814c6 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:46.120894 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 657/1316] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:26:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:26:48.756602 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb472812-309c-41a4-9f33-c31aa0e6d41f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:48.757094 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb472812-309c-41a4-9f33-c31aa0e6d41f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:48.757094 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb472812-309c-41a4-9f33-c31aa0e6d41f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:48.758580 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 660/1317] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:26:48.763923 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c5043-ed30-4654-8f3e-567a0e9fab71 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:48.764342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c5043-ed30-4654-8f3e-567a0e9fab71 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:48.764477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c5043-ed30-4654-8f3e-567a0e9fab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:48.836229 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-470c5043-ed30-4654-8f3e-567a0e9fab71 None None] MFA Rules not processed for user `f889fd589b2d4d67ac66dc372869f6fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:48.837506 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-470c5043-ed30-4654-8f3e-567a0e9fab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:48.902067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:48.950385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 658/1318] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:26:48 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:26:48.993968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb472812-309c-41a4-9f33-c31aa0e6d41f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:48.996380 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fb472812-309c-41a4-9f33-c31aa0e6d41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:49.109077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb472812-309c-41a4-9f33-c31aa0e6d41f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:49.112358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:49.184047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12e261-8b5b-4966-8463-71369bf34db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:49.184695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12e261-8b5b-4966-8463-71369bf34db8 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:49.184981 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12e261-8b5b-4966-8463-71369bf34db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:49.185261 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12e261-8b5b-4966-8463-71369bf34db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:49.186922 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ea12e261-8b5b-4966-8463-71369bf34db8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:49.306031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12e261-8b5b-4966-8463-71369bf34db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:49.308040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12e261-8b5b-4966-8463-71369bf34db8 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:49.330794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 661/1319] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:26:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:26:51.979775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b197e4-6745-4aa5-9924-97a552856c0f None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:51.980341 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b197e4-6745-4aa5-9924-97a552856c0f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:51.980341 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b197e4-6745-4aa5-9924-97a552856c0f None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:51.981815 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 659/1320] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:26:51.988570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700ce8c-4d78-443c-beae-1667b50dd7cf None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:51.989299 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700ce8c-4d78-443c-beae-1667b50dd7cf None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:51.989503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700ce8c-4d78-443c-beae-1667b50dd7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:52.036323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:52.066793 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4700ce8c-4d78-443c-beae-1667b50dd7cf None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:52.068483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4700ce8c-4d78-443c-beae-1667b50dd7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:52.171025 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 662/1321] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:26:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:26:52.213261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b197e4-6745-4aa5-9924-97a552856c0f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:52.216192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c5b197e4-6745-4aa5-9924-97a552856c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:52.325550 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b197e4-6745-4aa5-9924-97a552856c0f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:52.402386 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c05051-ff74-4289-bf20-e1033878e8f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:52.403118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c05051-ff74-4289-bf20-e1033878e8f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:52.403405 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c05051-ff74-4289-bf20-e1033878e8f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:52.403684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c05051-ff74-4289-bf20-e1033878e8f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:52.405313 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-65c05051-ff74-4289-bf20-e1033878e8f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:52.412800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:52.522846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c05051-ff74-4289-bf20-e1033878e8f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:52.524295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c05051-ff74-4289-bf20-e1033878e8f3 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:52.542432 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 660/1322] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:26:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:26:55.354586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a57702-6bb9-4b1b-a0b2-ae8d0cdff2bb None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:55.355176 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a57702-6bb9-4b1b-a0b2-ae8d0cdff2bb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:55.355176 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a57702-6bb9-4b1b-a0b2-ae8d0cdff2bb None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:55.356457 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 663/1323] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:26:55.362364 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f3f4b-e17c-475f-9084-52c6d2c976ef None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:55.362828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f3f4b-e17c-475f-9084-52c6d2c976ef None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:55.362942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f3f4b-e17c-475f-9084-52c6d2c976ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:55.436253 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-282f3f4b-e17c-475f-9084-52c6d2c976ef None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:55.437541 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-282f3f4b-e17c-475f-9084-52c6d2c976ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:55.501185 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:55.547311 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 661/1324] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:26:55.583147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a57702-6bb9-4b1b-a0b2-ae8d0cdff2bb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:55.585134 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-37a57702-6bb9-4b1b-a0b2-ae8d0cdff2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:55.704283 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a57702-6bb9-4b1b-a0b2-ae8d0cdff2bb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:55.716861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:55.783634 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1b7f9-0688-408b-9746-a5ddef6c0b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:55.784334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1b7f9-0688-408b-9746-a5ddef6c0b62 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:55.784615 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1b7f9-0688-408b-9746-a5ddef6c0b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:55.784897 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1b7f9-0688-408b-9746-a5ddef6c0b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:55.786634 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2ce1b7f9-0688-408b-9746-a5ddef6c0b62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:55.900985 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1b7f9-0688-408b-9746-a5ddef6c0b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:55.902310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1b7f9-0688-408b-9746-a5ddef6c0b62 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:55.921091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 664/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:26:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:26:58.072171 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f06546-71fe-4b04-9882-3f2516db258f None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:58.072635 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f06546-71fe-4b04-9882-3f2516db258f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:58.072751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f06546-71fe-4b04-9882-3f2516db258f None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:58.074213 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 662/1326] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:26:58.079536 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48049c18-940f-408f-9109-5c13ffdd9480 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:58.079967 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48049c18-940f-408f-9109-5c13ffdd9480 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:58.080091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48049c18-940f-408f-9109-5c13ffdd9480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:58.128290 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:58.147449 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-48049c18-940f-408f-9109-5c13ffdd9480 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:26:58.148640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-48049c18-940f-408f-9109-5c13ffdd9480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:58.245249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 665/1327] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:26:58.280428 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f06546-71fe-4b04-9882-3f2516db258f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:26:58.282181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c4f06546-71fe-4b04-9882-3f2516db258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:58.396348 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f06546-71fe-4b04-9882-3f2516db258f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:26:58.470195 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa01bd0-ae2f-437d-8e3f-6daf34c4adee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:26:58.470856 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa01bd0-ae2f-437d-8e3f-6daf34c4adee service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:26:58.471140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa01bd0-ae2f-437d-8e3f-6daf34c4adee service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:26:58.471418 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa01bd0-ae2f-437d-8e3f-6daf34c4adee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:26:58.473056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8fa01bd0-ae2f-437d-8e3f-6daf34c4adee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:26:58.490517 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:26:58.594957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa01bd0-ae2f-437d-8e3f-6daf34c4adee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:26:58.596401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa01bd0-ae2f-437d-8e3f-6daf34c4adee service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:26:58.614285 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 663/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:26:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:27:00.772329 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2a3bc-5af9-404c-893a-4325b1252965 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:00.772889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2a3bc-5af9-404c-893a-4325b1252965 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:00.772889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2a3bc-5af9-404c-893a-4325b1252965 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:00.774364 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 666/1329] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:00.780063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14973a-150e-4cfe-9873-5ee506866de0 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:00.780587 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14973a-150e-4cfe-9873-5ee506866de0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:00.780690 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a14973a-150e-4cfe-9873-5ee506866de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:00.849365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4a14973a-150e-4cfe-9873-5ee506866de0 None None] MFA Rules not processed for user `f889fd589b2d4d67ac66dc372869f6fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:00.850594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4a14973a-150e-4cfe-9873-5ee506866de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:00.920892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:27:00.954410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 664/1330] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:00.993096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2a3bc-5af9-404c-893a-4325b1252965 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:00.994731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c3f2a3bc-5af9-404c-893a-4325b1252965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:01.129554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2a3bc-5af9-404c-893a-4325b1252965 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:01.153090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:27:01.207347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a1a20-93f6-48df-9106-fdf727e22b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:01.208002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a1a20-93f6-48df-9106-fdf727e22b2e service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:01.208287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a1a20-93f6-48df-9106-fdf727e22b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:01.208599 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a1a20-93f6-48df-9106-fdf727e22b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:01.210294 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d99a1a20-93f6-48df-9106-fdf727e22b2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:01.329165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a1a20-93f6-48df-9106-fdf727e22b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:01.330589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a1a20-93f6-48df-9106-fdf727e22b2e service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:01.357126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 667/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:27:03.884051 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50594-ee84-4475-a6f8-021c29c06527 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:03.884623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50594-ee84-4475-a6f8-021c29c06527 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:03.884623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50594-ee84-4475-a6f8-021c29c06527 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:03.887028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 665/1332] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:03.895749 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a5480-70ac-4328-85d1-a946b5c5595f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:03.896164 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a5480-70ac-4328-85d1-a946b5c5595f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:03.896479 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a5480-70ac-4328-85d1-a946b5c5595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:03.961110 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:27:03.964494 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e82a5480-70ac-4328-85d1-a946b5c5595f None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:03.966461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e82a5480-70ac-4328-85d1-a946b5c5595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:04.065630 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 668/1333] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:04.101016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe50594-ee84-4475-a6f8-021c29c06527 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:04.102606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8fe50594-ee84-4475-a6f8-021c29c06527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:04.213077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe50594-ee84-4475-a6f8-021c29c06527 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:04.290770 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491d307-7802-4b96-8364-27cd6adeb905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:04.291421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491d307-7802-4b96-8364-27cd6adeb905 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:04.291695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491d307-7802-4b96-8364-27cd6adeb905 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:04.291969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491d307-7802-4b96-8364-27cd6adeb905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:04.293636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8491d307-7802-4b96-8364-27cd6adeb905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:04.320337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:27:04.417303 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491d307-7802-4b96-8364-27cd6adeb905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:04.418793 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491d307-7802-4b96-8364-27cd6adeb905 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:04.439401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 666/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:27:06.567946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3a05-3e8f-4e3c-ab37-cce9d5f0be0e None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:06.568823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3a05-3e8f-4e3c-ab37-cce9d5f0be0e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:06.568823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3a05-3e8f-4e3c-ab37-cce9d5f0be0e None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:06.571131 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 669/1335] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:06.577430 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c99d00-4d02-4df3-ad04-ffced50ecd21 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:06.577851 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c99d00-4d02-4df3-ad04-ffced50ecd21 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:06.577989 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c99d00-4d02-4df3-ad04-ffced50ecd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:06.651310 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b7c99d00-4d02-4df3-ad04-ffced50ecd21 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:06.652530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b7c99d00-4d02-4df3-ad04-ffced50ecd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:06.734069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:27:06.758543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 667/1336] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:06.798985 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3a05-3e8f-4e3c-ab37-cce9d5f0be0e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:06.801334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-568b3a05-3e8f-4e3c-ab37-cce9d5f0be0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:06.911174 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3a05-3e8f-4e3c-ab37-cce9d5f0be0e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:06.940955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:27:06.990350 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6002d85-cadc-4ce9-9c8c-3629f9cf173e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:06.991015 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6002d85-cadc-4ce9-9c8c-3629f9cf173e service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:06.991297 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6002d85-cadc-4ce9-9c8c-3629f9cf173e service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:06.991579 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6002d85-cadc-4ce9-9c8c-3629f9cf173e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:06.993290 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a6002d85-cadc-4ce9-9c8c-3629f9cf173e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:07.112278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6002d85-cadc-4ce9-9c8c-3629f9cf173e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:07.113763 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6002d85-cadc-4ce9-9c8c-3629f9cf173e service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:07.132282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 670/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:27:09.747527 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb96fd6-76cc-4acb-b236-2ce6f8b910c3 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:09.748441 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb96fd6-76cc-4acb-b236-2ce6f8b910c3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:09.748441 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb96fd6-76cc-4acb-b236-2ce6f8b910c3 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:09.750765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 668/1338] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:09.759800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee50f7-dfbd-4264-aa7e-1a01932691c1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:09.760260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee50f7-dfbd-4264-aa7e-1a01932691c1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:09.760374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee50f7-dfbd-4264-aa7e-1a01932691c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:09.842925 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-cfee50f7-dfbd-4264-aa7e-1a01932691c1 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:09.844322 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cfee50f7-dfbd-4264-aa7e-1a01932691c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:09.853270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:27:09.949604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 671/1339] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:09.986361 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb96fd6-76cc-4acb-b236-2ce6f8b910c3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:09.988958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ebb96fd6-76cc-4acb-b236-2ce6f8b910c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:10.104237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb96fd6-76cc-4acb-b236-2ce6f8b910c3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:10.178729 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908d5b7-0aa6-4e35-80ae-a9b8cc20b11d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:10.179385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908d5b7-0aa6-4e35-80ae-a9b8cc20b11d service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:10.179661 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908d5b7-0aa6-4e35-80ae-a9b8cc20b11d service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:10.179936 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908d5b7-0aa6-4e35-80ae-a9b8cc20b11d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:10.181609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8908d5b7-0aa6-4e35-80ae-a9b8cc20b11d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:10.217987 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:27:10.294633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908d5b7-0aa6-4e35-80ae-a9b8cc20b11d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:10.296074 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908d5b7-0aa6-4e35-80ae-a9b8cc20b11d service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:10.313968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 669/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:27:14.485997 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4d75b-2728-43fa-a00f-b66f72454bda None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:14.486582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4d75b-2728-43fa-a00f-b66f72454bda None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:14.486582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4d75b-2728-43fa-a00f-b66f72454bda None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:14.487976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 672/1341] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:14.493657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e8f4e-b213-4166-b02f-a3d48863708a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:14.494080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e8f4e-b213-4166-b02f-a3d48863708a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:14.494193 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e8f4e-b213-4166-b02f-a3d48863708a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:14.568338 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ad3e8f4e-b213-4166-b02f-a3d48863708a None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:14.569663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ad3e8f4e-b213-4166-b02f-a3d48863708a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:14.667491 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:27:14.681071 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 670/1342] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:27:14.719116 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4d75b-2728-43fa-a00f-b66f72454bda None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:14.721554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0da4d75b-2728-43fa-a00f-b66f72454bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:14.816652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4d75b-2728-43fa-a00f-b66f72454bda None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:14.820684 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f9043-1bd6-4bd0-b877-16b7188d9d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:14.821366 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f9043-1bd6-4bd0-b877-16b7188d9d54 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:14.821652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f9043-1bd6-4bd0-b877-16b7188d9d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:14.821928 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f9043-1bd6-4bd0-b877-16b7188d9d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:14.831266 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f9043-1bd6-4bd0-b877-16b7188d9d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:14.832677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f9043-1bd6-4bd0-b877-16b7188d9d54 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:14.842330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 673/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:27:17.620380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a369ceb-c6b0-4f53-a481-69e87cab54e0 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:17.621026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a369ceb-c6b0-4f53-a481-69e87cab54e0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:17.621026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a369ceb-c6b0-4f53-a481-69e87cab54e0 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:17.622361 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 671/1344] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:17.628453 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958690-4e3c-4dbd-8eaa-d8a87f25166b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:17.629006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958690-4e3c-4dbd-8eaa-d8a87f25166b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:17.629006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958690-4e3c-4dbd-8eaa-d8a87f25166b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:17.660158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c6958690-4e3c-4dbd-8eaa-d8a87f25166b None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:17.661337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c6958690-4e3c-4dbd-8eaa-d8a87f25166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:17.693809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:27:17.748410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 674/1345] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:17.785744 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a369ceb-c6b0-4f53-a481-69e87cab54e0 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:17.798111 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a369ceb-c6b0-4f53-a481-69e87cab54e0 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:17.802176 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a907e-9bf3-4027-874c-12d81e032008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:17.802829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a907e-9bf3-4027-874c-12d81e032008 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:17.803116 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a907e-9bf3-4027-874c-12d81e032008 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:17.803402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a907e-9bf3-4027-874c-12d81e032008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:17.813915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a907e-9bf3-4027-874c-12d81e032008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:17.815539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a907e-9bf3-4027-874c-12d81e032008 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:17.827641 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 672/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:27:22.324767 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb6669-493d-4618-8567-b3c3712eb49f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:22.325298 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb6669-493d-4618-8567-b3c3712eb49f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:22.325427 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb6669-493d-4618-8567-b3c3712eb49f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:22.326788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 675/1347] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:22.332371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b567555-0406-466c-a81c-b4e999bb2808 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:22.332875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b567555-0406-466c-a81c-b4e999bb2808 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:22.333122 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b567555-0406-466c-a81c-b4e999bb2808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:22.351625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-6b567555-0406-466c-a81c-b4e999bb2808 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:22.352843 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6b567555-0406-466c-a81c-b4e999bb2808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:22.365398 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 673/1348] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:22.402649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb6669-493d-4618-8567-b3c3712eb49f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:22.414661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb6669-493d-4618-8567-b3c3712eb49f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:22.418389 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a71336-1481-441f-9af0-e7a843a7892d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:22.419121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a71336-1481-441f-9af0-e7a843a7892d service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:22.419488 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a71336-1481-441f-9af0-e7a843a7892d service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:22.419839 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a71336-1481-441f-9af0-e7a843a7892d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:22.430153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a71336-1481-441f-9af0-e7a843a7892d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:22.431724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a71336-1481-441f-9af0-e7a843a7892d service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:22.441799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 676/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:27:27.422317 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53a2e6-8d68-4afa-a4e4-796ee7832272 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:27.422850 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53a2e6-8d68-4afa-a4e4-796ee7832272 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:27.422850 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53a2e6-8d68-4afa-a4e4-796ee7832272 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:27.424413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 674/1350] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 15 00:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:27.432826 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc91015-bf93-4612-b6ae-009a77380db2 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:27.433251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc91015-bf93-4612-b6ae-009a77380db2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:27.433501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc91015-bf93-4612-b6ae-009a77380db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:27.522789 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0cc91015-bf93-4612-b6ae-009a77380db2 None None] MFA Rules not processed for user `24e6dd029a3d45f6aeb4da06db9753dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:27.524029 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0cc91015-bf93-4612-b6ae-009a77380db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:27.617581 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 677/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 15 00:27:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:31.787350 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1719906-7465-444e-b4e1-c66e1bd12a6d None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:31.788557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1719906-7465-444e-b4e1-c66e1bd12a6d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:31.788841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1719906-7465-444e-b4e1-c66e1bd12a6d None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:31.790449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 675/1352] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 15 00:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:31.795927 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be51a3-eb89-4272-a482-e38991ca1c5e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:31.796374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be51a3-eb89-4272-a482-e38991ca1c5e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:31.796554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be51a3-eb89-4272-a482-e38991ca1c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:31.815165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e1be51a3-eb89-4272-a482-e38991ca1c5e None None] MFA Rules not processed for user `24e6dd029a3d45f6aeb4da06db9753dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:31.816464 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e1be51a3-eb89-4272-a482-e38991ca1c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:31.825145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 678/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 15 00:27:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:27:32.347063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=13 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:27:33.366061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ef7bc-a55e-4e52-9f68-2e95989e29d3 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:33.366704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ef7bc-a55e-4e52-9f68-2e95989e29d3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:33.366704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ef7bc-a55e-4e52-9f68-2e95989e29d3 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:33.368067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 676/1354] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 15 00:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:33.373257 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30b79b-45fd-4c1f-8c25-b017864ccba5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:33.373721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30b79b-45fd-4c1f-8c25-b017864ccba5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:33.373899 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30b79b-45fd-4c1f-8c25-b017864ccba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:33.394339 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ee30b79b-45fd-4c1f-8c25-b017864ccba5 None None] MFA Rules not processed for user `24e6dd029a3d45f6aeb4da06db9753dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:33.395539 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ee30b79b-45fd-4c1f-8c25-b017864ccba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:33.404757 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 679/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 15 00:27:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:37.140388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9c665-db01-4267-8605-8651f4e10c5a None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:37.141363 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9c665-db01-4267-8605-8651f4e10c5a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:37.141841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9c665-db01-4267-8605-8651f4e10c5a None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:37.143422 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 677/1356] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:37.148693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6024f19-c56d-452a-93c9-d1a5e33e32cc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:37.149100 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6024f19-c56d-452a-93c9-d1a5e33e32cc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:37.149315 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6024f19-c56d-452a-93c9-d1a5e33e32cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:37.172609 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e6024f19-c56d-452a-93c9-d1a5e33e32cc None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:37.174096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e6024f19-c56d-452a-93c9-d1a5e33e32cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:37.182278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 680/1357] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:37.234224 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bf235-e350-402d-a920-76adfa6e0331 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:37.235192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bf235-e350-402d-a920-76adfa6e0331 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:37.235684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bf235-e350-402d-a920-76adfa6e0331 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:37.237384 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 678/1358] 10.222.0.36 () {54 vars in 961 bytes} [Wed Jun 15 00:27:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:37.245743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78fae6-26fa-4726-af55-c869f911cd2f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:37.246367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78fae6-26fa-4726-af55-c869f911cd2f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:37.246896 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78fae6-26fa-4726-af55-c869f911cd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:37.295675 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:27:37.305174 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4a78fae6-26fa-4726-af55-c869f911cd2f None None] MFA Rules not processed for user `6d0ae1707c7041a0989889dbefeaf267`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:37.307000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4a78fae6-26fa-4726-af55-c869f911cd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:37.398727 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 681/1359] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Jun 15 00:27:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:37.406351 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bf235-e350-402d-a920-76adfa6e0331 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:37.421163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bf235-e350-402d-a920-76adfa6e0331 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:37.427244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720235f-8306-405c-96ef-ad673a115f15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:37.427950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720235f-8306-405c-96ef-ad673a115f15 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:37.428338 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720235f-8306-405c-96ef-ad673a115f15 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:37.428724 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720235f-8306-405c-96ef-ad673a115f15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:37.439066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720235f-8306-405c-96ef-ad673a115f15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:37.440746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720235f-8306-405c-96ef-ad673a115f15 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:37.451470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 679/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:27:39.783249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b41a0-326d-4304-a7da-8d80e30a356a None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:39.783833 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b41a0-326d-4304-a7da-8d80e30a356a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:39.784082 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b41a0-326d-4304-a7da-8d80e30a356a None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:39.788824 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 682/1361] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:39.791720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa9d1e-7f04-45e1-906b-6aead11c49ac None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:39.792352 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa9d1e-7f04-45e1-906b-6aead11c49ac None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:39.792352 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa9d1e-7f04-45e1-906b-6aead11c49ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:39.812679 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-affa9d1e-7f04-45e1-906b-6aead11c49ac None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:39.813879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-affa9d1e-7f04-45e1-906b-6aead11c49ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:39.824036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 680/1362] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:39.869513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b41a0-326d-4304-a7da-8d80e30a356a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:39.885645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b41a0-326d-4304-a7da-8d80e30a356a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:39.892557 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c949826-a470-4e85-96e3-d88010a32268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:39.893282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c949826-a470-4e85-96e3-d88010a32268 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:39.893659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c949826-a470-4e85-96e3-d88010a32268 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:39.894001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c949826-a470-4e85-96e3-d88010a32268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:39.905953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c949826-a470-4e85-96e3-d88010a32268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:39.907760 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c949826-a470-4e85-96e3-d88010a32268 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:39.918281 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 683/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:27:42.349080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb550f1b-c1be-4712-9086-074dacd53ee6 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:42.349577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb550f1b-c1be-4712-9086-074dacd53ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:42.349772 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb550f1b-c1be-4712-9086-074dacd53ee6 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:42.351454 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 681/1364] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:42.357187 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6310978-c2c4-43ca-ba91-0d8439d9be72 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:42.357666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6310978-c2c4-43ca-ba91-0d8439d9be72 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:42.358154 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6310978-c2c4-43ca-ba91-0d8439d9be72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:42.376289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e6310978-c2c4-43ca-ba91-0d8439d9be72 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:42.377546 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e6310978-c2c4-43ca-ba91-0d8439d9be72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:42.385620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 684/1365] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:42.431806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2d8cf-4788-4735-8ecd-1f68a57e5ede None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:42.432412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2d8cf-4788-4735-8ecd-1f68a57e5ede None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:42.432412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2d8cf-4788-4735-8ecd-1f68a57e5ede None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:42.434467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 682/1366] 10.222.0.36 () {54 vars in 961 bytes} [Wed Jun 15 00:27:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:42.441753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dd782-6976-4630-8404-36f261791dca None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:42.442043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dd782-6976-4630-8404-36f261791dca None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:42.442325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dd782-6976-4630-8404-36f261791dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:42.460630 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-280dd782-6976-4630-8404-36f261791dca None None] MFA Rules not processed for user `6d0ae1707c7041a0989889dbefeaf267`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:42.461979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-280dd782-6976-4630-8404-36f261791dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:42.471411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 685/1367] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Jun 15 00:27:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:42.479919 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2d8cf-4788-4735-8ecd-1f68a57e5ede None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:42.495214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2d8cf-4788-4735-8ecd-1f68a57e5ede None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:42.501046 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340c880-639a-4731-925c-a1bff4750041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:42.501726 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340c880-639a-4731-925c-a1bff4750041 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:42.502231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340c880-639a-4731-925c-a1bff4750041 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:42.502692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340c880-639a-4731-925c-a1bff4750041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:42.511609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340c880-639a-4731-925c-a1bff4750041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:42.513232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340c880-639a-4731-925c-a1bff4750041 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:42.523430 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 683/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:27:44.737035 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df6694-c659-4956-82ee-2ec4bb64712c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:44.737676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df6694-c659-4956-82ee-2ec4bb64712c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:44.737676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df6694-c659-4956-82ee-2ec4bb64712c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:44.739021 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 686/1369] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:44.744630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cdcb-4568-4e90-88b1-3f804d824946 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:44.745065 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cdcb-4568-4e90-88b1-3f804d824946 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:44.745146 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838cdcb-4568-4e90-88b1-3f804d824946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:44.763199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c838cdcb-4568-4e90-88b1-3f804d824946 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:44.764380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c838cdcb-4568-4e90-88b1-3f804d824946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:44.772643 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 684/1370] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:44.816040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df6694-c659-4956-82ee-2ec4bb64712c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:44.832078 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df6694-c659-4956-82ee-2ec4bb64712c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:44.837802 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4bf27-3250-4572-86be-5a49d8803a74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:44.838619 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4bf27-3250-4572-86be-5a49d8803a74 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:44.839048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4bf27-3250-4572-86be-5a49d8803a74 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:44.839470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4bf27-3250-4572-86be-5a49d8803a74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:44.848306 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4bf27-3250-4572-86be-5a49d8803a74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:44.850097 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4bf27-3250-4572-86be-5a49d8803a74 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:44.859940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 687/1371] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:27:45.240997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd67c0-1dde-4c32-9a65-996aeca81755 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:45.241263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd67c0-1dde-4c32-9a65-996aeca81755 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:45.241584 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd67c0-1dde-4c32-9a65-996aeca81755 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:45.242962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 685/1372] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:45.248384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd33d7a-427a-4060-97e0-e1939476007a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:45.248661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd33d7a-427a-4060-97e0-e1939476007a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:45.248974 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd33d7a-427a-4060-97e0-e1939476007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:45.267036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2dd33d7a-427a-4060-97e0-e1939476007a None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:45.268252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2dd33d7a-427a-4060-97e0-e1939476007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:45.276516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 688/1373] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:45.615143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ed4a6-1dbd-4762-9cc7-a06ee8b9fb8a None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:45.617152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ed4a6-1dbd-4762-9cc7-a06ee8b9fb8a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:45.617152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ed4a6-1dbd-4762-9cc7-a06ee8b9fb8a None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:45.617152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 686/1374] 10.222.0.36 () {54 vars in 963 bytes} [Wed Jun 15 00:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:45.622430 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04267b9-bff6-4980-987e-190765ba8756 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:45.622724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04267b9-bff6-4980-987e-190765ba8756 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:45.623003 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04267b9-bff6-4980-987e-190765ba8756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:45.673670 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c04267b9-bff6-4980-987e-190765ba8756 None None] MFA Rules not processed for user `d41065b495234fd98552222fc32cc53e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:45.674857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c04267b9-bff6-4980-987e-190765ba8756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:45.737255 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 689/1375] 10.222.0.36 () {58 vars in 1060 bytes} [Wed Jun 15 00:27:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:45.746487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ed4a6-1dbd-4762-9cc7-a06ee8b9fb8a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:45.757728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ed4a6-1dbd-4762-9cc7-a06ee8b9fb8a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:45.761665 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc24087-f4c8-4d8c-a245-9a475029585d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:45.762518 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc24087-f4c8-4d8c-a245-9a475029585d service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:45.762870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc24087-f4c8-4d8c-a245-9a475029585d service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:45.763213 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc24087-f4c8-4d8c-a245-9a475029585d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:45.773041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc24087-f4c8-4d8c-a245-9a475029585d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:45.774616 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc24087-f4c8-4d8c-a245-9a475029585d service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:45.785682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 687/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:27:46.996499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d4509-839d-4fce-a81c-77b6e76df89a None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:46.997072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d4509-839d-4fce-a81c-77b6e76df89a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:46.997163 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d4509-839d-4fce-a81c-77b6e76df89a None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:46.998654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 690/1377] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:47.004219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d8ad6-f4aa-4c27-a96b-da438b143bbb None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:47.004671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d8ad6-f4aa-4c27-a96b-da438b143bbb None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:47.004768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d8ad6-f4aa-4c27-a96b-da438b143bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:47.023454 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a59d8ad6-f4aa-4c27-a96b-da438b143bbb None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:47.024656 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a59d8ad6-f4aa-4c27-a96b-da438b143bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:47.032940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 688/1378] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:47.077247 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d4509-839d-4fce-a81c-77b6e76df89a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:47.092879 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d4509-839d-4fce-a81c-77b6e76df89a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:47.099093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded6f15-e750-499b-9be7-3f69fe14dc76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:47.099828 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded6f15-e750-499b-9be7-3f69fe14dc76 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:47.100177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded6f15-e750-499b-9be7-3f69fe14dc76 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:47.100539 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded6f15-e750-499b-9be7-3f69fe14dc76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:47.109162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded6f15-e750-499b-9be7-3f69fe14dc76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:47.110843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded6f15-e750-499b-9be7-3f69fe14dc76 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:47.114852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:27:47.121519 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 691/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:27:49.270597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f6557-fb61-4467-b154-1e49ee60dc12 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:49.271470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f6557-fb61-4467-b154-1e49ee60dc12 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:49.271747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f6557-fb61-4467-b154-1e49ee60dc12 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:49.273622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 689/1380] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:49.279635 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f12b83-0f3e-4e6f-97be-6c11b6200ebf None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:49.280106 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f12b83-0f3e-4e6f-97be-6c11b6200ebf None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:49.280590 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f12b83-0f3e-4e6f-97be-6c11b6200ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:49.301131 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d4f12b83-0f3e-4e6f-97be-6c11b6200ebf None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:49.302655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d4f12b83-0f3e-4e6f-97be-6c11b6200ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:49.312147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 692/1381] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:49.359994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f6557-fb61-4467-b154-1e49ee60dc12 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:49.376242 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f6557-fb61-4467-b154-1e49ee60dc12 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:49.382633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e9943-ff0f-4cf7-a9af-fa70ba525538 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:49.383591 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9943-ff0f-4cf7-a9af-fa70ba525538 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:49.384077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9943-ff0f-4cf7-a9af-fa70ba525538 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:49.384553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9943-ff0f-4cf7-a9af-fa70ba525538 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:49.394821 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e9943-ff0f-4cf7-a9af-fa70ba525538 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:49.396845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e9943-ff0f-4cf7-a9af-fa70ba525538 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:49.408552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 690/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:27:51.553495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8361ab-806f-43d0-89fc-584c39dbe372 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:51.554395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8361ab-806f-43d0-89fc-584c39dbe372 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:51.554643 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8361ab-806f-43d0-89fc-584c39dbe372 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:51.556186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 693/1383] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:51.561726 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9781cd1-5779-4490-9286-226458d6bf82 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:51.562156 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9781cd1-5779-4490-9286-226458d6bf82 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:51.562472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9781cd1-5779-4490-9286-226458d6bf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:51.580812 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a9781cd1-5779-4490-9286-226458d6bf82 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:51.582077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a9781cd1-5779-4490-9286-226458d6bf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:51.590297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 691/1384] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:51.632065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8361ab-806f-43d0-89fc-584c39dbe372 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:51.648071 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8361ab-806f-43d0-89fc-584c39dbe372 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:51.653523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20032b-c4e5-46b8-bd40-3b1e01d77679 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:51.654272 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20032b-c4e5-46b8-bd40-3b1e01d77679 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:51.654740 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20032b-c4e5-46b8-bd40-3b1e01d77679 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:51.655020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20032b-c4e5-46b8-bd40-3b1e01d77679 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:51.663594 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20032b-c4e5-46b8-bd40-3b1e01d77679 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:51.665167 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20032b-c4e5-46b8-bd40-3b1e01d77679 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:51.675018 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 694/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:27:53.879431 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4df237-8458-46c5-8870-69725eb31362 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:53.880050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4df237-8458-46c5-8870-69725eb31362 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:53.880050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4df237-8458-46c5-8870-69725eb31362 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:53.881872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 692/1386] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:53.887920 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aa5c3-3455-4967-b8ea-336fecf71462 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:53.888385 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aa5c3-3455-4967-b8ea-336fecf71462 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:53.888643 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364aa5c3-3455-4967-b8ea-336fecf71462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:53.910451 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-364aa5c3-3455-4967-b8ea-336fecf71462 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:53.911862 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-364aa5c3-3455-4967-b8ea-336fecf71462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:53.921006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 695/1387] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:53.968876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4df237-8458-46c5-8870-69725eb31362 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:53.986483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4df237-8458-46c5-8870-69725eb31362 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:53.992973 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8e26b-215e-4355-8e9e-3c525869a13c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:53.993803 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8e26b-215e-4355-8e9e-3c525869a13c service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:53.994147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8e26b-215e-4355-8e9e-3c525869a13c service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:53.994479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8e26b-215e-4355-8e9e-3c525869a13c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:54.004533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8e26b-215e-4355-8e9e-3c525869a13c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:54.006499 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8e26b-215e-4355-8e9e-3c525869a13c service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:54.017749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 693/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:27:56.293525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81071e01-239d-4a47-ba7a-859dd76ca285 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:56.294156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81071e01-239d-4a47-ba7a-859dd76ca285 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:56.294156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81071e01-239d-4a47-ba7a-859dd76ca285 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:56.295691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 696/1389] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:56.301279 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ee101-acc7-441e-a731-200a02eb9d00 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:56.301795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ee101-acc7-441e-a731-200a02eb9d00 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:56.301907 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ee101-acc7-441e-a731-200a02eb9d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:56.320785 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-193ee101-acc7-441e-a731-200a02eb9d00 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:56.322045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-193ee101-acc7-441e-a731-200a02eb9d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:56.330246 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 694/1390] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:56.376701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81071e01-239d-4a47-ba7a-859dd76ca285 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:56.394420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81071e01-239d-4a47-ba7a-859dd76ca285 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:56.403929 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407da12f-042d-49f5-88c5-0532c836cfae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:56.404865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407da12f-042d-49f5-88c5-0532c836cfae service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:56.405231 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407da12f-042d-49f5-88c5-0532c836cfae service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:56.405629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407da12f-042d-49f5-88c5-0532c836cfae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:56.417599 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407da12f-042d-49f5-88c5-0532c836cfae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:56.419918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407da12f-042d-49f5-88c5-0532c836cfae service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:56.433374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 697/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:27:58.679822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812dc06-7b75-4539-8d87-1cc310c97a03 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:58.680572 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812dc06-7b75-4539-8d87-1cc310c97a03 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:58.680572 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812dc06-7b75-4539-8d87-1cc310c97a03 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:58.681992 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 695/1392] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:27:58.688943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4ef9c-1d83-40e7-9e2b-0d389014a4ae None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:58.689426 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4ef9c-1d83-40e7-9e2b-0d389014a4ae None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:58.689838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4ef9c-1d83-40e7-9e2b-0d389014a4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:58.714746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7aa4ef9c-1d83-40e7-9e2b-0d389014a4ae None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:27:58.716721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7aa4ef9c-1d83-40e7-9e2b-0d389014a4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:27:58.729601 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 698/1393] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:27:58.788667 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812dc06-7b75-4539-8d87-1cc310c97a03 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:27:58.805379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812dc06-7b75-4539-8d87-1cc310c97a03 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:27:58.811293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0248c-77a1-4087-bb1d-55bb74ccebb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:27:58.811968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0248c-77a1-4087-bb1d-55bb74ccebb1 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:27:58.812250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0248c-77a1-4087-bb1d-55bb74ccebb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:27:58.812531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0248c-77a1-4087-bb1d-55bb74ccebb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:27:58.822242 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0248c-77a1-4087-bb1d-55bb74ccebb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:27:58.824009 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0248c-77a1-4087-bb1d-55bb74ccebb1 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:27:58.834380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 696/1394] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:01.006855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7535e-d3b0-440e-a2b8-d4e8e677ffb9 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:01.007466 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7535e-d3b0-440e-a2b8-d4e8e677ffb9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:01.007466 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7535e-d3b0-440e-a2b8-d4e8e677ffb9 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:01.009158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 699/1395] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:01.010475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fc43b-acb6-4c1b-b0fa-8936c7dc9498 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:01.010953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fc43b-acb6-4c1b-b0fa-8936c7dc9498 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:01.011062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fc43b-acb6-4c1b-b0fa-8936c7dc9498 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:01.012460 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 697/1396] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:01.014164 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f95e1-3a88-4b1f-beb4-409d742b64b6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:01.014454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f95e1-3a88-4b1f-beb4-409d742b64b6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:01.014730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f95e1-3a88-4b1f-beb4-409d742b64b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:01.017580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabe57d-70ac-49c5-b79a-0ebf205f383a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:01.017870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabe57d-70ac-49c5-b79a-0ebf205f383a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:01.018172 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabe57d-70ac-49c5-b79a-0ebf205f383a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:01.032707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a87f95e1-3a88-4b1f-beb4-409d742b64b6 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:01.033919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a87f95e1-3a88-4b1f-beb4-409d742b64b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:01.036315 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5eabe57d-70ac-49c5-b79a-0ebf205f383a None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:01.037533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5eabe57d-70ac-49c5-b79a-0ebf205f383a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:01.041772 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 700/1397] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:01.046179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 698/1398] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:01.086663 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f95e1-3a88-4b1f-beb4-409d742b64b6 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:01.100451 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f95e1-3a88-4b1f-beb4-409d742b64b6 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:01.101996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6528e7-9f1e-46c2-b3cf-e6f7dd3be5bb None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:01.102284 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6528e7-9f1e-46c2-b3cf-e6f7dd3be5bb None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:01.102571 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6528e7-9f1e-46c2-b3cf-e6f7dd3be5bb None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:01.104004 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 699/1399] 10.222.0.36 () {54 vars in 962 bytes} [Wed Jun 15 00:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:28:01.106555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed02f6-d3e7-4a2c-8685-b6f92f223eec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:01.107200 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed02f6-d3e7-4a2c-8685-b6f92f223eec service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:01.107843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed02f6-d3e7-4a2c-8685-b6f92f223eec service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:01.108111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed02f6-d3e7-4a2c-8685-b6f92f223eec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:01.109474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a777cc-baba-41c4-bf79-98b6174ac0f3 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:01.109766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a777cc-baba-41c4-bf79-98b6174ac0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:01.110043 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a777cc-baba-41c4-bf79-98b6174ac0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:01.117185 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed02f6-d3e7-4a2c-8685-b6f92f223eec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:01.118878 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed02f6-d3e7-4a2c-8685-b6f92f223eec service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:01.128832 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 701/1400] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:01.161522 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-29a777cc-baba-41c4-bf79-98b6174ac0f3 None None] MFA Rules not processed for user `a239897b9a0644ef9d2e0e2e333232fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:01.162719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-29a777cc-baba-41c4-bf79-98b6174ac0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:01.225614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 700/1401] 10.222.0.36 () {58 vars in 1059 bytes} [Wed Jun 15 00:28:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:01.234193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed02f6-d3e7-4a2c-8685-b6f92f223eec service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:01.243882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed02f6-d3e7-4a2c-8685-b6f92f223eec service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:01.247588 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab200478-b1af-4f08-b0cb-5520cddd7232 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a239897b9a0644ef9d2e0e2e333232fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:01.248265 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab200478-b1af-4f08-b0cb-5520cddd7232 service glance] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:01.248586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab200478-b1af-4f08-b0cb-5520cddd7232 service glance] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:01.248904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab200478-b1af-4f08-b0cb-5520cddd7232 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:01.259633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab200478-b1af-4f08-b0cb-5520cddd7232 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:01.261076 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab200478-b1af-4f08-b0cb-5520cddd7232 service glance] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:01.272299 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 702/1402] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:28:01.999634 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7f731-d73a-40ff-98c1-cb1757edde00 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:02.000035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7f731-d73a-40ff-98c1-cb1757edde00 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:02.000396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7f731-d73a-40ff-98c1-cb1757edde00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:02.026532 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:28:02.049596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-baa7f731-d73a-40ff-98c1-cb1757edde00 None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:02.050875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-baa7f731-d73a-40ff-98c1-cb1757edde00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:02.120075 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 701/1403] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 15 00:28:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:02.163581 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c3c90-2de9-41bc-b097-6d3bf2e90fb7 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:02.164079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c3c90-2de9-41bc-b097-6d3bf2e90fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:02.164175 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c3c90-2de9-41bc-b097-6d3bf2e90fb7 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:02.165592 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 703/1404] 10.222.0.36 () {54 vars in 942 bytes} [Wed Jun 15 00:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:02.172032 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd494b19-4af1-4fdd-8da9-fa5075272ae7 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:02.172328 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd494b19-4af1-4fdd-8da9-fa5075272ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:02.172604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd494b19-4af1-4fdd-8da9-fa5075272ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:02.225076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-dd494b19-4af1-4fdd-8da9-fa5075272ae7 None None] MFA Rules not processed for user `ff27c57c1d1b4f4ab1a030995db2e63a`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:02.226339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-dd494b19-4af1-4fdd-8da9-fa5075272ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:02.302868 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 702/1405] 10.222.0.36 () {58 vars in 1039 bytes} [Wed Jun 15 00:28:02 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:02.312581 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c3c90-2de9-41bc-b097-6d3bf2e90fb7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:02.326152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c3c90-2de9-41bc-b097-6d3bf2e90fb7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:02.331454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0e52a-329b-4365-bb2e-9702ba221f74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:02.332108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0e52a-329b-4365-bb2e-9702ba221f74 service swift] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:02.332388 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0e52a-329b-4365-bb2e-9702ba221f74 service swift] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:02.332662 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0e52a-329b-4365-bb2e-9702ba221f74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:02.341215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0e52a-329b-4365-bb2e-9702ba221f74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:02.342819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0e52a-329b-4365-bb2e-9702ba221f74 service swift] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:02.350859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 704/1406] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:28:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:28:03.287174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c6f1d-0444-49fe-b170-8247739e9eb8 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:03.287725 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c6f1d-0444-49fe-b170-8247739e9eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:03.287725 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c6f1d-0444-49fe-b170-8247739e9eb8 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:03.289282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 703/1407] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:03.294485 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6eb33-7a20-41a6-9ede-3e59cd3caca2 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:03.294929 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6eb33-7a20-41a6-9ede-3e59cd3caca2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:03.295056 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6eb33-7a20-41a6-9ede-3e59cd3caca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:03.313404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-69b6eb33-7a20-41a6-9ede-3e59cd3caca2 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:03.314611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-69b6eb33-7a20-41a6-9ede-3e59cd3caca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:03.322784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 705/1408] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:03.366850 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c6f1d-0444-49fe-b170-8247739e9eb8 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:03.381942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c6f1d-0444-49fe-b170-8247739e9eb8 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:03.387207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b2aeb-fe5e-4e66-9641-954709b81df6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:03.387860 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2aeb-fe5e-4e66-9641-954709b81df6 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:03.388150 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2aeb-fe5e-4e66-9641-954709b81df6 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:03.388441 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2aeb-fe5e-4e66-9641-954709b81df6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:03.396693 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b2aeb-fe5e-4e66-9641-954709b81df6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:03.398305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b2aeb-fe5e-4e66-9641-954709b81df6 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:03.410040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 704/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:13.308003 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=46 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:28:13.405630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=82 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:28:24.871571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ebc7b-fafb-4f41-b43a-8b076d642725 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:24.872231 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ebc7b-fafb-4f41-b43a-8b076d642725 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:24.872231 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ebc7b-fafb-4f41-b43a-8b076d642725 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:24.873561 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 706/1410] 10.222.0.36 () {54 vars in 918 bytes} [Wed Jun 15 00:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:24.878764 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf340c5-6d06-4ef3-88db-0fe8c86b978e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:24.879261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf340c5-6d06-4ef3-88db-0fe8c86b978e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:24.879261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf340c5-6d06-4ef3-88db-0fe8c86b978e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:24.898292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-daf340c5-6d06-4ef3-88db-0fe8c86b978e None None] MFA Rules not processed for user `24e6dd029a3d45f6aeb4da06db9753dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:24.899478 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-daf340c5-6d06-4ef3-88db-0fe8c86b978e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:24.908552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 705/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Jun 15 00:28:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:24.928986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46947a0-de85-45b1-8300-e9109a415e27 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:24.929275 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46947a0-de85-45b1-8300-e9109a415e27 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:24.929722 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46947a0-de85-45b1-8300-e9109a415e27 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:24.931943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 707/1412] 10.222.0.36 () {54 vars in 918 bytes} [Wed Jun 15 00:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:24.940824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92df8d-e0e7-473b-8c09-e0666bcb9448 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:24.941116 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92df8d-e0e7-473b-8c09-e0666bcb9448 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:24.941412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92df8d-e0e7-473b-8c09-e0666bcb9448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:24.966650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-3e92df8d-e0e7-473b-8c09-e0666bcb9448 None None] MFA Rules not processed for user `6d0ae1707c7041a0989889dbefeaf267`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:24.968400 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3e92df8d-e0e7-473b-8c09-e0666bcb9448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:24.980386 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 706/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Jun 15 00:28:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:27.567747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd457ff8-ced5-44aa-8d7d-0cffe85c85c9 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:27.568328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd457ff8-ced5-44aa-8d7d-0cffe85c85c9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:27.568328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd457ff8-ced5-44aa-8d7d-0cffe85c85c9 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:27.570580 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:28:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:27.583811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a7534-b1ca-4b9a-9b5e-bf20b29b47df None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:27.584304 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a7534-b1ca-4b9a-9b5e-bf20b29b47df None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:27.584402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a7534-b1ca-4b9a-9b5e-bf20b29b47df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:27.611100 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-891a7534-b1ca-4b9a-9b5e-bf20b29b47df None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:27.612839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-891a7534-b1ca-4b9a-9b5e-bf20b29b47df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:27.622882 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:27.674233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd457ff8-ced5-44aa-8d7d-0cffe85c85c9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:27.691107 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd457ff8-ced5-44aa-8d7d-0cffe85c85c9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:27.697150 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6e375a-3714-4536-9bfe-20d0397a70b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:27.697803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e375a-3714-4536-9bfe-20d0397a70b8 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:27.698088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e375a-3714-4536-9bfe-20d0397a70b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:27.698366 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6e375a-3714-4536-9bfe-20d0397a70b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:27.707747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e375a-3714-4536-9bfe-20d0397a70b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:27.709377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6e375a-3714-4536-9bfe-20d0397a70b8 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:27.719032 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 709/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:28.679586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7fb8a-05ac-4b6c-8ace-325eaff0f8fa None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:28.680562 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7fb8a-05ac-4b6c-8ace-325eaff0f8fa None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:28.680562 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7fb8a-05ac-4b6c-8ace-325eaff0f8fa None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:28.682636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:28:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:28.691010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e099336-73c2-4c02-970c-983fc7ec2c60 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:28.691427 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e099336-73c2-4c02-970c-983fc7ec2c60 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:28.691578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e099336-73c2-4c02-970c-983fc7ec2c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:28.710976 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6e099336-73c2-4c02-970c-983fc7ec2c60 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:28.712177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6e099336-73c2-4c02-970c-983fc7ec2c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:28.721745 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:28.893188 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7fb8a-05ac-4b6c-8ace-325eaff0f8fa None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:28.916029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7fb8a-05ac-4b6c-8ace-325eaff0f8fa None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:28.922266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73668e4b-77d9-43d1-8ade-e3dee32ae89a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:28.922912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668e4b-77d9-43d1-8ade-e3dee32ae89a service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:28.923192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668e4b-77d9-43d1-8ade-e3dee32ae89a service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:28.923471 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668e4b-77d9-43d1-8ade-e3dee32ae89a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:28.931890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73668e4b-77d9-43d1-8ade-e3dee32ae89a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:28.933513 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73668e4b-77d9-43d1-8ade-e3dee32ae89a service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:28.943169 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 709/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:29.885542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c0231-3286-44dd-bc72-018973520098 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:29.886105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c0231-3286-44dd-bc72-018973520098 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:29.886105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c0231-3286-44dd-bc72-018973520098 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:29.888402 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:28:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:29.896613 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7486b84-98d7-416c-b104-a156d3480839 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:29.897032 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7486b84-98d7-416c-b104-a156d3480839 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:29.897190 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7486b84-98d7-416c-b104-a156d3480839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:29.921997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b7486b84-98d7-416c-b104-a156d3480839 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:29.923199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b7486b84-98d7-416c-b104-a156d3480839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:29.931751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:30.085084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c0231-3286-44dd-bc72-018973520098 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:30.101465 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c0231-3286-44dd-bc72-018973520098 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:30.107641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d7b8a-1dff-401a-8d82-696eac55f3e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:30.108640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d7b8a-1dff-401a-8d82-696eac55f3e1 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:30.108921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d7b8a-1dff-401a-8d82-696eac55f3e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:30.109195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d7b8a-1dff-401a-8d82-696eac55f3e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:30.118113 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d7b8a-1dff-401a-8d82-696eac55f3e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:30.119710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d7b8a-1dff-401a-8d82-696eac55f3e1 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:30.129480 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 712/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:31.040400 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2da6c1-f020-4717-b50a-96d9620b2137 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:31.041005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2da6c1-f020-4717-b50a-96d9620b2137 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:31.041005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2da6c1-f020-4717-b50a-96d9620b2137 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:31.042402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:31.048426 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bdb23-1682-4b37-9f65-0810d6fecbb0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:31.049240 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bdb23-1682-4b37-9f65-0810d6fecbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:31.049414 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bdb23-1682-4b37-9f65-0810d6fecbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:31.075762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-108bdb23-1682-4b37-9f65-0810d6fecbb0 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:31.076991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-108bdb23-1682-4b37-9f65-0810d6fecbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:31.088045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:31.241230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2da6c1-f020-4717-b50a-96d9620b2137 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:31.262376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2da6c1-f020-4717-b50a-96d9620b2137 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:31.268697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4207e2-1d66-4d69-ab57-e309e98b477c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:31.269362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4207e2-1d66-4d69-ab57-e309e98b477c service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:31.269654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4207e2-1d66-4d69-ab57-e309e98b477c service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:31.269930 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4207e2-1d66-4d69-ab57-e309e98b477c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:31.278663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4207e2-1d66-4d69-ab57-e309e98b477c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:31.280267 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4207e2-1d66-4d69-ab57-e309e98b477c service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:31.290206 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 712/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:32.188773 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb69b5e-a22a-459d-a100-f2358ebae892 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:32.189384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb69b5e-a22a-459d-a100-f2358ebae892 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:32.189384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb69b5e-a22a-459d-a100-f2358ebae892 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:32.192331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:28:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:32.206007 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ed27b-532a-4f00-8ae3-4d0a22e2ff38 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:32.206737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ed27b-532a-4f00-8ae3-4d0a22e2ff38 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:32.206849 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ed27b-532a-4f00-8ae3-4d0a22e2ff38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:32.226926 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1b9ed27b-532a-4f00-8ae3-4d0a22e2ff38 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:32.228055 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1b9ed27b-532a-4f00-8ae3-4d0a22e2ff38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:32.237492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:32.392262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb69b5e-a22a-459d-a100-f2358ebae892 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:32.409396 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb69b5e-a22a-459d-a100-f2358ebae892 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:32.415894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4441f-cd89-470c-b33f-74783c522bd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:32.416542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4441f-cd89-470c-b33f-74783c522bd6 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:32.416828 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4441f-cd89-470c-b33f-74783c522bd6 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:32.417108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4441f-cd89-470c-b33f-74783c522bd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:32.427063 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4441f-cd89-470c-b33f-74783c522bd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:32.429492 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4441f-cd89-470c-b33f-74783c522bd6 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:32.443583 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 715/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:33.302251 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9650afa-06f5-4eae-a919-09b2130592b2 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:33.303172 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9650afa-06f5-4eae-a919-09b2130592b2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:33.303172 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9650afa-06f5-4eae-a919-09b2130592b2 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:33.305493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:28:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:33.311692 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9c7b2-b300-4eca-bbd8-693feb9b30ad None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:33.312134 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9c7b2-b300-4eca-bbd8-693feb9b30ad None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:33.312348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9c7b2-b300-4eca-bbd8-693feb9b30ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:33.332523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4fd9c7b2-b300-4eca-bbd8-693feb9b30ad None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:33.333762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4fd9c7b2-b300-4eca-bbd8-693feb9b30ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:33.342520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:33.493792 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9650afa-06f5-4eae-a919-09b2130592b2 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:33.509922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9650afa-06f5-4eae-a919-09b2130592b2 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:33.516153 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a4d13-6e53-497b-ac60-408b92958c52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:33.516796 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a4d13-6e53-497b-ac60-408b92958c52 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:33.517084 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a4d13-6e53-497b-ac60-408b92958c52 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:33.517375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a4d13-6e53-497b-ac60-408b92958c52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:33.525674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a4d13-6e53-497b-ac60-408b92958c52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:33.527268 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a4d13-6e53-497b-ac60-408b92958c52 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:33.536897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 715/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:34.383975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf66f37-11ec-4a29-9850-24762005b6f1 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:34.384524 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf66f37-11ec-4a29-9850-24762005b6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:34.384524 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf66f37-11ec-4a29-9850-24762005b6f1 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:34.385880 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:34.392008 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce74a7-f908-4c28-8f4e-b457a1eff7b9 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:34.392467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce74a7-f908-4c28-8f4e-b457a1eff7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:34.392570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce74a7-f908-4c28-8f4e-b457a1eff7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:34.413109 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-22ce74a7-f908-4c28-8f4e-b457a1eff7b9 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:34.414350 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-22ce74a7-f908-4c28-8f4e-b457a1eff7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:34.423652 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:34.574800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf66f37-11ec-4a29-9850-24762005b6f1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:34.594108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf66f37-11ec-4a29-9850-24762005b6f1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:34.600845 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa323c7d-a845-4fa3-8df7-f03f2d74e466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:34.601521 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa323c7d-a845-4fa3-8df7-f03f2d74e466 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:34.601807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa323c7d-a845-4fa3-8df7-f03f2d74e466 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:34.602047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa323c7d-a845-4fa3-8df7-f03f2d74e466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:34.610973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa323c7d-a845-4fa3-8df7-f03f2d74e466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:34.612581 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa323c7d-a845-4fa3-8df7-f03f2d74e466 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:34.622435 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 718/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:35.466001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332cbdb-72da-4f7a-94f6-2915233a491d None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:35.466606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332cbdb-72da-4f7a-94f6-2915233a491d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:35.466606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332cbdb-72da-4f7a-94f6-2915233a491d None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:35.467979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:35.474301 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f510c2-2104-433f-8dd5-f92e381266fc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:35.474728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f510c2-2104-433f-8dd5-f92e381266fc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:35.474817 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f510c2-2104-433f-8dd5-f92e381266fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:35.499472 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-20f510c2-2104-433f-8dd5-f92e381266fc None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:35.500657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-20f510c2-2104-433f-8dd5-f92e381266fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:35.510692 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:35.662596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332cbdb-72da-4f7a-94f6-2915233a491d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:35.688596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332cbdb-72da-4f7a-94f6-2915233a491d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:35.696373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226213e-6ddb-42e4-9cd1-a123a90e71a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:35.696995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226213e-6ddb-42e4-9cd1-a123a90e71a5 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:35.697282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226213e-6ddb-42e4-9cd1-a123a90e71a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:35.697590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226213e-6ddb-42e4-9cd1-a123a90e71a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:35.706199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226213e-6ddb-42e4-9cd1-a123a90e71a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:35.707886 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226213e-6ddb-42e4-9cd1-a123a90e71a5 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:35.717798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 718/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:36.583071 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f48a0-4a3c-43ac-b91e-3e14bb6e291f None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:36.583988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f48a0-4a3c-43ac-b91e-3e14bb6e291f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:36.583988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f48a0-4a3c-43ac-b91e-3e14bb6e291f None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:36.586253 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:28:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:36.594281 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f921d-9165-4d81-ae3d-c679b7ad564f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:36.594724 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f921d-9165-4d81-ae3d-c679b7ad564f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:36.594850 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f921d-9165-4d81-ae3d-c679b7ad564f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:36.620049 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-206f921d-9165-4d81-ae3d-c679b7ad564f None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:36.621303 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-206f921d-9165-4d81-ae3d-c679b7ad564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:36.630933 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:36.785193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f48a0-4a3c-43ac-b91e-3e14bb6e291f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:36.807026 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f48a0-4a3c-43ac-b91e-3e14bb6e291f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:36.813871 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3475925-977d-4ea4-a63e-86c4783e0cc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:36.814519 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3475925-977d-4ea4-a63e-86c4783e0cc1 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:36.814805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3475925-977d-4ea4-a63e-86c4783e0cc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:36.815080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3475925-977d-4ea4-a63e-86c4783e0cc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:36.824082 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3475925-977d-4ea4-a63e-86c4783e0cc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:36.826088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3475925-977d-4ea4-a63e-86c4783e0cc1 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:36.836400 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 721/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:38.877527 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b40349-2d22-4409-bdd1-672dc6fcc56a None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:38.878074 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b40349-2d22-4409-bdd1-672dc6fcc56a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:38.878203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b40349-2d22-4409-bdd1-672dc6fcc56a None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:38.880202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:28:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:38.885894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb59bd5-5292-4fad-87e8-26795897aa55 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:38.886309 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb59bd5-5292-4fad-87e8-26795897aa55 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:38.886522 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb59bd5-5292-4fad-87e8-26795897aa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:38.907520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-edb59bd5-5292-4fad-87e8-26795897aa55 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:38.908730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-edb59bd5-5292-4fad-87e8-26795897aa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:38.917866 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:38.955927 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b40349-2d22-4409-bdd1-672dc6fcc56a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:38.967592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b40349-2d22-4409-bdd1-672dc6fcc56a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:38.971437 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa45ef4-8afa-48da-871b-a9e0f651cf24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:38.972063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa45ef4-8afa-48da-871b-a9e0f651cf24 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:38.972366 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa45ef4-8afa-48da-871b-a9e0f651cf24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:38.972639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa45ef4-8afa-48da-871b-a9e0f651cf24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:38.981639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa45ef4-8afa-48da-871b-a9e0f651cf24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:38.983457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa45ef4-8afa-48da-871b-a9e0f651cf24 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:38.992718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 721/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:41.253114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d962fdf-2639-46f8-a2a9-0dd1eaa764b0 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:41.253732 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d962fdf-2639-46f8-a2a9-0dd1eaa764b0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:41.253732 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d962fdf-2639-46f8-a2a9-0dd1eaa764b0 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:41.255155 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:41.261644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec34d08-cb44-4ae3-9649-d9f4e4dd9500 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:41.262416 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec34d08-cb44-4ae3-9649-d9f4e4dd9500 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:41.262578 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec34d08-cb44-4ae3-9649-d9f4e4dd9500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:41.283230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9ec34d08-cb44-4ae3-9649-d9f4e4dd9500 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:41.284432 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9ec34d08-cb44-4ae3-9649-d9f4e4dd9500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:41.292713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:41.330538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d962fdf-2639-46f8-a2a9-0dd1eaa764b0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:41.341795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d962fdf-2639-46f8-a2a9-0dd1eaa764b0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:41.345640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c3278-0969-4d99-92e4-9cd8c36d00b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:41.346280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c3278-0969-4d99-92e4-9cd8c36d00b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:41.346565 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c3278-0969-4d99-92e4-9cd8c36d00b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:41.346840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c3278-0969-4d99-92e4-9cd8c36d00b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:41.356142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c3278-0969-4d99-92e4-9cd8c36d00b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:41.357606 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c3278-0969-4d99-92e4-9cd8c36d00b3 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:41.367397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 724/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:43.775968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d7c9-6ba6-48c8-9c02-b39b8f9db36d None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:43.776549 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d7c9-6ba6-48c8-9c02-b39b8f9db36d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:43.776549 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d7c9-6ba6-48c8-9c02-b39b8f9db36d None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:43.777949 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:43.783525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7a3a5-9780-47ef-a26a-6470fb70d45c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:43.783963 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7a3a5-9780-47ef-a26a-6470fb70d45c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:43.784091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7a3a5-9780-47ef-a26a-6470fb70d45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:43.803967 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7fb7a3a5-9780-47ef-a26a-6470fb70d45c None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:43.805183 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7fb7a3a5-9780-47ef-a26a-6470fb70d45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:43.814399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:43.854201 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39d7c9-6ba6-48c8-9c02-b39b8f9db36d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:43.871838 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39d7c9-6ba6-48c8-9c02-b39b8f9db36d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:43.878879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72fcc4-14e0-4948-a8c3-24de7216f5c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:43.879508 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72fcc4-14e0-4948-a8c3-24de7216f5c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:43.879800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72fcc4-14e0-4948-a8c3-24de7216f5c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:43.880069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72fcc4-14e0-4948-a8c3-24de7216f5c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:43.890189 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72fcc4-14e0-4948-a8c3-24de7216f5c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:43.891638 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72fcc4-14e0-4948-a8c3-24de7216f5c9 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:43.901092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 724/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:46.127184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e309f-d521-40f9-8d8b-736b4d33201d None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:46.127817 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e309f-d521-40f9-8d8b-736b4d33201d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:46.127817 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e309f-d521-40f9-8d8b-736b4d33201d None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:46.129181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 15 00:28:46.134660 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304326b-3723-4ec9-8d62-b052c1f266ac None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:46.135106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304326b-3723-4ec9-8d62-b052c1f266ac None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:46.135207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304326b-3723-4ec9-8d62-b052c1f266ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:46.153822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2304326b-3723-4ec9-8d62-b052c1f266ac None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:46.155000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2304326b-3723-4ec9-8d62-b052c1f266ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:46.163682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:46.205100 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e309f-d521-40f9-8d8b-736b4d33201d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:46.218500 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e309f-d521-40f9-8d8b-736b4d33201d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:46.222911 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df33049-3106-4efe-adae-29d0806c42f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:46.223548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df33049-3106-4efe-adae-29d0806c42f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:46.223828 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df33049-3106-4efe-adae-29d0806c42f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:46.224105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df33049-3106-4efe-adae-29d0806c42f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:46.233659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df33049-3106-4efe-adae-29d0806c42f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:46.235086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df33049-3106-4efe-adae-29d0806c42f4 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:46.244522 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 727/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:48.420566 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b744-7b43-45a6-8f3e-e3c12726f751 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:48.421154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b744-7b43-45a6-8f3e-e3c12726f751 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:48.421154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b744-7b43-45a6-8f3e-e3c12726f751 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:48.423062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:48.428548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ee0d6-bbd1-4085-ba54-3a32e4bdc5b0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:48.429012 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ee0d6-bbd1-4085-ba54-3a32e4bdc5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:48.429112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ee0d6-bbd1-4085-ba54-3a32e4bdc5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:48.447766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3e8ee0d6-bbd1-4085-ba54-3a32e4bdc5b0 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:48.448956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3e8ee0d6-bbd1-4085-ba54-3a32e4bdc5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:48.457762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:48.496576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1b744-7b43-45a6-8f3e-e3c12726f751 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:48.512148 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1b744-7b43-45a6-8f3e-e3c12726f751 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:48.516539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502111b-2e63-484d-967a-76aa9e977c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:48.517175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502111b-2e63-484d-967a-76aa9e977c2f service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:48.517549 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502111b-2e63-484d-967a-76aa9e977c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:48.517756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502111b-2e63-484d-967a-76aa9e977c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:48.527220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502111b-2e63-484d-967a-76aa9e977c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:48.528665 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502111b-2e63-484d-967a-76aa9e977c2f service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:48.538115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 727/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:50.720707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d5a9a-85f5-4cf2-ab82-5cddd11b3bbf None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:50.721327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d5a9a-85f5-4cf2-ab82-5cddd11b3bbf None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:50.721327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d5a9a-85f5-4cf2-ab82-5cddd11b3bbf None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:50.722794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:50.729180 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5424c2-76c9-49c0-a21d-82ba4c5ce846 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:50.729969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5424c2-76c9-49c0-a21d-82ba4c5ce846 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:50.730188 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5424c2-76c9-49c0-a21d-82ba4c5ce846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:50.751181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4c5424c2-76c9-49c0-a21d-82ba4c5ce846 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:50.752367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4c5424c2-76c9-49c0-a21d-82ba4c5ce846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:50.760714 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:50.800861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d5a9a-85f5-4cf2-ab82-5cddd11b3bbf None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:50.813148 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d5a9a-85f5-4cf2-ab82-5cddd11b3bbf None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:50.817333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebffb0-438f-4c5a-a236-e49e5740fbd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:50.817994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebffb0-438f-4c5a-a236-e49e5740fbd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:50.818268 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebffb0-438f-4c5a-a236-e49e5740fbd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:50.818544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebffb0-438f-4c5a-a236-e49e5740fbd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:50.828978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebffb0-438f-4c5a-a236-e49e5740fbd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:50.830528 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebffb0-438f-4c5a-a236-e49e5740fbd3 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:50.840088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 730/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:28:53.034654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc86d62-8286-4086-85ff-2f5bc0622d6b None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:53.035273 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc86d62-8286-4086-85ff-2f5bc0622d6b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:53.035273 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc86d62-8286-4086-85ff-2f5bc0622d6b None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:53.036629 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:53.043129 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd19e94-aea8-4776-95b1-a5b41e9eb527 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:53.044009 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd19e94-aea8-4776-95b1-a5b41e9eb527 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:53.044200 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd19e94-aea8-4776-95b1-a5b41e9eb527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:53.065632 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fdd19e94-aea8-4776-95b1-a5b41e9eb527 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:53.066835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fdd19e94-aea8-4776-95b1-a5b41e9eb527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:53.076683 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:53.114704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc86d62-8286-4086-85ff-2f5bc0622d6b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:53.133587 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc86d62-8286-4086-85ff-2f5bc0622d6b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:53.139545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88a61b-8952-4fc4-a2d3-f4d58d88b76e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:53.140570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88a61b-8952-4fc4-a2d3-f4d58d88b76e service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:53.141026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88a61b-8952-4fc4-a2d3-f4d58d88b76e service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:53.141506 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88a61b-8952-4fc4-a2d3-f4d58d88b76e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:53.152684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88a61b-8952-4fc4-a2d3-f4d58d88b76e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:53.154193 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88a61b-8952-4fc4-a2d3-f4d58d88b76e service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:53.164848 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 730/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:55.322325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b109f-08a9-46ac-b984-e08290985d5c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:55.322884 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b109f-08a9-46ac-b984-e08290985d5c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:55.322884 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b109f-08a9-46ac-b984-e08290985d5c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:55.324279 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:55.329694 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac769e7-bccc-4258-9558-318e00c68bcb None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:55.330098 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac769e7-bccc-4258-9558-318e00c68bcb None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:55.330235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac769e7-bccc-4258-9558-318e00c68bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:55.336564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=79 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:28:55.349964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-eac769e7-bccc-4258-9558-318e00c68bcb None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:55.351169 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-eac769e7-bccc-4258-9558-318e00c68bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:55.360304 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:55.397322 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b109f-08a9-46ac-b984-e08290985d5c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:55.402941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=73 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:28:55.409914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b109f-08a9-46ac-b984-e08290985d5c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:55.413523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb65dd-842f-4ca3-bbab-55d85258e048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:55.414260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb65dd-842f-4ca3-bbab-55d85258e048 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:55.414609 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb65dd-842f-4ca3-bbab-55d85258e048 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:55.414951 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb65dd-842f-4ca3-bbab-55d85258e048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:55.427063 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb65dd-842f-4ca3-bbab-55d85258e048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:55.428512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb65dd-842f-4ca3-bbab-55d85258e048 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:55.437886 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 733/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:57.600561 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a23e29-1b05-49cb-9ee4-4b232a9cd519 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:57.601171 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a23e29-1b05-49cb-9ee4-4b232a9cd519 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:57.601171 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a23e29-1b05-49cb-9ee4-4b232a9cd519 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:57.602551 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:57.609326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aa1d4-fb2c-475b-9354-8e3e60b9a3be None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:57.610010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aa1d4-fb2c-475b-9354-8e3e60b9a3be None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:57.610118 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aa1d4-fb2c-475b-9354-8e3e60b9a3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:57.630748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-bc2aa1d4-fb2c-475b-9354-8e3e60b9a3be None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:57.632565 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bc2aa1d4-fb2c-475b-9354-8e3e60b9a3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:57.641006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:57.678543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a23e29-1b05-49cb-9ee4-4b232a9cd519 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:57.681533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-19a23e29-1b05-49cb-9ee4-4b232a9cd519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:57.703558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a23e29-1b05-49cb-9ee4-4b232a9cd519 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:57.708976 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b0793-c97e-4e8e-9afa-b75cc7cc9cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:57.709646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b0793-c97e-4e8e-9afa-b75cc7cc9cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:57.709927 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b0793-c97e-4e8e-9afa-b75cc7cc9cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:57.710203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b0793-c97e-4e8e-9afa-b75cc7cc9cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:57.719844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b0793-c97e-4e8e-9afa-b75cc7cc9cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:57.721322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b0793-c97e-4e8e-9afa-b75cc7cc9cd9 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:57.730926 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 733/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:28:59.832689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d34bb-9615-40d1-b4c2-484ae0e8e987 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:59.833255 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d34bb-9615-40d1-b4c2-484ae0e8e987 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:59.833255 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d34bb-9615-40d1-b4c2-484ae0e8e987 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:59.834740 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:28:59.840991 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e112-3a3a-487a-8576-121a2924b9ab None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:59.841444 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e112-3a3a-487a-8576-121a2924b9ab None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:59.841591 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e112-3a3a-487a-8576-121a2924b9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:59.867080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a270e112-3a3a-487a-8576-121a2924b9ab None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:28:59.868286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a270e112-3a3a-487a-8576-121a2924b9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:28:59.876858 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:28:59.913598 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d34bb-9615-40d1-b4c2-484ae0e8e987 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:28:59.929481 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d34bb-9615-40d1-b4c2-484ae0e8e987 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:28:59.933815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d4bb4-6b64-4803-ab33-ddbe51d8c17f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:28:59.934461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d4bb4-6b64-4803-ab33-ddbe51d8c17f service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:28:59.934748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d4bb4-6b64-4803-ab33-ddbe51d8c17f service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:28:59.935031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d4bb4-6b64-4803-ab33-ddbe51d8c17f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:28:59.944086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d4bb4-6b64-4803-ab33-ddbe51d8c17f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:28:59.945574 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d4bb4-6b64-4803-ab33-ddbe51d8c17f service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:28:59.954858 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 736/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:29:09.861093 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=11 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:29:09.950796 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=14 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:29:19.847907 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8a449-e00d-429c-b627-19cac43f9d1e None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:19.848544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8a449-e00d-429c-b627-19cac43f9d1e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:19.848544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8a449-e00d-429c-b627-19cac43f9d1e None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:19.849966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 735/1471] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:29:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:29:19.855216 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe66aa-090e-4d41-a0f9-842f47627ebe None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:19.855675 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe66aa-090e-4d41-a0f9-842f47627ebe None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:19.855782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe66aa-090e-4d41-a0f9-842f47627ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:19.877486 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d9fe66aa-090e-4d41-a0f9-842f47627ebe None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:29:19.879571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d9fe66aa-090e-4d41-a0f9-842f47627ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:29:19.889973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 737/1472] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:29:19.945121 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e31e4f-9a55-46ec-b94f-9ca62d5bc33d None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:19.945442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e31e4f-9a55-46ec-b94f-9ca62d5bc33d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:19.945716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e31e4f-9a55-46ec-b94f-9ca62d5bc33d None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:19.947104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 736/1473] 10.222.0.36 () {54 vars in 962 bytes} [Wed Jun 15 00:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:29:19.951934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b8b4-de8e-4afb-908b-6788ef3eea60 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:19.952225 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b8b4-de8e-4afb-908b-6788ef3eea60 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:19.952498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b8b4-de8e-4afb-908b-6788ef3eea60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:19.971649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ff41b8b4-de8e-4afb-908b-6788ef3eea60 None None] MFA Rules not processed for user `a239897b9a0644ef9d2e0e2e333232fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:29:19.972915 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ff41b8b4-de8e-4afb-908b-6788ef3eea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:29:19.980642 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 738/1474] 10.222.0.36 () {58 vars in 1059 bytes} [Wed Jun 15 00:29:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:29:19.988554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e31e4f-9a55-46ec-b94f-9ca62d5bc33d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:29:20.000543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e31e4f-9a55-46ec-b94f-9ca62d5bc33d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:29:20.005397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d598f-c616-405c-9569-2abd84aaa24f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a239897b9a0644ef9d2e0e2e333232fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:29:20.006046 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d598f-c616-405c-9569-2abd84aaa24f service glance] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:20.006327 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d598f-c616-405c-9569-2abd84aaa24f service glance] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:20.006597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d598f-c616-405c-9569-2abd84aaa24f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:20.015764 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d598f-c616-405c-9569-2abd84aaa24f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:29:20.017202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d598f-c616-405c-9569-2abd84aaa24f service glance] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:29:20.026773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 737/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:29:22.303901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201f62e-fd2b-475c-b36d-997bf6deee88 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:22.304504 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201f62e-fd2b-475c-b36d-997bf6deee88 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:22.304504 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201f62e-fd2b-475c-b36d-997bf6deee88 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:22.305798 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 739/1476] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:29:22.311159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c653b33-3e64-46bf-8d27-530f4c59e076 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:22.311620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c653b33-3e64-46bf-8d27-530f4c59e076 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:22.311736 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c653b33-3e64-46bf-8d27-530f4c59e076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:22.331019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-3c653b33-3e64-46bf-8d27-530f4c59e076 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:29:22.332341 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3c653b33-3e64-46bf-8d27-530f4c59e076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:29:22.342320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 738/1477] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:29:22.371706 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201f62e-fd2b-475c-b36d-997bf6deee88 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:29:22.386509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201f62e-fd2b-475c-b36d-997bf6deee88 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:29:22.391809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7875f-cd3f-48ba-8e30-75679de2336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:29:22.392505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7875f-cd3f-48ba-8e30-75679de2336e admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:22.392785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7875f-cd3f-48ba-8e30-75679de2336e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:22.393060 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7875f-cd3f-48ba-8e30-75679de2336e admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:22.393819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7875f-cd3f-48ba-8e30-75679de2336e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:29:22.395743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: WARNING py.warnings [None req-5fa7875f-cd3f-48ba-8e30-75679de2336e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:29:22.395743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: warnings.warn(msg) Jun 15 00:29:22.395743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: Jun 15 00:29:22.396868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7875f-cd3f-48ba-8e30-75679de2336e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:29:22.416410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 740/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Jun 15 00:29:22 2022] GET /identity/v3/projects => generated 2553 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:29:24.634344 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13255fb4-b8bc-4c3e-aabe-677b2792d58b None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:24.634899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13255fb4-b8bc-4c3e-aabe-677b2792d58b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:24.634899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13255fb4-b8bc-4c3e-aabe-677b2792d58b None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:24.637013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 739/1479] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:29:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:29:24.645090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d71cbf-fe2a-4728-be60-631599d2376c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:24.645594 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d71cbf-fe2a-4728-be60-631599d2376c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:24.645709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d71cbf-fe2a-4728-be60-631599d2376c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:24.664852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-10d71cbf-fe2a-4728-be60-631599d2376c None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:29:24.666086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-10d71cbf-fe2a-4728-be60-631599d2376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:29:24.674475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 741/1480] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:29:24.719618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13255fb4-b8bc-4c3e-aabe-677b2792d58b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:29:24.740433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13255fb4-b8bc-4c3e-aabe-677b2792d58b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:29:24.746300 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f705d74-56ef-43ae-b196-5e42bad38957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:29:24.746939 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f705d74-56ef-43ae-b196-5e42bad38957 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:24.747228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f705d74-56ef-43ae-b196-5e42bad38957 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:24.747505 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f705d74-56ef-43ae-b196-5e42bad38957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:24.755807 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f705d74-56ef-43ae-b196-5e42bad38957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:29:24.757425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f705d74-56ef-43ae-b196-5e42bad38957 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:29:24.766920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 740/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:29:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:29:27.048201 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293f958-69c0-47fd-a55b-434a7eda04e3 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:27.048903 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293f958-69c0-47fd-a55b-434a7eda04e3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:27.048903 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293f958-69c0-47fd-a55b-434a7eda04e3 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:27.050885 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 742/1482] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:29:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:29:27.056310 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25890d-a285-4bc3-90e5-f98523338e8e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:27.056735 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25890d-a285-4bc3-90e5-f98523338e8e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:27.056902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25890d-a285-4bc3-90e5-f98523338e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:27.080432 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ea25890d-a285-4bc3-90e5-f98523338e8e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:29:27.082167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ea25890d-a285-4bc3-90e5-f98523338e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:29:27.091273 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 741/1483] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:29:27.127614 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293f958-69c0-47fd-a55b-434a7eda04e3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:29:27.140112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293f958-69c0-47fd-a55b-434a7eda04e3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:29:27.144578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb747d-3141-4810-8068-2b3adf758c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:29:27.145226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb747d-3141-4810-8068-2b3adf758c70 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:27.145546 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb747d-3141-4810-8068-2b3adf758c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:27.145808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb747d-3141-4810-8068-2b3adf758c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:27.155308 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb747d-3141-4810-8068-2b3adf758c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:29:27.156752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb747d-3141-4810-8068-2b3adf758c70 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:29:27.166519 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 743/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:29:29.321405 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eeb405-708c-43ab-b36a-9e1904b1950f None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:29.322197 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eeb405-708c-43ab-b36a-9e1904b1950f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:29.322197 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eeb405-708c-43ab-b36a-9e1904b1950f None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:29.323776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 742/1485] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:29:29.329036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121e6f2-5b09-4ee0-8213-641ed60ec0de None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:29.329494 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121e6f2-5b09-4ee0-8213-641ed60ec0de None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:29.329589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121e6f2-5b09-4ee0-8213-641ed60ec0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:29.347637 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e121e6f2-5b09-4ee0-8213-641ed60ec0de None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:29:29.348834 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e121e6f2-5b09-4ee0-8213-641ed60ec0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:29:29.357136 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 744/1486] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:29:29.398808 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eeb405-708c-43ab-b36a-9e1904b1950f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:29:29.415226 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eeb405-708c-43ab-b36a-9e1904b1950f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:29:29.419720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aec6a3-187f-4566-8972-bc2c62856ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:29:29.420365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aec6a3-187f-4566-8972-bc2c62856ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:29.420649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aec6a3-187f-4566-8972-bc2c62856ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:29.420925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aec6a3-187f-4566-8972-bc2c62856ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:29.431238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aec6a3-187f-4566-8972-bc2c62856ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:29:29.432698 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aec6a3-187f-4566-8972-bc2c62856ac4 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:29:29.442845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 743/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:29:31.625641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fa932-8c83-4635-a9dd-f702c1a32d91 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:31.626261 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fa932-8c83-4635-a9dd-f702c1a32d91 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:31.626261 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fa932-8c83-4635-a9dd-f702c1a32d91 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:31.627600 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 745/1488] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:29:31.633042 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32710c-3518-41db-ab53-5f6bea1c45a3 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:31.633487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32710c-3518-41db-ab53-5f6bea1c45a3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:31.633656 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32710c-3518-41db-ab53-5f6bea1c45a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:31.651315 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4b32710c-3518-41db-ab53-5f6bea1c45a3 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:29:31.652492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4b32710c-3518-41db-ab53-5f6bea1c45a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:29:31.660750 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 744/1489] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:29:31.703137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fa932-8c83-4635-a9dd-f702c1a32d91 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:29:31.719443 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fa932-8c83-4635-a9dd-f702c1a32d91 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:29:31.724609 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcf1b9-5757-4872-b2d3-058b6de3a9ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:29:31.725250 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf1b9-5757-4872-b2d3-058b6de3a9ee service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:31.725576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf1b9-5757-4872-b2d3-058b6de3a9ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:31.725859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf1b9-5757-4872-b2d3-058b6de3a9ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:31.736372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcf1b9-5757-4872-b2d3-058b6de3a9ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:29:31.737889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcf1b9-5757-4872-b2d3-058b6de3a9ee service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:29:31.747681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 746/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:29:34.064983 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083be92c-99d1-4b7d-8be1-d81ffb03efcd None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:34.065892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083be92c-99d1-4b7d-8be1-d81ffb03efcd None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:34.066019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083be92c-99d1-4b7d-8be1-d81ffb03efcd None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:34.067392 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 745/1491] 10.222.0.36 () {54 vars in 926 bytes} [Wed Jun 15 00:29:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:29:34.073192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6ac72-5c7c-4e81-be7e-375e505082eb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:34.073646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6ac72-5c7c-4e81-be7e-375e505082eb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:34.073815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6ac72-5c7c-4e81-be7e-375e505082eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:34.099838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1ce6ac72-5c7c-4e81-be7e-375e505082eb None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:29:34.101037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1ce6ac72-5c7c-4e81-be7e-375e505082eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:29:34.110188 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 747/1492] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Jun 15 00:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:29:34.149306 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083be92c-99d1-4b7d-8be1-d81ffb03efcd None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:29:34.165013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083be92c-99d1-4b7d-8be1-d81ffb03efcd None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:29:34.169202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1d0d3-851b-45b7-a76a-015b06ed8cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:29:34.169877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1d0d3-851b-45b7-a76a-015b06ed8cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:29:34.170159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1d0d3-851b-45b7-a76a-015b06ed8cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:29:34.170472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1d0d3-851b-45b7-a76a-015b06ed8cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:29:34.179244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1d0d3-851b-45b7-a76a-015b06ed8cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:29:34.180678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1d0d3-851b-45b7-a76a-015b06ed8cf9 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:29:34.189760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 746/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:29:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:29:44.092729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=33 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:29:44.185885 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=33 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:31:02.332427 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12948-7fc0-4520-b05a-0d0452851f9e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:02.333268 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12948-7fc0-4520-b05a-0d0452851f9e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:02.333268 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12948-7fc0-4520-b05a-0d0452851f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:02.357110 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-46e12948-7fc0-4520-b05a-0d0452851f9e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:31:02.358348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-46e12948-7fc0-4520-b05a-0d0452851f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:31:02.367104 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 748/1494] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:31:02.376512 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7aea7c-199e-44d5-9f44-ebc06b277ce1 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:02.377048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7aea7c-199e-44d5-9f44-ebc06b277ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:02.377048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7aea7c-199e-44d5-9f44-ebc06b277ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:02.395470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5a7aea7c-199e-44d5-9f44-ebc06b277ce1 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:31:02.396645 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5a7aea7c-199e-44d5-9f44-ebc06b277ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:31:02.405237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 747/1495] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:31:02.409874 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e12948-7fc0-4520-b05a-0d0452851f9e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:31:02.420340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e12948-7fc0-4520-b05a-0d0452851f9e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:31:02.425725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a737838-5884-4b66-8ddb-a2870012e5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:31:02.426416 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a737838-5884-4b66-8ddb-a2870012e5bf admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:02.426747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a737838-5884-4b66-8ddb-a2870012e5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:02.427032 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a737838-5884-4b66-8ddb-a2870012e5bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:02.427775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a737838-5884-4b66-8ddb-a2870012e5bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:31:02.428090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a737838-5884-4b66-8ddb-a2870012e5bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:31:02.429123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: WARNING py.warnings [None req-1a737838-5884-4b66-8ddb-a2870012e5bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:31:02.429123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: warnings.warn(msg) Jun 15 00:31:02.429123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: Jun 15 00:31:02.430041 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a737838-5884-4b66-8ddb-a2870012e5bf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:31:02.442016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 749/1496] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:31:02.453906 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7aea7c-199e-44d5-9f44-ebc06b277ce1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:31:02.467622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7aea7c-199e-44d5-9f44-ebc06b277ce1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:31:02.473806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71481660-4ab0-40a2-b55f-616ca1bfe0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:31:02.474463 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71481660-4ab0-40a2-b55f-616ca1bfe0fa admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:02.474745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71481660-4ab0-40a2-b55f-616ca1bfe0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:02.475056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71481660-4ab0-40a2-b55f-616ca1bfe0fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:02.475755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71481660-4ab0-40a2-b55f-616ca1bfe0fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:31:02.477631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: WARNING py.warnings [None req-71481660-4ab0-40a2-b55f-616ca1bfe0fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:31:02.477631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: warnings.warn(msg) Jun 15 00:31:02.477631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: Jun 15 00:31:02.478812 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71481660-4ab0-40a2-b55f-616ca1bfe0fa admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:31:02.518830 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 748/1497] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:31:02 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:31:02.523321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a737838-5884-4b66-8ddb-a2870012e5bf admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:31:02.533444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a737838-5884-4b66-8ddb-a2870012e5bf admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:31:02.599858 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b71d5-46b7-458a-9635-2d21b5d4acce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:31:02.600461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b71d5-46b7-458a-9635-2d21b5d4acce admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:02.600748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b71d5-46b7-458a-9635-2d21b5d4acce admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:02.601020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b71d5-46b7-458a-9635-2d21b5d4acce admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:02.601754 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b71d5-46b7-458a-9635-2d21b5d4acce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:31:02.602797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: WARNING py.warnings [None req-ee9b71d5-46b7-458a-9635-2d21b5d4acce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:31:02.602797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: warnings.warn(msg) Jun 15 00:31:02.602797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: Jun 15 00:31:02.604010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b71d5-46b7-458a-9635-2d21b5d4acce admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:31:02.627580 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 750/1498] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:31:02 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:31:02.632122 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71481660-4ab0-40a2-b55f-616ca1bfe0fa admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:31:02.642802 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71481660-4ab0-40a2-b55f-616ca1bfe0fa admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:31:02.647391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d22da4-e73b-4fb4-99cf-2d1ec445e973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:31:02.648055 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d22da4-e73b-4fb4-99cf-2d1ec445e973 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:02.648347 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d22da4-e73b-4fb4-99cf-2d1ec445e973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:02.648624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d22da4-e73b-4fb4-99cf-2d1ec445e973 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:02.649375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d22da4-e73b-4fb4-99cf-2d1ec445e973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:31:02.650574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: WARNING py.warnings [None req-13d22da4-e73b-4fb4-99cf-2d1ec445e973 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:31:02.650574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: warnings.warn(msg) Jun 15 00:31:02.650574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: Jun 15 00:31:02.651455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d22da4-e73b-4fb4-99cf-2d1ec445e973 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:31:02.665004 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 749/1499] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:31:02.668808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b71d5-46b7-458a-9635-2d21b5d4acce admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:31:02.678785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b71d5-46b7-458a-9635-2d21b5d4acce admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:31:02.683520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb8a40-d9d8-4880-9528-d36dd4454dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:31:02.684186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb8a40-d9d8-4880-9528-d36dd4454dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:02.684479 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb8a40-d9d8-4880-9528-d36dd4454dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:02.684759 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb8a40-d9d8-4880-9528-d36dd4454dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:02.685602 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb8a40-d9d8-4880-9528-d36dd4454dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:31:02.686639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: WARNING py.warnings [None req-9deb8a40-d9d8-4880-9528-d36dd4454dbd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:31:02.686639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: warnings.warn(msg) Jun 15 00:31:02.686639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: Jun 15 00:31:02.687521 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb8a40-d9d8-4880-9528-d36dd4454dbd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:31:02.701522 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 751/1500] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:31:02.705868 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d22da4-e73b-4fb4-99cf-2d1ec445e973 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:31:02.716616 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d22da4-e73b-4fb4-99cf-2d1ec445e973 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:31:02.722246 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e529d-0391-41be-af1d-f2755cf0668c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:31:02.723184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e529d-0391-41be-af1d-f2755cf0668c admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:02.723466 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e529d-0391-41be-af1d-f2755cf0668c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:02.723743 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e529d-0391-41be-af1d-f2755cf0668c admin admin] PATH_INFO: `/v3/projects/7f73cf6d0abd464eba9a0c9243c5f7c2/users/65a93c4a62294853a104fc0f3d5b0a83/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:02.741593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e529d-0391-41be-af1d-f2755cf0668c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f73cf6d0abd464eba9a0c9243c5f7c2, user_id=65a93c4a62294853a104fc0f3d5b0a83, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:31:02.742647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: WARNING py.warnings [None req-b62e529d-0391-41be-af1d-f2755cf0668c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:31:02.742647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: warnings.warn(msg) Jun 15 00:31:02.742647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: Jun 15 00:31:02.744560 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e529d-0391-41be-af1d-f2755cf0668c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:31:02.764295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 750/1501] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:31:02 2022] PUT /identity/v3/projects/7f73cf6d0abd464eba9a0c9243c5f7c2/users/65a93c4a62294853a104fc0f3d5b0a83/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:31:02.776162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d2786-c24b-4743-b44e-0fc2da8cb97d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:02.776460 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d2786-c24b-4743-b44e-0fc2da8cb97d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:02.776742 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d2786-c24b-4743-b44e-0fc2da8cb97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:02.804444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-671d2786-c24b-4743-b44e-0fc2da8cb97d None None] MFA Rules not processed for user `65a93c4a62294853a104fc0f3d5b0a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:31:02.805694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-671d2786-c24b-4743-b44e-0fc2da8cb97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:31:02.872412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 752/1502] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:31:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:31:02.886185 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b4ef4-34a9-4336-99dd-07f22fe859ec None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:02.886475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b4ef4-34a9-4336-99dd-07f22fe859ec None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:02.886749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b4ef4-34a9-4336-99dd-07f22fe859ec None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:02.888162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 751/1503] 10.222.0.36 () {54 vars in 963 bytes} [Wed Jun 15 00:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:31:02.893148 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e5213-f94b-48c5-95f1-0b812b6ea7d7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:02.893471 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e5213-f94b-48c5-95f1-0b812b6ea7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:02.893871 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e5213-f94b-48c5-95f1-0b812b6ea7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:02.914306 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-386e5213-f94b-48c5-95f1-0b812b6ea7d7 None None] MFA Rules not processed for user `d41065b495234fd98552222fc32cc53e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:31:02.915534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-386e5213-f94b-48c5-95f1-0b812b6ea7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:31:02.961554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:31:02.970307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 753/1504] 10.222.0.36 () {58 vars in 1060 bytes} [Wed Jun 15 00:31:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:31:02.978317 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b4ef4-34a9-4336-99dd-07f22fe859ec None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:31:02.990644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b4ef4-34a9-4336-99dd-07f22fe859ec None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:31:02.994824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886677b-64be-41a8-8e0c-ffef159e023c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:31:02.995468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886677b-64be-41a8-8e0c-ffef159e023c service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:02.995754 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886677b-64be-41a8-8e0c-ffef159e023c service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:02.996035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886677b-64be-41a8-8e0c-ffef159e023c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:03.004489 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886677b-64be-41a8-8e0c-ffef159e023c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:31:03.006075 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886677b-64be-41a8-8e0c-ffef159e023c service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:31:03.014833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 752/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:31:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:31:03.064267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c231f-d9f0-4c2c-b916-2164067f2731 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:03.064559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c231f-d9f0-4c2c-b916-2164067f2731 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:03.064838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c231f-d9f0-4c2c-b916-2164067f2731 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:03.066308 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 754/1506] 10.222.0.36 () {52 vars in 829 bytes} [Wed Jun 15 00:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:31:03.070187 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886677b-64be-41a8-8e0c-ffef159e023c service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:31:03.136270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886677b-64be-41a8-8e0c-ffef159e023c service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:31:03.141618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528d15f-9c86-4343-8123-c276c3f7fb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:31:03.142532 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528d15f-9c86-4343-8123-c276c3f7fb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:03.142821 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528d15f-9c86-4343-8123-c276c3f7fb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:03.143102 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528d15f-9c86-4343-8123-c276c3f7fb77 admin admin] PATH_INFO: `/v3/users/65a93c4a62294853a104fc0f3d5b0a83` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:03.144329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528d15f-9c86-4343-8123-c276c3f7fb77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a93c4a62294853a104fc0f3d5b0a83)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:31:03.145389 dv-cinder-835384-6-smb devstack@keystone.service[80188]: WARNING py.warnings [None req-3528d15f-9c86-4343-8123-c276c3f7fb77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:31:03.145389 dv-cinder-835384-6-smb devstack@keystone.service[80188]: warnings.warn(msg) Jun 15 00:31:03.145389 dv-cinder-835384-6-smb devstack@keystone.service[80188]: Jun 15 00:31:03.146604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528d15f-9c86-4343-8123-c276c3f7fb77 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:31:03.217127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3528d15f-9c86-4343-8123-c276c3f7fb77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a93c4a62294853a104fc0f3d5b0a83'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:31:03.228410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3528d15f-9c86-4343-8123-c276c3f7fb77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a93c4a62294853a104fc0f3d5b0a83'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:31:03.229148 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3528d15f-9c86-4343-8123-c276c3f7fb77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a93c4a62294853a104fc0f3d5b0a83'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:31:03.230269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3528d15f-9c86-4343-8123-c276c3f7fb77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a93c4a62294853a104fc0f3d5b0a83'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:31:03.250459 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3528d15f-9c86-4343-8123-c276c3f7fb77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a93c4a62294853a104fc0f3d5b0a83'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:31:03.259879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:31:03.272559 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 753/1507] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:31:03 2022] DELETE /identity/v3/users/65a93c4a62294853a104fc0f3d5b0a83 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:31:03.278581 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e404df1-73db-4629-be27-a38dfb8b9588 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:03.278869 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e404df1-73db-4629-be27-a38dfb8b9588 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:03.279151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e404df1-73db-4629-be27-a38dfb8b9588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:03.297481 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0e404df1-73db-4629-be27-a38dfb8b9588 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:31:03.298677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0e404df1-73db-4629-be27-a38dfb8b9588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:31:03.368069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 755/1508] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:31:03.378684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528d15f-9c86-4343-8123-c276c3f7fb77 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:31:03.380218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3528d15f-9c86-4343-8123-c276c3f7fb77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:31:03.439110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528d15f-9c86-4343-8123-c276c3f7fb77 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:31:03.443008 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832b397-a34f-468e-b03d-6c7e351d09fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:31:03.443662 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832b397-a34f-468e-b03d-6c7e351d09fb service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:03.443953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832b397-a34f-468e-b03d-6c7e351d09fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:03.444225 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832b397-a34f-468e-b03d-6c7e351d09fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:03.453634 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832b397-a34f-468e-b03d-6c7e351d09fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:31:03.455075 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832b397-a34f-468e-b03d-6c7e351d09fb service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:31:03.464958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 754/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:31:03.821635 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e404df1-73db-4629-be27-a38dfb8b9588 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:31:03.823170 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0e404df1-73db-4629-be27-a38dfb8b9588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:31:03.839094 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e404df1-73db-4629-be27-a38dfb8b9588 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:31:03.844016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c8b39-afe4-4986-b00a-8c0e9e38676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:31:03.844944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c8b39-afe4-4986-b00a-8c0e9e38676d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:31:03.845233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c8b39-afe4-4986-b00a-8c0e9e38676d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:31:03.845557 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c8b39-afe4-4986-b00a-8c0e9e38676d admin admin] PATH_INFO: `/v3/projects/7f73cf6d0abd464eba9a0c9243c5f7c2` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:31:03.846755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c8b39-afe4-4986-b00a-8c0e9e38676d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f73cf6d0abd464eba9a0c9243c5f7c2)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:31:03.847829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: WARNING py.warnings [None req-ce4c8b39-afe4-4986-b00a-8c0e9e38676d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:31:03.847829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: warnings.warn(msg) Jun 15 00:31:03.847829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: Jun 15 00:31:03.849047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c8b39-afe4-4986-b00a-8c0e9e38676d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:31:03.914524 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ce4c8b39-afe4-4986-b00a-8c0e9e38676d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f73cf6d0abd464eba9a0c9243c5f7c2', 'request_id': 'req-ce4c8b39-afe4-4986-b00a-8c0e9e38676d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:31:03.921030 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ce4c8b39-afe4-4986-b00a-8c0e9e38676d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f73cf6d0abd464eba9a0c9243c5f7c2', 'request_id': 'req-ce4c8b39-afe4-4986-b00a-8c0e9e38676d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:31:03.934713 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ce4c8b39-afe4-4986-b00a-8c0e9e38676d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f73cf6d0abd464eba9a0c9243c5f7c2', 'request_id': 'req-ce4c8b39-afe4-4986-b00a-8c0e9e38676d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:31:03.951544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ce4c8b39-afe4-4986-b00a-8c0e9e38676d admin admin] The token cache is being invalidate because project 7f73cf6d0abd464eba9a0c9243c5f7c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:31:03.951834 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ce4c8b39-afe4-4986-b00a-8c0e9e38676d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:31:03.952473 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ce4c8b39-afe4-4986-b00a-8c0e9e38676d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:31:03.954165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 756/1510] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:31:03 2022] DELETE /identity/v3/projects/7f73cf6d0abd464eba9a0c9243c5f7c2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:31:13.460351 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=29 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:31:13.948184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:32:50.313530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98e9e3-d007-4e9f-80d2-b3c21c41d652 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:50.314463 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98e9e3-d007-4e9f-80d2-b3c21c41d652 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:50.314463 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98e9e3-d007-4e9f-80d2-b3c21c41d652 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:50.316691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:32:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:50.321934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528bd06-5fe5-4273-bab5-6fb76933e8bb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:50.322366 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528bd06-5fe5-4273-bab5-6fb76933e8bb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:50.322475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528bd06-5fe5-4273-bab5-6fb76933e8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:50.343314 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6528bd06-5fe5-4273-bab5-6fb76933e8bb None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:50.343314 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6528bd06-5fe5-4273-bab5-6fb76933e8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:50.403039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:32:50.581014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98e9e3-d007-4e9f-80d2-b3c21c41d652 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:32:50.583875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ab98e9e3-d007-4e9f-80d2-b3c21c41d652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:50.670497 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98e9e3-d007-4e9f-80d2-b3c21c41d652 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:32:50.676706 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54554495-c0ce-4c79-89db-fa640bd47bd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:32:50.677372 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54554495-c0ce-4c79-89db-fa640bd47bd2 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:50.677682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54554495-c0ce-4c79-89db-fa640bd47bd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:50.677963 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54554495-c0ce-4c79-89db-fa640bd47bd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:50.686493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54554495-c0ce-4c79-89db-fa640bd47bd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:32:50.688105 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54554495-c0ce-4c79-89db-fa640bd47bd2 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:32:50.697872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 756/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:32:51.555709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db4918-079d-4362-819f-ac4b501b311c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:51.556628 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db4918-079d-4362-819f-ac4b501b311c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:51.556628 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db4918-079d-4362-819f-ac4b501b311c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:51.558952 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:32:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:32:51.566775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cecf4-b6c6-4be2-9c00-e07d95a3e5de None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:51.567226 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cecf4-b6c6-4be2-9c00-e07d95a3e5de None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:51.567351 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cecf4-b6c6-4be2-9c00-e07d95a3e5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:51.594090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-510cecf4-b6c6-4be2-9c00-e07d95a3e5de None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:51.595325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-510cecf4-b6c6-4be2-9c00-e07d95a3e5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:51.604181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:32:51.758189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db4918-079d-4362-819f-ac4b501b311c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:32:51.777691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db4918-079d-4362-819f-ac4b501b311c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:32:51.786297 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a5f2a-df4c-4e70-81bf-5480f96496b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:32:51.787232 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a5f2a-df4c-4e70-81bf-5480f96496b9 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:51.787640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a5f2a-df4c-4e70-81bf-5480f96496b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:51.788038 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a5f2a-df4c-4e70-81bf-5480f96496b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:51.799575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a5f2a-df4c-4e70-81bf-5480f96496b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:32:51.801235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a5f2a-df4c-4e70-81bf-5480f96496b9 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:32:51.811875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 759/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:32:52.085392 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7fe6c-c545-479e-a2dd-f373e740edd1 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:52.085715 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7fe6c-c545-479e-a2dd-f373e740edd1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:52.085988 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7fe6c-c545-479e-a2dd-f373e740edd1 None None] PATH_INFO: `/v3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:52.087333 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 758/1517] 10.222.0.39 () {54 vars in 925 bytes} [Wed Jun 15 00:32:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:32:52.094520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be5d5e-8270-4308-b6b5-b893859c1db4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:32:52.094813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be5d5e-8270-4308-b6b5-b893859c1db4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:32:52.095097 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be5d5e-8270-4308-b6b5-b893859c1db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:32:52.115273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-19be5d5e-8270-4308-b6b5-b893859c1db4 None None] MFA Rules not processed for user `24e6dd029a3d45f6aeb4da06db9753dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:32:52.116491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-19be5d5e-8270-4308-b6b5-b893859c1db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:32:52.183917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 760/1518] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Jun 15 00:32:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:01.196217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57afeb-ff28-4dc7-812b-cd44a2407e1d None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:01.197119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57afeb-ff28-4dc7-812b-cd44a2407e1d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:01.197119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57afeb-ff28-4dc7-812b-cd44a2407e1d None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:01.199295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 759/1519] 10.222.0.36 () {54 vars in 960 bytes} [Wed Jun 15 00:33:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:01.204703 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd05abd-e67d-429a-b8c9-d48dc74bb108 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:01.205159 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd05abd-e67d-429a-b8c9-d48dc74bb108 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:01.205272 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd05abd-e67d-429a-b8c9-d48dc74bb108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:01.224830 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2cd05abd-e67d-429a-b8c9-d48dc74bb108 None None] MFA Rules not processed for user `24e6dd029a3d45f6aeb4da06db9753dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:01.226099 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2cd05abd-e67d-429a-b8c9-d48dc74bb108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:01.235518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 761/1520] 10.222.0.36 () {58 vars in 1057 bytes} [Wed Jun 15 00:33:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:01.243073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57afeb-ff28-4dc7-812b-cd44a2407e1d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:01.257283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57afeb-ff28-4dc7-812b-cd44a2407e1d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:01.262234 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2f2ee-79c3-4e8a-bed8-8c7c5c962dda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e6dd029a3d45f6aeb4da06db9753dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:01.262879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2f2ee-79c3-4e8a-bed8-8c7c5c962dda service placement] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:01.263162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2f2ee-79c3-4e8a-bed8-8c7c5c962dda service placement] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:01.263437 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2f2ee-79c3-4e8a-bed8-8c7c5c962dda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:01.271540 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2f2ee-79c3-4e8a-bed8-8c7c5c962dda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:01.273206 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2f2ee-79c3-4e8a-bed8-8c7c5c962dda service placement] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:01.282739 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 760/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:03.093256 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6dce7-cff7-4328-961e-5799afedda64 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:03.093821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6dce7-cff7-4328-961e-5799afedda64 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:03.093821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6dce7-cff7-4328-961e-5799afedda64 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:03.095251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:03.100311 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99079892-e1f0-4697-89d2-7425a68bcb25 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:03.100765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99079892-e1f0-4697-89d2-7425a68bcb25 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:03.100864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99079892-e1f0-4697-89d2-7425a68bcb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:03.120562 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-99079892-e1f0-4697-89d2-7425a68bcb25 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:03.121796 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-99079892-e1f0-4697-89d2-7425a68bcb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:03.130525 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:03.290466 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6dce7-cff7-4328-961e-5799afedda64 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:03.307288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6dce7-cff7-4328-961e-5799afedda64 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:03.312766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c99c39-4fc2-45dc-b914-d9cf3dbd13ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:03.313429 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c99c39-4fc2-45dc-b914-d9cf3dbd13ad service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:03.313740 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c99c39-4fc2-45dc-b914-d9cf3dbd13ad service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:03.314016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c99c39-4fc2-45dc-b914-d9cf3dbd13ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:03.322832 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c99c39-4fc2-45dc-b914-d9cf3dbd13ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:03.324350 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c99c39-4fc2-45dc-b914-d9cf3dbd13ad service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:03.334481 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 763/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:04.191240 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e627d-15c9-4179-a725-18d8b5dabc9b None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:04.191778 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e627d-15c9-4179-a725-18d8b5dabc9b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:04.191778 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e627d-15c9-4179-a725-18d8b5dabc9b None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:04.193202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 15 00:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:04.198959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9efa5b-42f0-4ba1-8940-dd0420748396 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:04.199706 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9efa5b-42f0-4ba1-8940-dd0420748396 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:04.199820 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9efa5b-42f0-4ba1-8940-dd0420748396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:04.222128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-da9efa5b-42f0-4ba1-8940-dd0420748396 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:04.223341 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-da9efa5b-42f0-4ba1-8940-dd0420748396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:04.232582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 15 00:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:04.398186 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e627d-15c9-4179-a725-18d8b5dabc9b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:04.416623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e627d-15c9-4179-a725-18d8b5dabc9b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:04.423523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1a846-0c89-4ca6-a7fd-4d4b0835856a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:04.424151 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a846-0c89-4ca6-a7fd-4d4b0835856a service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:04.424431 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a846-0c89-4ca6-a7fd-4d4b0835856a service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:04.424712 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a846-0c89-4ca6-a7fd-4d4b0835856a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:04.433016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1a846-0c89-4ca6-a7fd-4d4b0835856a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:04.434724 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1a846-0c89-4ca6-a7fd-4d4b0835856a service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:04.444814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 763/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:08.380950 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c03de2-c313-406b-99fb-0a384280e397 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:08.381852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c03de2-c313-406b-99fb-0a384280e397 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:08.381852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c03de2-c313-406b-99fb-0a384280e397 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:08.383987 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:33:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:08.392792 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91264c-e907-4ccc-a6c3-f699bf594d2d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:08.393224 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91264c-e907-4ccc-a6c3-f699bf594d2d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:08.393321 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91264c-e907-4ccc-a6c3-f699bf594d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:08.413745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5a91264c-e907-4ccc-a6c3-f699bf594d2d None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:08.414953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5a91264c-e907-4ccc-a6c3-f699bf594d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:08.425501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:08.462556 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c03de2-c313-406b-99fb-0a384280e397 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:08.464782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b0c03de2-c313-406b-99fb-0a384280e397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:08.524848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c03de2-c313-406b-99fb-0a384280e397 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:08.528960 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb2006-8612-4194-972c-5b45b6ca3d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:08.529631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb2006-8612-4194-972c-5b45b6ca3d87 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:08.529921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb2006-8612-4194-972c-5b45b6ca3d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:08.530187 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb2006-8612-4194-972c-5b45b6ca3d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:08.539498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb2006-8612-4194-972c-5b45b6ca3d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:08.540943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb2006-8612-4194-972c-5b45b6ca3d87 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:08.546037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:08.551533 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 766/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:10.638727 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613725c2-b766-4322-aee1-481eef42a1b9 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:10.639332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613725c2-b766-4322-aee1-481eef42a1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:10.639332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613725c2-b766-4322-aee1-481eef42a1b9 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:10.640678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:10.648745 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b22c8-2edd-4c43-a841-ea8d7db83410 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:10.649603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b22c8-2edd-4c43-a841-ea8d7db83410 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:10.650480 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b22c8-2edd-4c43-a841-ea8d7db83410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:10.680040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d13b22c8-2edd-4c43-a841-ea8d7db83410 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:10.681260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d13b22c8-2edd-4c43-a841-ea8d7db83410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:10.690805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:10.726911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613725c2-b766-4322-aee1-481eef42a1b9 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:10.746527 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613725c2-b766-4322-aee1-481eef42a1b9 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:10.753022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad16937-0e6d-4fee-af0f-26414c0484a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:10.753703 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad16937-0e6d-4fee-af0f-26414c0484a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:10.753985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad16937-0e6d-4fee-af0f-26414c0484a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:10.754254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad16937-0e6d-4fee-af0f-26414c0484a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:10.764049 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad16937-0e6d-4fee-af0f-26414c0484a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:10.765528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad16937-0e6d-4fee-af0f-26414c0484a9 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:10.775245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 766/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:14.536412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31fae7-37cd-4919-8181-5be9a78b4d54 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:14.537336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31fae7-37cd-4919-8181-5be9a78b4d54 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:14.537336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31fae7-37cd-4919-8181-5be9a78b4d54 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:14.539435 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:33:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:14.547442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d0f00-b258-4e5c-a987-ba1e07672d85 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:14.547897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d0f00-b258-4e5c-a987-ba1e07672d85 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:14.548008 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d0f00-b258-4e5c-a987-ba1e07672d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:14.555434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=62 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:14.568516 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c08d0f00-b258-4e5c-a987-ba1e07672d85 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:14.569752 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c08d0f00-b258-4e5c-a987-ba1e07672d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:14.578044 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:33:14.849186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31fae7-37cd-4919-8181-5be9a78b4d54 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:14.852159 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-db31fae7-37cd-4919-8181-5be9a78b4d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:14.916478 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31fae7-37cd-4919-8181-5be9a78b4d54 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:14.921089 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b787a00-c435-423e-be3a-71e26f74ceb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:14.921780 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b787a00-c435-423e-be3a-71e26f74ceb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:14.922066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b787a00-c435-423e-be3a-71e26f74ceb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:14.922357 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b787a00-c435-423e-be3a-71e26f74ceb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:14.931978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b787a00-c435-423e-be3a-71e26f74ceb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:14.933453 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b787a00-c435-423e-be3a-71e26f74ceb7 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:14.942974 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 769/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:17.077409 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f61c75-6ccf-4e6a-b4a5-1be9edeefcc5 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:17.078208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f61c75-6ccf-4e6a-b4a5-1be9edeefcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:17.078370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f61c75-6ccf-4e6a-b4a5-1be9edeefcc5 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:17.080669 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 15 00:33:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:33:17.086113 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e24be3-8289-416a-ab85-96bf108360f3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:17.086563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e24be3-8289-416a-ab85-96bf108360f3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:17.086676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e24be3-8289-416a-ab85-96bf108360f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:17.106054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b2e24be3-8289-416a-ab85-96bf108360f3 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:33:17.107260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b2e24be3-8289-416a-ab85-96bf108360f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:17.116865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 15 00:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:33:17.389740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f61c75-6ccf-4e6a-b4a5-1be9edeefcc5 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:33:17.393019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f3f61c75-6ccf-4e6a-b4a5-1be9edeefcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:33:17.408128 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f61c75-6ccf-4e6a-b4a5-1be9edeefcc5 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:33:17.412004 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b67da-0899-43df-98ce-c7f74815a53b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:33:17.412644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b67da-0899-43df-98ce-c7f74815a53b service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:33:17.412926 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b67da-0899-43df-98ce-c7f74815a53b service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:33:17.413203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b67da-0899-43df-98ce-c7f74815a53b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:33:17.422520 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b67da-0899-43df-98ce-c7f74815a53b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:33:17.423948 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b67da-0899-43df-98ce-c7f74815a53b service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:33:17.433612 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 769/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:33:27.100657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=32 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:33:27.429706 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=8 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:49.650242 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a4bf1-b380-4fc8-8f80-ddba8389a5b3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:49.650912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a4bf1-b380-4fc8-8f80-ddba8389a5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:49.650912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a4bf1-b380-4fc8-8f80-ddba8389a5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:49.674270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f71a4bf1-b380-4fc8-8f80-ddba8389a5b3 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:49.675507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f71a4bf1-b380-4fc8-8f80-ddba8389a5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:49.685211 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 771/1540] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:49.696028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a7941-9f57-428b-9397-2173936ec62d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:49.696622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a7941-9f57-428b-9397-2173936ec62d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:49.696622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a7941-9f57-428b-9397-2173936ec62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:49.716134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2d2a7941-9f57-428b-9397-2173936ec62d None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:49.717333 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2d2a7941-9f57-428b-9397-2173936ec62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:49.730812 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 770/1541] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:49.735923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a4bf1-b380-4fc8-8f80-ddba8389a5b3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:49.744043 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2df4be-b412-4667-8de1-b6af48aaed74 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:49.745861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2df4be-b412-4667-8de1-b6af48aaed74 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:49.745861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2df4be-b412-4667-8de1-b6af48aaed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:49.747470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a4bf1-b380-4fc8-8f80-ddba8389a5b3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:49.762257 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f849875-e741-49a8-a251-c5b531ddc105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:49.763394 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f849875-e741-49a8-a251-c5b531ddc105 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:49.763913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f849875-e741-49a8-a251-c5b531ddc105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:49.764405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f849875-e741-49a8-a251-c5b531ddc105 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:49.765491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f849875-e741-49a8-a251-c5b531ddc105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:34:49.766053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f849875-e741-49a8-a251-c5b531ddc105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:49.767958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f849875-e741-49a8-a251-c5b531ddc105 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:49.778067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8d2df4be-b412-4667-8de1-b6af48aaed74 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:49.778443 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8d2df4be-b412-4667-8de1-b6af48aaed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:49.793369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 771/1542] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:34:49.794482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 772/1543] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:34:49.808992 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2df4be-b412-4667-8de1-b6af48aaed74 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:49.809932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce962a-0852-4f63-9523-6a4f0ba9b14a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:49.810460 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce962a-0852-4f63-9523-6a4f0ba9b14a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:49.810957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce962a-0852-4f63-9523-6a4f0ba9b14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:49.822497 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2df4be-b412-4667-8de1-b6af48aaed74 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:49.832246 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a9151-ef6f-45dc-9e50-494f3d37aeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:49.832924 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a9151-ef6f-45dc-9e50-494f3d37aeb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:49.833206 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a9151-ef6f-45dc-9e50-494f3d37aeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:49.833511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a9151-ef6f-45dc-9e50-494f3d37aeb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:49.834215 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a9151-ef6f-45dc-9e50-494f3d37aeb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:49.841377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a9151-ef6f-45dc-9e50-494f3d37aeb9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:49.841554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e6ce962a-0852-4f63-9523-6a4f0ba9b14a None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:49.841554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e6ce962a-0852-4f63-9523-6a4f0ba9b14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:49.858747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 773/1544] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:49.866904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce962a-0852-4f63-9523-6a4f0ba9b14a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:49.880184 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce962a-0852-4f63-9523-6a4f0ba9b14a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:49.886840 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 772/1545] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:34:49 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:49.889578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1376a-8507-4df7-b8bb-7f4721c732f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:49.890278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1376a-8507-4df7-b8bb-7f4721c732f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:49.890562 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1376a-8507-4df7-b8bb-7f4721c732f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:49.890838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1376a-8507-4df7-b8bb-7f4721c732f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:49.891581 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1376a-8507-4df7-b8bb-7f4721c732f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:34:49.892034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1376a-8507-4df7-b8bb-7f4721c732f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:49.893774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1376a-8507-4df7-b8bb-7f4721c732f4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:49.906996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a9151-ef6f-45dc-9e50-494f3d37aeb9 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:49.920991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 774/1546] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:34:49.929123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1376a-8507-4df7-b8bb-7f4721c732f4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:49.940110 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1376a-8507-4df7-b8bb-7f4721c732f4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.011810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a9151-ef6f-45dc-9e50-494f3d37aeb9 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.027428 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed1f91-eec7-4928-86a4-fe395715c24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.028146 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed1f91-eec7-4928-86a4-fe395715c24a admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.028430 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed1f91-eec7-4928-86a4-fe395715c24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.028815 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed1f91-eec7-4928-86a4-fe395715c24a admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.029959 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed1f91-eec7-4928-86a4-fe395715c24a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.031017 dv-cinder-835384-6-smb devstack@keystone.service[80188]: WARNING py.warnings [None req-69ed1f91-eec7-4928-86a4-fe395715c24a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:34:50.031017 dv-cinder-835384-6-smb devstack@keystone.service[80188]: warnings.warn(msg) Jun 15 00:34:50.031017 dv-cinder-835384-6-smb devstack@keystone.service[80188]: Jun 15 00:34:50.032259 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed1f91-eec7-4928-86a4-fe395715c24a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.038938 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541108ba-336f-408c-ad21-32e8cd6a5e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.039637 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541108ba-336f-408c-ad21-32e8cd6a5e64 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.039922 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541108ba-336f-408c-ad21-32e8cd6a5e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.040201 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541108ba-336f-408c-ad21-32e8cd6a5e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.040916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541108ba-336f-408c-ad21-32e8cd6a5e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.041990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: WARNING py.warnings [None req-541108ba-336f-408c-ad21-32e8cd6a5e64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:34:50.041990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: warnings.warn(msg) Jun 15 00:34:50.041990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: Jun 15 00:34:50.043183 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541108ba-336f-408c-ad21-32e8cd6a5e64 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.085402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 773/1547] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:34:49 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:50.085402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8d1c1-c9ef-4981-9d03-9dddc7eeeeaa None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.085402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8d1c1-c9ef-4981-9d03-9dddc7eeeeaa None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.085402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8d1c1-c9ef-4981-9d03-9dddc7eeeeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.103524 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 775/1548] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:34:49 2022] POST /identity/v3/projects => generated 403 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:34:50.104913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8509-e2e8-4796-93b0-4eb73d1f4070 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.105205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8509-e2e8-4796-93b0-4eb73d1f4070 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.105528 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8509-e2e8-4796-93b0-4eb73d1f4070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.121973 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-91c8d1c1-c9ef-4981-9d03-9dddc7eeeeaa None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:50.123267 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-91c8d1c1-c9ef-4981-9d03-9dddc7eeeeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:50.127881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-04be8509-e2e8-4796-93b0-4eb73d1f4070 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:50.129036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-04be8509-e2e8-4796-93b0-4eb73d1f4070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:50.219966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 776/1549] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:50.220943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8509-e2e8-4796-93b0-4eb73d1f4070 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.221900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 774/1550] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:50.223077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034cdac-39e8-4c8d-a8d6-a04527c0665b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.223372 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034cdac-39e8-4c8d-a8d6-a04527c0665b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.223660 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034cdac-39e8-4c8d-a8d6-a04527c0665b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.233462 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8509-e2e8-4796-93b0-4eb73d1f4070 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.238110 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c187c-396b-4a03-a3d4-1acdeac89baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.238795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c187c-396b-4a03-a3d4-1acdeac89baf admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.239084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c187c-396b-4a03-a3d4-1acdeac89baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.239366 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c187c-396b-4a03-a3d4-1acdeac89baf admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.240110 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c187c-396b-4a03-a3d4-1acdeac89baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.241882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c187c-396b-4a03-a3d4-1acdeac89baf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.246198 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5034cdac-39e8-4c8d-a8d6-a04527c0665b None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:50.247412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5034cdac-39e8-4c8d-a8d6-a04527c0665b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:50.252301 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 777/1551] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:50.252885 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c187c-396b-4a03-a3d4-1acdeac89baf admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.255527 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 775/1552] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:50.256896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd32fc-6b10-4996-bb5b-0b9cf7c35b0b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.257256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd32fc-6b10-4996-bb5b-0b9cf7c35b0b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.257638 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd32fc-6b10-4996-bb5b-0b9cf7c35b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.263368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c187c-396b-4a03-a3d4-1acdeac89baf admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.267690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55fda4-e350-4a23-b146-98d3fbf023ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.268364 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55fda4-e350-4a23-b146-98d3fbf023ca admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.268652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55fda4-e350-4a23-b146-98d3fbf023ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.268934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55fda4-e350-4a23-b146-98d3fbf023ca admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.269678 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55fda4-e350-4a23-b146-98d3fbf023ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.271591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55fda4-e350-4a23-b146-98d3fbf023ca admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.275278 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-42dd32fc-6b10-4996-bb5b-0b9cf7c35b0b None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:50.276513 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-42dd32fc-6b10-4996-bb5b-0b9cf7c35b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:50.285806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 776/1553] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:50.287090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679045-2e38-4a12-aa55-0b2bc3add069 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.287436 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679045-2e38-4a12-aa55-0b2bc3add069 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.287783 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679045-2e38-4a12-aa55-0b2bc3add069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.295869 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 778/1554] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/users => generated 302 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:50.297753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f6988-2349-49c3-ac05-33dd14f7fe72 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.298049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f6988-2349-49c3-ac05-33dd14f7fe72 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.298327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f6988-2349-49c3-ac05-33dd14f7fe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.307604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-11679045-2e38-4a12-aa55-0b2bc3add069 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:50.308815 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-11679045-2e38-4a12-aa55-0b2bc3add069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:50.316687 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-443f6988-2349-49c3-ac05-33dd14f7fe72 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:50.316902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 777/1555] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:50.317964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-443f6988-2349-49c3-ac05-33dd14f7fe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:50.318221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362cc7b-0bae-40d5-88cc-ae46082d7d01 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.318563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362cc7b-0bae-40d5-88cc-ae46082d7d01 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.318877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362cc7b-0bae-40d5-88cc-ae46082d7d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.329439 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 779/1556] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:50.330782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af76969-ac09-41c3-a457-b049c377961b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.331076 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af76969-ac09-41c3-a457-b049c377961b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.331353 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af76969-ac09-41c3-a457-b049c377961b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.338660 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2362cc7b-0bae-40d5-88cc-ae46082d7d01 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:50.339880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2362cc7b-0bae-40d5-88cc-ae46082d7d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:50.348028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 778/1557] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:50.348028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362cc7b-0bae-40d5-88cc-ae46082d7d01 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.358347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3af76969-ac09-41c3-a457-b049c377961b None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:50.358603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362cc7b-0bae-40d5-88cc-ae46082d7d01 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.359535 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3af76969-ac09-41c3-a457-b049c377961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:50.363137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e520db1-962b-4bbc-85ea-4a50d20f19bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.363797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e520db1-962b-4bbc-85ea-4a50d20f19bf admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.364086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e520db1-962b-4bbc-85ea-4a50d20f19bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.364363 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e520db1-962b-4bbc-85ea-4a50d20f19bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.365134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e520db1-962b-4bbc-85ea-4a50d20f19bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.366808 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e520db1-962b-4bbc-85ea-4a50d20f19bf admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.367445 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 780/1558] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:50.368506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecd8db-2f9c-4d3a-9792-1bda32c9708d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.368792 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecd8db-2f9c-4d3a-9792-1bda32c9708d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.369079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecd8db-2f9c-4d3a-9792-1bda32c9708d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.375890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:50.380293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 779/1559] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:50.380293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15e99b-4705-447c-97bb-4cc4cb0836ec None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.380293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15e99b-4705-447c-97bb-4cc4cb0836ec None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.380293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15e99b-4705-447c-97bb-4cc4cb0836ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.389249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-59ecd8db-2f9c-4d3a-9792-1bda32c9708d None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:50.390481 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-59ecd8db-2f9c-4d3a-9792-1bda32c9708d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:50.398411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 781/1560] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:50.398891 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2c15e99b-4705-447c-97bb-4cc4cb0836ec None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:50.399185 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecd8db-2f9c-4d3a-9792-1bda32c9708d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.400069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2c15e99b-4705-447c-97bb-4cc4cb0836ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:50.407987 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 780/1561] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:50.408820 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecd8db-2f9c-4d3a-9792-1bda32c9708d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.409205 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45402ba-ef24-4240-998d-41d0b36e2837 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.409538 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45402ba-ef24-4240-998d-41d0b36e2837 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.409829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45402ba-ef24-4240-998d-41d0b36e2837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.413831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd0375-1c0b-4d15-a5ec-0699704bb4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.414785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0375-1c0b-4d15-a5ec-0699704bb4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.415067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0375-1c0b-4d15-a5ec-0699704bb4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.415339 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0375-1c0b-4d15-a5ec-0699704bb4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.416289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd0375-1c0b-4d15-a5ec-0699704bb4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.417996 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd0375-1c0b-4d15-a5ec-0699704bb4b6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.427994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b45402ba-ef24-4240-998d-41d0b36e2837 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:50.428179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 782/1562] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:50.429611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0172c-699b-4cdb-8869-9ade4820e65c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.429723 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b45402ba-ef24-4240-998d-41d0b36e2837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:50.429901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0172c-699b-4cdb-8869-9ade4820e65c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.430174 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0172c-699b-4cdb-8869-9ade4820e65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.437575 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 781/1563] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:50.438352 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45402ba-ef24-4240-998d-41d0b36e2837 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.444081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:50.448485 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45402ba-ef24-4240-998d-41d0b36e2837 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.451554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-82c0172c-699b-4cdb-8869-9ade4820e65c None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:50.452749 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-82c0172c-699b-4cdb-8869-9ade4820e65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:50.454369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576bb6e-e863-42f1-a9ea-057a6690d96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.455032 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576bb6e-e863-42f1-a9ea-057a6690d96e admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.455338 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576bb6e-e863-42f1-a9ea-057a6690d96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.455595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576bb6e-e863-42f1-a9ea-057a6690d96e admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.456328 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576bb6e-e863-42f1-a9ea-057a6690d96e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:34:50.456644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576bb6e-e863-42f1-a9ea-057a6690d96e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.457710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: WARNING py.warnings [None req-e576bb6e-e863-42f1-a9ea-057a6690d96e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:34:50.457710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: warnings.warn(msg) Jun 15 00:34:50.457710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: Jun 15 00:34:50.458595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576bb6e-e863-42f1-a9ea-057a6690d96e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.460532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 783/1564] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:50.461410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0172c-699b-4cdb-8869-9ade4820e65c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.470554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 782/1565] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:34:50.470967 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0172c-699b-4cdb-8869-9ade4820e65c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.471335 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576bb6e-e863-42f1-a9ea-057a6690d96e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.475595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d51ae-668a-46b0-bcb7-447eec0aaa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.476446 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d51ae-668a-46b0-bcb7-447eec0aaa66 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.476731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d51ae-668a-46b0-bcb7-447eec0aaa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.477006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d51ae-668a-46b0-bcb7-447eec0aaa66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.477788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d51ae-668a-46b0-bcb7-447eec0aaa66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:34:50.478104 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d51ae-668a-46b0-bcb7-447eec0aaa66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.479708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d51ae-668a-46b0-bcb7-447eec0aaa66 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.483935 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576bb6e-e863-42f1-a9ea-057a6690d96e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.488585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05defabe-d177-496f-b49a-66150e3ecc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.489535 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05defabe-d177-496f-b49a-66150e3ecc48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.489820 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05defabe-d177-496f-b49a-66150e3ecc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.490124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05defabe-d177-496f-b49a-66150e3ecc48 admin admin] PATH_INFO: `/v3/projects/7e81c359988f4cb8b315375e046a252d/users/d6ae6bd14d1a437d9d40409061e65eee/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.492153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 784/1566] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:34:50.492945 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d51ae-668a-46b0-bcb7-447eec0aaa66 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.504118 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d51ae-668a-46b0-bcb7-447eec0aaa66 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.505303 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05defabe-d177-496f-b49a-66150e3ecc48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e81c359988f4cb8b315375e046a252d, user_id=d6ae6bd14d1a437d9d40409061e65eee, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.508306 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05defabe-d177-496f-b49a-66150e3ecc48 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.508701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0f794-05fd-45d3-96c8-ffb167099dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.509387 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0f794-05fd-45d3-96c8-ffb167099dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.509704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0f794-05fd-45d3-96c8-ffb167099dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.509983 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0f794-05fd-45d3-96c8-ffb167099dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.510713 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0f794-05fd-45d3-96c8-ffb167099dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:34:50.511020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0f794-05fd-45d3-96c8-ffb167099dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.512634 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0f794-05fd-45d3-96c8-ffb167099dd9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.523144 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 783/1567] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:50 2022] PUT /identity/v3/projects/7e81c359988f4cb8b315375e046a252d/users/d6ae6bd14d1a437d9d40409061e65eee/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:50.525053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 785/1568] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:34:50.526121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0f794-05fd-45d3-96c8-ffb167099dd9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.530274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05defabe-d177-496f-b49a-66150e3ecc48 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.536670 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0f794-05fd-45d3-96c8-ffb167099dd9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.595548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be937ad-3c92-446a-b919-2b3c8d64860f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.595815 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05defabe-d177-496f-b49a-66150e3ecc48 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.596227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be937ad-3c92-446a-b919-2b3c8d64860f admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.596515 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be937ad-3c92-446a-b919-2b3c8d64860f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.596795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be937ad-3c92-446a-b919-2b3c8d64860f admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.597561 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be937ad-3c92-446a-b919-2b3c8d64860f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.599164 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be937ad-3c92-446a-b919-2b3c8d64860f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.600315 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb496e3-f4e5-4048-9774-e91e47929e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.601303 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb496e3-f4e5-4048-9774-e91e47929e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.601448 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb496e3-f4e5-4048-9774-e91e47929e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.601646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb496e3-f4e5-4048-9774-e91e47929e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.602374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb496e3-f4e5-4048-9774-e91e47929e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:34:50.602683 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb496e3-f4e5-4048-9774-e91e47929e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.604293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb496e3-f4e5-4048-9774-e91e47929e86 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.609372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 786/1569] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:50.610092 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be937ad-3c92-446a-b919-2b3c8d64860f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.616674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 784/1570] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:34:50.617517 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb496e3-f4e5-4048-9774-e91e47929e86 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.626234 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be937ad-3c92-446a-b919-2b3c8d64860f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.626749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb496e3-f4e5-4048-9774-e91e47929e86 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.630793 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193428a8-256a-45ae-a706-89ce64e8374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.631121 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f6bbe-5dba-43c8-94b7-51c822acb6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.631452 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193428a8-256a-45ae-a706-89ce64e8374d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.631737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193428a8-256a-45ae-a706-89ce64e8374d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.631908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f6bbe-5dba-43c8-94b7-51c822acb6eb admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.632056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f6bbe-5dba-43c8-94b7-51c822acb6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.632161 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193428a8-256a-45ae-a706-89ce64e8374d admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.632355 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f6bbe-5dba-43c8-94b7-51c822acb6eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.632802 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193428a8-256a-45ae-a706-89ce64e8374d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:34:50.633077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f6bbe-5dba-43c8-94b7-51c822acb6eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:34:50.633204 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193428a8-256a-45ae-a706-89ce64e8374d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.633413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f6bbe-5dba-43c8-94b7-51c822acb6eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.634730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193428a8-256a-45ae-a706-89ce64e8374d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.634992 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f6bbe-5dba-43c8-94b7-51c822acb6eb admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.647226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 787/1571] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:34:50.648079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193428a8-256a-45ae-a706-89ce64e8374d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.653995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 785/1572] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:34:50.653995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f6bbe-5dba-43c8-94b7-51c822acb6eb admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.663956 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f6bbe-5dba-43c8-94b7-51c822acb6eb admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.664121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193428a8-256a-45ae-a706-89ce64e8374d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.668914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7b7fd-3a3e-4e02-b871-fbe82169a459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.669085 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26521d32-60bf-4a7a-a457-f9bf90cee360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.669589 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26521d32-60bf-4a7a-a457-f9bf90cee360 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.669712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7b7fd-3a3e-4e02-b871-fbe82169a459 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.669836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26521d32-60bf-4a7a-a457-f9bf90cee360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.669934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7b7fd-3a3e-4e02-b871-fbe82169a459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.670127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26521d32-60bf-4a7a-a457-f9bf90cee360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.670225 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7b7fd-3a3e-4e02-b871-fbe82169a459 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.670851 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7b7fd-3a3e-4e02-b871-fbe82169a459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.670967 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26521d32-60bf-4a7a-a457-f9bf90cee360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.672750 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7b7fd-3a3e-4e02-b871-fbe82169a459 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.672859 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26521d32-60bf-4a7a-a457-f9bf90cee360 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.702596 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 788/1573] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:50.702596 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7b7fd-3a3e-4e02-b871-fbe82169a459 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.702902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 786/1574] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:50.702902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67523ea-03b0-450a-934f-248397a00daa None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.702902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67523ea-03b0-450a-934f-248397a00daa None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.702902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67523ea-03b0-450a-934f-248397a00daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.728141 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e67523ea-03b0-450a-934f-248397a00daa None None] MFA Rules not processed for user `d6ae6bd14d1a437d9d40409061e65eee`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:50.729371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e67523ea-03b0-450a-934f-248397a00daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:50.762859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7b7fd-3a3e-4e02-b871-fbe82169a459 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.780879 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:50.794716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 787/1575] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:50.795537 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67523ea-03b0-450a-934f-248397a00daa None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.813249 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:50.834009 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceac550-ec2a-426c-af3d-3e5c388d5133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.834803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceac550-ec2a-426c-af3d-3e5c388d5133 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.835355 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceac550-ec2a-426c-af3d-3e5c388d5133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.835668 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceac550-ec2a-426c-af3d-3e5c388d5133 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.836460 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceac550-ec2a-426c-af3d-3e5c388d5133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.838413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceac550-ec2a-426c-af3d-3e5c388d5133 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.862509 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67523ea-03b0-450a-934f-248397a00daa None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.865258 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 789/1576] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:50.866162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceac550-ec2a-426c-af3d-3e5c388d5133 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.867467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af841a6-fafd-4551-8440-15ea35c2f155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.868565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af841a6-fafd-4551-8440-15ea35c2f155 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.868864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af841a6-fafd-4551-8440-15ea35c2f155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.869145 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af841a6-fafd-4551-8440-15ea35c2f155 admin admin] PATH_INFO: `/v3/projects/19f23046a3b641c9b1368964b30df39a/users/2a2896eda44743cbaea5903c0003bde6/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.885786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af841a6-fafd-4551-8440-15ea35c2f155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f23046a3b641c9b1368964b30df39a, user_id=2a2896eda44743cbaea5903c0003bde6, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.888582 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af841a6-fafd-4551-8440-15ea35c2f155 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.902803 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 788/1577] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:50 2022] PUT /identity/v3/projects/19f23046a3b641c9b1368964b30df39a/users/2a2896eda44743cbaea5903c0003bde6/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:50.903639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af841a6-fafd-4551-8440-15ea35c2f155 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:50.930683 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceac550-ec2a-426c-af3d-3e5c388d5133 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.965368 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af841a6-fafd-4551-8440-15ea35c2f155 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:50.969718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314117bb-238c-4e9f-b4c6-b5f4f120f8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.970383 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314117bb-238c-4e9f-b4c6-b5f4f120f8ef admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.970663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314117bb-238c-4e9f-b4c6-b5f4f120f8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.970934 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314117bb-238c-4e9f-b4c6-b5f4f120f8ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.971617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314117bb-238c-4e9f-b4c6-b5f4f120f8ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.973565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314117bb-238c-4e9f-b4c6-b5f4f120f8ef admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:50.987129 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e70e35-8d86-4bd0-ac61-3bb11b44d9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:50.987807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e70e35-8d86-4bd0-ac61-3bb11b44d9ff admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:50.988096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e70e35-8d86-4bd0-ac61-3bb11b44d9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:50.988371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e70e35-8d86-4bd0-ac61-3bb11b44d9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:50.989079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e70e35-8d86-4bd0-ac61-3bb11b44d9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:50.991091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e70e35-8d86-4bd0-ac61-3bb11b44d9ff admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.003524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 789/1578] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:51.003524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314117bb-238c-4e9f-b4c6-b5f4f120f8ef admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.020859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 790/1579] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:34:50 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:51.020859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e70e35-8d86-4bd0-ac61-3bb11b44d9ff admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.059581 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:51.065434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314117bb-238c-4e9f-b4c6-b5f4f120f8ef admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.080990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e70e35-8d86-4bd0-ac61-3bb11b44d9ff admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.085801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2cd9c-e652-4a89-8585-9a383becee0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.086480 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2cd9c-e652-4a89-8585-9a383becee0e admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.086767 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2cd9c-e652-4a89-8585-9a383becee0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.087048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2cd9c-e652-4a89-8585-9a383becee0e admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.087744 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2cd9c-e652-4a89-8585-9a383becee0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.089725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2cd9c-e652-4a89-8585-9a383becee0e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.092926 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:51.109332 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 791/1580] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:34:51 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:51.110015 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2cd9c-e652-4a89-8585-9a383becee0e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.119129 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2cd9c-e652-4a89-8585-9a383becee0e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.123803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ad748-b6f6-4583-8d2a-e12019f3a0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.124564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ad748-b6f6-4583-8d2a-e12019f3a0cd admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.124920 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ad748-b6f6-4583-8d2a-e12019f3a0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.125197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ad748-b6f6-4583-8d2a-e12019f3a0cd admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.125915 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ad748-b6f6-4583-8d2a-e12019f3a0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.127222 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b1805-c23f-4803-bc12-c2f3ff903208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.127804 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ad748-b6f6-4583-8d2a-e12019f3a0cd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.127916 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b1805-c23f-4803-bc12-c2f3ff903208 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.128165 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b1805-c23f-4803-bc12-c2f3ff903208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.128436 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b1805-c23f-4803-bc12-c2f3ff903208 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.129137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b1805-c23f-4803-bc12-c2f3ff903208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.131067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b1805-c23f-4803-bc12-c2f3ff903208 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.148001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 792/1581] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:34:51 2022] POST /identity/v3/users => generated 302 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:51.149405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf38f12-c682-43e6-9123-37a7d3d161fb None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.149729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf38f12-c682-43e6-9123-37a7d3d161fb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.150003 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf38f12-c682-43e6-9123-37a7d3d161fb None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.151617 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 793/1582] 10.222.0.36 () {54 vars in 961 bytes} [Wed Jun 15 00:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:51.152489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf38f12-c682-43e6-9123-37a7d3d161fb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.163830 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 790/1583] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:34:51 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:51.163830 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405ef81-2c4f-4815-9c8c-c30191f379a0 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.163830 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405ef81-2c4f-4815-9c8c-c30191f379a0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.163830 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405ef81-2c4f-4815-9c8c-c30191f379a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.164702 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf38f12-c682-43e6-9123-37a7d3d161fb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.180337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-3405ef81-2c4f-4815-9c8c-c30191f379a0 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:51.182004 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3405ef81-2c4f-4815-9c8c-c30191f379a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:51.220559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cbc2e-8ca6-42c1-8166-736f8de6b6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.221157 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cbc2e-8ca6-42c1-8166-736f8de6b6ad admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.221477 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cbc2e-8ca6-42c1-8166-736f8de6b6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.221758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cbc2e-8ca6-42c1-8166-736f8de6b6ad admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.222449 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cbc2e-8ca6-42c1-8166-736f8de6b6ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.224367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cbc2e-8ca6-42c1-8166-736f8de6b6ad admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.244301 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 791/1584] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:51.245272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405ef81-2c4f-4815-9c8c-c30191f379a0 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.251104 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 794/1585] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:34:51 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:51.251890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cbc2e-8ca6-42c1-8166-736f8de6b6ad admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.254424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405ef81-2c4f-4815-9c8c-c30191f379a0 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.258915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e0bc0-4c53-441d-87b8-1b9cff77ab8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.259586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e0bc0-4c53-441d-87b8-1b9cff77ab8a admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.259864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e0bc0-4c53-441d-87b8-1b9cff77ab8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.260141 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e0bc0-4c53-441d-87b8-1b9cff77ab8a admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.260835 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e0bc0-4c53-441d-87b8-1b9cff77ab8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.262811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e0bc0-4c53-441d-87b8-1b9cff77ab8a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.264242 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cbc2e-8ca6-42c1-8166-736f8de6b6ad admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.269434 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4803b2-a44f-448a-ac46-c61e25ef0706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.270105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4803b2-a44f-448a-ac46-c61e25ef0706 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.270398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4803b2-a44f-448a-ac46-c61e25ef0706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.270824 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4803b2-a44f-448a-ac46-c61e25ef0706 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.271354 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4803b2-a44f-448a-ac46-c61e25ef0706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.273304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4803b2-a44f-448a-ac46-c61e25ef0706 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.283854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 792/1586] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:34:51 2022] POST /identity/v3/users => generated 296 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:51.285036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e0bc0-4c53-441d-87b8-1b9cff77ab8a admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.296923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 795/1587] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:34:51 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:51.296923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4803b2-a44f-448a-ac46-c61e25ef0706 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.297198 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e0bc0-4c53-441d-87b8-1b9cff77ab8a admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.299872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ddbcd2-e5f1-4c4c-aab5-c58780417b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.300537 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddbcd2-e5f1-4c4c-aab5-c58780417b16 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.300818 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddbcd2-e5f1-4c4c-aab5-c58780417b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.301099 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ddbcd2-e5f1-4c4c-aab5-c58780417b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.301863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddbcd2-e5f1-4c4c-aab5-c58780417b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.303469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ddbcd2-e5f1-4c4c-aab5-c58780417b16 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.304224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4803b2-a44f-448a-ac46-c61e25ef0706 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.308748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f4d99-c321-4371-a658-b6edda7d479e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.309436 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f4d99-c321-4371-a658-b6edda7d479e admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.309723 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f4d99-c321-4371-a658-b6edda7d479e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.310001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f4d99-c321-4371-a658-b6edda7d479e admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.310733 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f4d99-c321-4371-a658-b6edda7d479e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.312350 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f4d99-c321-4371-a658-b6edda7d479e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.313949 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 793/1588] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:51.315717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede8294-c107-4df2-a63c-7223b1d1f367 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.316013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede8294-c107-4df2-a63c-7223b1d1f367 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.316293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede8294-c107-4df2-a63c-7223b1d1f367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.324437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 796/1589] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:51.325104 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f4d99-c321-4371-a658-b6edda7d479e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.335345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f4d99-c321-4371-a658-b6edda7d479e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.337837 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-aede8294-c107-4df2-a63c-7223b1d1f367 None None] MFA Rules not processed for user `6d0ae1707c7041a0989889dbefeaf267`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:51.339050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-aede8294-c107-4df2-a63c-7223b1d1f367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:51.340048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0a798-b06a-4c8a-ba00-b6023c73d248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.340708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0a798-b06a-4c8a-ba00-b6023c73d248 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.340989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0a798-b06a-4c8a-ba00-b6023c73d248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.341441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0a798-b06a-4c8a-ba00-b6023c73d248 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.342234 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0a798-b06a-4c8a-ba00-b6023c73d248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.344733 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0a798-b06a-4c8a-ba00-b6023c73d248 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.366769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 797/1590] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:34:51 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:51.367564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0a798-b06a-4c8a-ba00-b6023c73d248 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.376690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0a798-b06a-4c8a-ba00-b6023c73d248 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.381177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d5cda-dd4b-4a5a-9197-2e1f13c5dda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.382050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d5cda-dd4b-4a5a-9197-2e1f13c5dda0 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.382332 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d5cda-dd4b-4a5a-9197-2e1f13c5dda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.382656 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d5cda-dd4b-4a5a-9197-2e1f13c5dda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.383376 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d5cda-dd4b-4a5a-9197-2e1f13c5dda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.384943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d5cda-dd4b-4a5a-9197-2e1f13c5dda0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.394734 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 798/1591] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:51.395530 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d5cda-dd4b-4a5a-9197-2e1f13c5dda0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.408830 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 794/1592] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Jun 15 00:34:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:51.409873 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede8294-c107-4df2-a63c-7223b1d1f367 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.420598 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede8294-c107-4df2-a63c-7223b1d1f367 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.425728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae30ed3-527d-4a14-84fa-66eb3941342d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.426415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30ed3-527d-4a14-84fa-66eb3941342d admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.426699 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30ed3-527d-4a14-84fa-66eb3941342d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.426995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30ed3-527d-4a14-84fa-66eb3941342d admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.427701 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae30ed3-527d-4a14-84fa-66eb3941342d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.429397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae30ed3-527d-4a14-84fa-66eb3941342d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.439396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 795/1593] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:51.440175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae30ed3-527d-4a14-84fa-66eb3941342d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.443526 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=85,keystone:INSERT=15 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:51.449466 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae30ed3-527d-4a14-84fa-66eb3941342d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.454091 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7c24f-0320-4684-bbab-fa5f615b5ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.454340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d5cda-dd4b-4a5a-9197-2e1f13c5dda0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.454742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7c24f-0320-4684-bbab-fa5f615b5ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.455026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7c24f-0320-4684-bbab-fa5f615b5ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.455302 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7c24f-0320-4684-bbab-fa5f615b5ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.456031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7c24f-0320-4684-bbab-fa5f615b5ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.457661 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7c24f-0320-4684-bbab-fa5f615b5ba5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.457864 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad1e54-2f64-4d84-8c77-398c94afd94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.458511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad1e54-2f64-4d84-8c77-398c94afd94e service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.458847 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad1e54-2f64-4d84-8c77-398c94afd94e service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.459067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad1e54-2f64-4d84-8c77-398c94afd94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.459728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:51.468778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad1e54-2f64-4d84-8c77-398c94afd94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.470242 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad1e54-2f64-4d84-8c77-398c94afd94e service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.471787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 796/1594] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:51.472457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7c24f-0320-4684-bbab-fa5f615b5ba5 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.480281 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 799/1595] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:51.481090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad1e54-2f64-4d84-8c77-398c94afd94e service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.482095 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7c24f-0320-4684-bbab-fa5f615b5ba5 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.486547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a1b4c-afb0-497a-b2fb-04b707b5f469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.487651 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a1b4c-afb0-497a-b2fb-04b707b5f469 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.487651 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a1b4c-afb0-497a-b2fb-04b707b5f469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.487878 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a1b4c-afb0-497a-b2fb-04b707b5f469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.488501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a1b4c-afb0-497a-b2fb-04b707b5f469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.490146 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a1b4c-afb0-497a-b2fb-04b707b5f469 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.491587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad1e54-2f64-4d84-8c77-398c94afd94e service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.496973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb49d41-6d48-495c-9ba2-3ad5e20ed53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.497677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49d41-6d48-495c-9ba2-3ad5e20ed53d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.497962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49d41-6d48-495c-9ba2-3ad5e20ed53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.498240 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb49d41-6d48-495c-9ba2-3ad5e20ed53d admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.498968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb49d41-6d48-495c-9ba2-3ad5e20ed53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.500556 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb49d41-6d48-495c-9ba2-3ad5e20ed53d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.500848 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 797/1596] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:51.504282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a1b4c-afb0-497a-b2fb-04b707b5f469 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.516731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 800/1597] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:51.516880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a1b4c-afb0-497a-b2fb-04b707b5f469 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.517000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb49d41-6d48-495c-9ba2-3ad5e20ed53d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.521369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9a5fe-07da-4c6b-88af-2cc568ad15ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.522104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9a5fe-07da-4c6b-88af-2cc568ad15ce admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.522518 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9a5fe-07da-4c6b-88af-2cc568ad15ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.522800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9a5fe-07da-4c6b-88af-2cc568ad15ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.523498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9a5fe-07da-4c6b-88af-2cc568ad15ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.524510 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb49d41-6d48-495c-9ba2-3ad5e20ed53d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.525424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9a5fe-07da-4c6b-88af-2cc568ad15ce admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.529372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc034d-efff-43ec-8344-1d939edc4e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.530031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc034d-efff-43ec-8344-1d939edc4e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.530321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc034d-efff-43ec-8344-1d939edc4e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.530600 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc034d-efff-43ec-8344-1d939edc4e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.531329 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc034d-efff-43ec-8344-1d939edc4e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.532918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc034d-efff-43ec-8344-1d939edc4e91 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.537592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 798/1598] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:51.538312 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9a5fe-07da-4c6b-88af-2cc568ad15ce admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.551046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 801/1599] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:51.551046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc034d-efff-43ec-8344-1d939edc4e91 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.556904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9a5fe-07da-4c6b-88af-2cc568ad15ce admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.561168 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc034d-efff-43ec-8344-1d939edc4e91 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.566378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ea4c6-5585-47f5-a25a-0e6f16a024a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.567049 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ea4c6-5585-47f5-a25a-0e6f16a024a4 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.567334 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ea4c6-5585-47f5-a25a-0e6f16a024a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.567613 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ea4c6-5585-47f5-a25a-0e6f16a024a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.568405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e171b28-9874-416f-9b16-70f103f98d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.569104 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e171b28-9874-416f-9b16-70f103f98d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.569436 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e171b28-9874-416f-9b16-70f103f98d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.569702 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e171b28-9874-416f-9b16-70f103f98d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.570444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e171b28-9874-416f-9b16-70f103f98d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.572591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e171b28-9874-416f-9b16-70f103f98d99 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.588758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 802/1600] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:51.588758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e171b28-9874-416f-9b16-70f103f98d99 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.597516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e171b28-9874-416f-9b16-70f103f98d99 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.602218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f672ae-eac2-4750-9d63-f41324b6b8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.602896 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f672ae-eac2-4750-9d63-f41324b6b8ae admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.603183 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f672ae-eac2-4750-9d63-f41324b6b8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.603459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f672ae-eac2-4750-9d63-f41324b6b8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.604193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f672ae-eac2-4750-9d63-f41324b6b8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.605962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f672ae-eac2-4750-9d63-f41324b6b8ae admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.618593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 803/1601] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:51.619640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f672ae-eac2-4750-9d63-f41324b6b8ae admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.630068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f672ae-eac2-4750-9d63-f41324b6b8ae admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.635274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504ba18-291a-4575-9a82-a5abc0e5d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.636388 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504ba18-291a-4575-9a82-a5abc0e5d08f admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.636818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504ba18-291a-4575-9a82-a5abc0e5d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.637251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504ba18-291a-4575-9a82-a5abc0e5d08f admin admin] PATH_INFO: `/v3/projects/93998b0d78f44acaa7d0a3427a0b793b/users/5b0386fdb2454f629aba7e195275b885/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.638826 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ea4c6-5585-47f5-a25a-0e6f16a024a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.640768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ea4c6-5585-47f5-a25a-0e6f16a024a4 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.651953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 799/1602] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:51.652858 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ea4c6-5585-47f5-a25a-0e6f16a024a4 service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.656137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504ba18-291a-4575-9a82-a5abc0e5d08f admin admin] RBAC: Authorizing `identity:create_grant(project_id=93998b0d78f44acaa7d0a3427a0b793b, user_id=5b0386fdb2454f629aba7e195275b885, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.657741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: WARNING py.warnings [None req-2504ba18-291a-4575-9a82-a5abc0e5d08f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:34:51.657741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: warnings.warn(msg) Jun 15 00:34:51.657741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: Jun 15 00:34:51.660977 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504ba18-291a-4575-9a82-a5abc0e5d08f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.663036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ea4c6-5585-47f5-a25a-0e6f16a024a4 service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.668376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9e61e-afd6-4b53-bd57-327c3f42fd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.669259 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9e61e-afd6-4b53-bd57-327c3f42fd3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.669583 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9e61e-afd6-4b53-bd57-327c3f42fd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.669872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9e61e-afd6-4b53-bd57-327c3f42fd3a admin admin] PATH_INFO: `/v3/projects/38b1cfd96f81441bab8821b8bf5abacf/users/57ab69989e8642c8ada96ebd40cacfde/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.688625 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 804/1603] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:51 2022] PUT /identity/v3/projects/93998b0d78f44acaa7d0a3427a0b793b/users/5b0386fdb2454f629aba7e195275b885/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:51.688625 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504ba18-291a-4575-9a82-a5abc0e5d08f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.697491 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9e61e-afd6-4b53-bd57-327c3f42fd3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b1cfd96f81441bab8821b8bf5abacf, user_id=57ab69989e8642c8ada96ebd40cacfde, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.700715 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9e61e-afd6-4b53-bd57-327c3f42fd3a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.719886 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 800/1604] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:51 2022] PUT /identity/v3/projects/38b1cfd96f81441bab8821b8bf5abacf/users/57ab69989e8642c8ada96ebd40cacfde/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:51.721769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9e61e-afd6-4b53-bd57-327c3f42fd3a admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.788286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504ba18-291a-4575-9a82-a5abc0e5d08f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.825151 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9e61e-afd6-4b53-bd57-327c3f42fd3a admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.832755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbf678-6ed7-4129-b1d4-2fa33f9aaf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.833769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbf678-6ed7-4129-b1d4-2fa33f9aaf4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.834055 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbf678-6ed7-4129-b1d4-2fa33f9aaf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.834333 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbf678-6ed7-4129-b1d4-2fa33f9aaf4d admin admin] PATH_INFO: `/v3/projects/bd45818aa5d34673ad78b39d8fcdfd79/users/bd1d5a4ca2e3438fa01f4075cd654147/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.853689 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbf678-6ed7-4129-b1d4-2fa33f9aaf4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd45818aa5d34673ad78b39d8fcdfd79, user_id=bd1d5a4ca2e3438fa01f4075cd654147, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.857714 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbf678-6ed7-4129-b1d4-2fa33f9aaf4d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.893425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 801/1605] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:51 2022] PUT /identity/v3/projects/bd45818aa5d34673ad78b39d8fcdfd79/users/bd1d5a4ca2e3438fa01f4075cd654147/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:51.893425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbf678-6ed7-4129-b1d4-2fa33f9aaf4d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.904619 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76920212-44e7-4021-9056-64807f1aee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.905331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76920212-44e7-4021-9056-64807f1aee67 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.905766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76920212-44e7-4021-9056-64807f1aee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.906048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76920212-44e7-4021-9056-64807f1aee67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:51.906968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76920212-44e7-4021-9056-64807f1aee67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:51.909598 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76920212-44e7-4021-9056-64807f1aee67 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:51.922965 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 805/1606] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:51.927814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76920212-44e7-4021-9056-64807f1aee67 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:51.939898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:51.942663 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76920212-44e7-4021-9056-64807f1aee67 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.966132 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:51.973877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbf678-6ed7-4129-b1d4-2fa33f9aaf4d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:51.980030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad4ea8-c4ea-4814-ba74-538c5d7e29fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:51.981232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad4ea8-c4ea-4814-ba74-538c5d7e29fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:51.981922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad4ea8-c4ea-4814-ba74-538c5d7e29fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:51.982357 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad4ea8-c4ea-4814-ba74-538c5d7e29fc admin admin] PATH_INFO: `/v3/projects/8a97ae7800f0422cadeb9b69a018df12/users/21c54bf3ff584c709731d3624aa187a4/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.001265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad4ea8-c4ea-4814-ba74-538c5d7e29fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a97ae7800f0422cadeb9b69a018df12, user_id=21c54bf3ff584c709731d3624aa187a4, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:52.003900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad4ea8-c4ea-4814-ba74-538c5d7e29fc admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:52.007832 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c5cb9-b398-46e5-b48e-139f1cd2ac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:52.008502 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c5cb9-b398-46e5-b48e-139f1cd2ac5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.008890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c5cb9-b398-46e5-b48e-139f1cd2ac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.009089 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c5cb9-b398-46e5-b48e-139f1cd2ac5a admin admin] PATH_INFO: `/v3/projects/54c128e73ca24206a1088f4babbab672/users/3a5031b8154d4b18846b793fd8f7c1ef/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.024628 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 802/1607] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:51 2022] PUT /identity/v3/projects/8a97ae7800f0422cadeb9b69a018df12/users/21c54bf3ff584c709731d3624aa187a4/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:52.025823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c5cb9-b398-46e5-b48e-139f1cd2ac5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c128e73ca24206a1088f4babbab672, user_id=3a5031b8154d4b18846b793fd8f7c1ef, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:52.028664 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c5cb9-b398-46e5-b48e-139f1cd2ac5a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:52.030275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f99e-7d5c-4322-9cd8-d327d60a6d1c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.030634 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f99e-7d5c-4322-9cd8-d327d60a6d1c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.030982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f99e-7d5c-4322-9cd8-d327d60a6d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.048509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 806/1608] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:51 2022] PUT /identity/v3/projects/54c128e73ca24206a1088f4babbab672/users/3a5031b8154d4b18846b793fd8f7c1ef/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:52.050234 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81246f1-bf65-43d5-b4ec-4a5ff505900b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.050590 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81246f1-bf65-43d5-b4ec-4a5ff505900b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.050866 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81246f1-bf65-43d5-b4ec-4a5ff505900b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.059324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-0e25f99e-7d5c-4322-9cd8-d327d60a6d1c None None] MFA Rules not processed for user `5b0386fdb2454f629aba7e195275b885`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:52.060798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0e25f99e-7d5c-4322-9cd8-d327d60a6d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:52.081947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f81246f1-bf65-43d5-b4ec-4a5ff505900b None None] MFA Rules not processed for user `57ab69989e8642c8ada96ebd40cacfde`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:52.083784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f81246f1-bf65-43d5-b4ec-4a5ff505900b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:52.141262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 803/1609] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:52.143025 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658ec19-972d-4eb9-a0b6-36cc08877674 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.143321 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658ec19-972d-4eb9-a0b6-36cc08877674 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.143599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7658ec19-972d-4eb9-a0b6-36cc08877674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.161391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 807/1610] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:52.167588 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc4352-336a-448d-bdb9-28f4768ea725 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.167879 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc4352-336a-448d-bdb9-28f4768ea725 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.168165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc4352-336a-448d-bdb9-28f4768ea725 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.169794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 808/1611] 10.222.0.36 () {54 vars in 912 bytes} [Wed Jun 15 00:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:52.170248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc4352-336a-448d-bdb9-28f4768ea725 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:52.174369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-7658ec19-972d-4eb9-a0b6-36cc08877674 None None] MFA Rules not processed for user `bd1d5a4ca2e3438fa01f4075cd654147`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:52.175531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7658ec19-972d-4eb9-a0b6-36cc08877674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:52.243041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 804/1612] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:52.246702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39134234-4bdc-4f62-8192-230b256f3b5e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.246702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39134234-4bdc-4f62-8192-230b256f3b5e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.246702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39134234-4bdc-4f62-8192-230b256f3b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.263238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-39134234-4bdc-4f62-8192-230b256f3b5e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:52.264620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-39134234-4bdc-4f62-8192-230b256f3b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:52.267308 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc4352-336a-448d-bdb9-28f4768ea725 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:52.276055 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 805/1613] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:52.276230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4940646-5cc4-44d8-8011-4474a351d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:52.276369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410dade-9ef2-46f5-80d2-f226eae2f5e8 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.276369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410dade-9ef2-46f5-80d2-f226eae2f5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.276369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410dade-9ef2-46f5-80d2-f226eae2f5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.276753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4940646-5cc4-44d8-8011-4474a351d765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.276753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4940646-5cc4-44d8-8011-4474a351d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.276753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4940646-5cc4-44d8-8011-4474a351d765 admin admin] PATH_INFO: `/v3/projects/3736c3d43fa04279aa88c72681f3c95c/users/772b9a5e43034b37ae878024830ddd1b/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.304411 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d410dade-9ef2-46f5-80d2-f226eae2f5e8 None None] MFA Rules not processed for user `3a5031b8154d4b18846b793fd8f7c1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:52.305812 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d410dade-9ef2-46f5-80d2-f226eae2f5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:52.318123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4940646-5cc4-44d8-8011-4474a351d765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3736c3d43fa04279aa88c72681f3c95c, user_id=772b9a5e43034b37ae878024830ddd1b, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:52.320846 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4940646-5cc4-44d8-8011-4474a351d765 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:52.324355 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:52.337380 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 809/1614] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:52 2022] PUT /identity/v3/projects/3736c3d43fa04279aa88c72681f3c95c/users/772b9a5e43034b37ae878024830ddd1b/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:52.341743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4940646-5cc4-44d8-8011-4474a351d765 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:52.365604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:52.384478 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 806/1615] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:52.385633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410dade-9ef2-46f5-80d2-f226eae2f5e8 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:52.396175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410dade-9ef2-46f5-80d2-f226eae2f5e8 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:52.420504 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4940646-5cc4-44d8-8011-4474a351d765 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:52.426768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1f1c0-1004-4c3b-9455-3ea2cc03aaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:52.428360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1f1c0-1004-4c3b-9455-3ea2cc03aaca admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.428360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1f1c0-1004-4c3b-9455-3ea2cc03aaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.428624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1f1c0-1004-4c3b-9455-3ea2cc03aaca admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.429781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1f1c0-1004-4c3b-9455-3ea2cc03aaca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:52.432245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1f1c0-1004-4c3b-9455-3ea2cc03aaca admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:52.459760 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 810/1616] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/projects => generated 363 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:52.461934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66061e93-8b3a-4cc6-b83c-6dc85b8690d8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.462293 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66061e93-8b3a-4cc6-b83c-6dc85b8690d8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.462642 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66061e93-8b3a-4cc6-b83c-6dc85b8690d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.466245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435de9f4-075b-4a8a-9231-6ef6520283f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:52.467283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de9f4-075b-4a8a-9231-6ef6520283f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.467813 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de9f4-075b-4a8a-9231-6ef6520283f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.468238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de9f4-075b-4a8a-9231-6ef6520283f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.469085 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435de9f4-075b-4a8a-9231-6ef6520283f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:52.471319 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435de9f4-075b-4a8a-9231-6ef6520283f2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:52.482369 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-66061e93-8b3a-4cc6-b83c-6dc85b8690d8 None None] MFA Rules not processed for user `6d0ae1707c7041a0989889dbefeaf267`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:52.483846 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-66061e93-8b3a-4cc6-b83c-6dc85b8690d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:52.502950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 807/1617] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:52.502950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435de9f4-075b-4a8a-9231-6ef6520283f2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:52.553301 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 811/1618] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:52.554023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66061e93-8b3a-4cc6-b83c-6dc85b8690d8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:52.566239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435de9f4-075b-4a8a-9231-6ef6520283f2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:52.571260 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99690573-aec3-47a7-bfb1-5e49ce4a3997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:52.571931 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99690573-aec3-47a7-bfb1-5e49ce4a3997 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.572216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99690573-aec3-47a7-bfb1-5e49ce4a3997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.572525 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99690573-aec3-47a7-bfb1-5e49ce4a3997 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.573239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99690573-aec3-47a7-bfb1-5e49ce4a3997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:52.575476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99690573-aec3-47a7-bfb1-5e49ce4a3997 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:52.607993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 808/1619] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:52.607993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7e88-be21-4104-802e-32a6a103365d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.607993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7e88-be21-4104-802e-32a6a103365d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.607993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a7e88-be21-4104-802e-32a6a103365d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.609850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66061e93-8b3a-4cc6-b83c-6dc85b8690d8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:52.632650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-923a7e88-be21-4104-802e-32a6a103365d None None] MFA Rules not processed for user `2a2896eda44743cbaea5903c0003bde6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:52.633859 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-923a7e88-be21-4104-802e-32a6a103365d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:52.650100 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:52.658384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029caa4-f994-48ac-9615-a41df493030a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:52.659092 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029caa4-f994-48ac-9615-a41df493030a service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.659371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029caa4-f994-48ac-9615-a41df493030a service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.659687 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029caa4-f994-48ac-9615-a41df493030a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.664337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:52.699533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 809/1620] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:52.701052 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681d9d9-d775-4336-8c63-ed0aed04fdd2 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.701443 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681d9d9-d775-4336-8c63-ed0aed04fdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.701789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681d9d9-d775-4336-8c63-ed0aed04fdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.718468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a681d9d9-d775-4336-8c63-ed0aed04fdd2 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:52.719678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a681d9d9-d775-4336-8c63-ed0aed04fdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:52.722971 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029caa4-f994-48ac-9615-a41df493030a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:52.724453 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029caa4-f994-48ac-9615-a41df493030a service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:52.727481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 810/1621] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:52.728278 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681d9d9-d775-4336-8c63-ed0aed04fdd2 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:52.734730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 812/1622] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:52.735415 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029caa4-f994-48ac-9615-a41df493030a service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:52.738349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681d9d9-d775-4336-8c63-ed0aed04fdd2 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:52.743333 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f92a73-5d02-4d25-9597-19358c42753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:52.744005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f92a73-5d02-4d25-9597-19358c42753d admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.744264 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f92a73-5d02-4d25-9597-19358c42753d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.744544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f92a73-5d02-4d25-9597-19358c42753d admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.744709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029caa4-f994-48ac-9615-a41df493030a service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:52.745221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f92a73-5d02-4d25-9597-19358c42753d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:52.747207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f92a73-5d02-4d25-9597-19358c42753d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:52.749272 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd713a-d875-46b1-bb55-5a79627c023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:52.749960 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd713a-d875-46b1-bb55-5a79627c023e admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.750242 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd713a-d875-46b1-bb55-5a79627c023e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.750518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd713a-d875-46b1-bb55-5a79627c023e admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.751526 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd713a-d875-46b1-bb55-5a79627c023e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:52.753123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd713a-d875-46b1-bb55-5a79627c023e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:52.778472 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 813/1623] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:52.778472 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd713a-d875-46b1-bb55-5a79627c023e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:52.780141 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 811/1624] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:52.781077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f92a73-5d02-4d25-9597-19358c42753d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:52.789033 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd713a-d875-46b1-bb55-5a79627c023e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:52.851288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a446ed-f1f3-4132-b7ac-5737dddc10b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:52.852092 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a446ed-f1f3-4132-b7ac-5737dddc10b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.852503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a446ed-f1f3-4132-b7ac-5737dddc10b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.852991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a446ed-f1f3-4132-b7ac-5737dddc10b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.853783 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a446ed-f1f3-4132-b7ac-5737dddc10b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:52.853976 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f92a73-5d02-4d25-9597-19358c42753d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:52.855855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a446ed-f1f3-4132-b7ac-5737dddc10b8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:52.858104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17de714-bc60-4b90-baac-235e48d6b84a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:52.859011 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17de714-bc60-4b90-baac-235e48d6b84a service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.859164 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17de714-bc60-4b90-baac-235e48d6b84a service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.859444 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17de714-bc60-4b90-baac-235e48d6b84a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.882322 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 814/1625] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/users => generated 309 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:52.882322 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a446ed-f1f3-4132-b7ac-5737dddc10b8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:52.891020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a446ed-f1f3-4132-b7ac-5737dddc10b8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:52.896715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c63c1-de2e-445b-a20e-273cae7c7ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:52.897455 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c63c1-de2e-445b-a20e-273cae7c7ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.897604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c63c1-de2e-445b-a20e-273cae7c7ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.898099 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c63c1-de2e-445b-a20e-273cae7c7ac9 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.898954 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c63c1-de2e-445b-a20e-273cae7c7ac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:52.900994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c63c1-de2e-445b-a20e-273cae7c7ac9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:52.923663 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 815/1626] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:52.924501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c63c1-de2e-445b-a20e-273cae7c7ac9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:52.934768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c63c1-de2e-445b-a20e-273cae7c7ac9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:52.942392 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84659f86-c58d-4f29-9bcd-6c1780fa62fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:52.943288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84659f86-c58d-4f29-9bcd-6c1780fa62fc admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:52.943477 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84659f86-c58d-4f29-9bcd-6c1780fa62fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:52.943796 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84659f86-c58d-4f29-9bcd-6c1780fa62fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:52.944874 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84659f86-c58d-4f29-9bcd-6c1780fa62fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:52.945102 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17de714-bc60-4b90-baac-235e48d6b84a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:52.946652 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17de714-bc60-4b90-baac-235e48d6b84a service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:52.947178 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84659f86-c58d-4f29-9bcd-6c1780fa62fc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:52.970639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 812/1627] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:52.974701 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17de714-bc60-4b90-baac-235e48d6b84a service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:52.979379 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 816/1628] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:34:52 2022] POST /identity/v3/projects => generated 405 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:52.980798 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84659f86-c58d-4f29-9bcd-6c1780fa62fc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:53.033149 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:53.034526 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:53.069201 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17de714-bc60-4b90-baac-235e48d6b84a service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:53.080190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84659f86-c58d-4f29-9bcd-6c1780fa62fc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:53.087175 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471aa96-3148-414a-855a-66c6a4e173db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:53.087881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471aa96-3148-414a-855a-66c6a4e173db admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:53.088172 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471aa96-3148-414a-855a-66c6a4e173db admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:53.088452 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471aa96-3148-414a-855a-66c6a4e173db admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:53.089363 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471aa96-3148-414a-855a-66c6a4e173db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:53.091319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471aa96-3148-414a-855a-66c6a4e173db admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:53.109928 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 817/1629] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:53.111462 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471aa96-3148-414a-855a-66c6a4e173db admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:53.125637 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471aa96-3148-414a-855a-66c6a4e173db admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:53.131027 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f844d-1f58-4f69-84e5-eef9a714321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:53.132114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f844d-1f58-4f69-84e5-eef9a714321e admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:53.132584 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f844d-1f58-4f69-84e5-eef9a714321e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:53.132886 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f844d-1f58-4f69-84e5-eef9a714321e admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:53.133641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f844d-1f58-4f69-84e5-eef9a714321e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:53.135688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f844d-1f58-4f69-84e5-eef9a714321e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:53.161544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732bfe5-2f00-4599-83a7-d9b870adc50e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:53.162864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732bfe5-2f00-4599-83a7-d9b870adc50e service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:53.163426 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732bfe5-2f00-4599-83a7-d9b870adc50e service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:53.163657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 818/1630] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:34:53 2022] POST /identity/v3/users => generated 293 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:53.164138 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732bfe5-2f00-4599-83a7-d9b870adc50e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:53.164507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f844d-1f58-4f69-84e5-eef9a714321e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:53.178844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732bfe5-2f00-4599-83a7-d9b870adc50e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:53.181313 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732bfe5-2f00-4599-83a7-d9b870adc50e service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:53.195664 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 813/1631] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:53.197236 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732bfe5-2f00-4599-83a7-d9b870adc50e service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:53.210756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732bfe5-2f00-4599-83a7-d9b870adc50e service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:53.214027 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f844d-1f58-4f69-84e5-eef9a714321e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:53.217420 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc341f4-a414-45cd-b5ed-2687d9571fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:53.218760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc341f4-a414-45cd-b5ed-2687d9571fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:53.219302 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc341f4-a414-45cd-b5ed-2687d9571fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:53.220362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc341f4-a414-45cd-b5ed-2687d9571fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:53.221179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc341f4-a414-45cd-b5ed-2687d9571fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:53.224073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc341f4-a414-45cd-b5ed-2687d9571fd5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:53.234423 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716add8-f339-48d6-b679-766b6ddc86ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:53.235291 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716add8-f339-48d6-b679-766b6ddc86ed admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:53.236023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716add8-f339-48d6-b679-766b6ddc86ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:53.236302 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716add8-f339-48d6-b679-766b6ddc86ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:53.237055 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716add8-f339-48d6-b679-766b6ddc86ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:53.238725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716add8-f339-48d6-b679-766b6ddc86ed admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:53.241008 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 814/1632] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:53.242628 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc341f4-a414-45cd-b5ed-2687d9571fd5 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:53.258327 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc341f4-a414-45cd-b5ed-2687d9571fd5 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:53.265006 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ed499-275f-4b6f-8ec2-b0fc4c3566f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:53.266149 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ed499-275f-4b6f-8ec2-b0fc4c3566f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:53.266510 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ed499-275f-4b6f-8ec2-b0fc4c3566f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:53.266914 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ed499-275f-4b6f-8ec2-b0fc4c3566f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:53.267767 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ed499-275f-4b6f-8ec2-b0fc4c3566f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:53.269432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 819/1633] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:53.270165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716add8-f339-48d6-b679-766b6ddc86ed admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:53.271918 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ed499-275f-4b6f-8ec2-b0fc4c3566f2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:53.291712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716add8-f339-48d6-b679-766b6ddc86ed admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:53.303768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6a4e1-b771-402a-a6ca-112da60cc00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:53.305015 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6a4e1-b771-402a-a6ca-112da60cc00f admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:53.305309 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6a4e1-b771-402a-a6ca-112da60cc00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:53.305605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6a4e1-b771-402a-a6ca-112da60cc00f admin admin] PATH_INFO: `/v3/projects/4e57630f500748908317f3bfcebde4cc/users/89734fb79d7b4f4ea8960fd5e2ce0fca/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:53.321188 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 815/1634] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:34:53 2022] POST /identity/v3/users => generated 309 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:34:53.324209 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ed499-275f-4b6f-8ec2-b0fc4c3566f2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:53.340073 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6a4e1-b771-402a-a6ca-112da60cc00f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e57630f500748908317f3bfcebde4cc, user_id=89734fb79d7b4f4ea8960fd5e2ce0fca, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:53.342837 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6a4e1-b771-402a-a6ca-112da60cc00f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:53.352628 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ed499-275f-4b6f-8ec2-b0fc4c3566f2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:53.361018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30172836-f085-46cc-9e6a-f76129b72dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:53.362328 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30172836-f085-46cc-9e6a-f76129b72dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:53.362617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30172836-f085-46cc-9e6a-f76129b72dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:53.363117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30172836-f085-46cc-9e6a-f76129b72dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:53.363883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30172836-f085-46cc-9e6a-f76129b72dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:53.366259 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30172836-f085-46cc-9e6a-f76129b72dcf admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:53.370006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 820/1635] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:53 2022] PUT /identity/v3/projects/4e57630f500748908317f3bfcebde4cc/users/89734fb79d7b4f4ea8960fd5e2ce0fca/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:53.374843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6a4e1-b771-402a-a6ca-112da60cc00f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:53.384356 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 816/1636] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:53.385601 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30172836-f085-46cc-9e6a-f76129b72dcf admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:53.397490 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30172836-f085-46cc-9e6a-f76129b72dcf admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:53.518128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6a4e1-b771-402a-a6ca-112da60cc00f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:53.520164 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34f564-dede-4b23-b8fe-6fae6a334987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:53.521958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34f564-dede-4b23-b8fe-6fae6a334987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:53.522372 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34f564-dede-4b23-b8fe-6fae6a334987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:53.522710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34f564-dede-4b23-b8fe-6fae6a334987 admin admin] PATH_INFO: `/v3/projects/806d5d9a9b914ef5b44c7693448eea53/users/d67a1beceb824b77b834ebae18e9dcc8/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:53.528124 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316f4bb-a3ce-4f15-8d0a-50c95979e5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:53.529209 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f4bb-a3ce-4f15-8d0a-50c95979e5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:53.529670 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f4bb-a3ce-4f15-8d0a-50c95979e5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:53.530073 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f4bb-a3ce-4f15-8d0a-50c95979e5d8 admin admin] PATH_INFO: `/v3/projects/849362069bd64d25bd00acd2d010dd3d/users/9e17daca875048eb964800f5daa57445/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:53.558955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316f4bb-a3ce-4f15-8d0a-50c95979e5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849362069bd64d25bd00acd2d010dd3d, user_id=9e17daca875048eb964800f5daa57445, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:53.563393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316f4bb-a3ce-4f15-8d0a-50c95979e5d8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:53.569006 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34f564-dede-4b23-b8fe-6fae6a334987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=806d5d9a9b914ef5b44c7693448eea53, user_id=d67a1beceb824b77b834ebae18e9dcc8, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:53.572751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34f564-dede-4b23-b8fe-6fae6a334987 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:53.584839 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 821/1637] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:53 2022] PUT /identity/v3/projects/849362069bd64d25bd00acd2d010dd3d/users/9e17daca875048eb964800f5daa57445/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:53.592817 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316f4bb-a3ce-4f15-8d0a-50c95979e5d8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:53.609325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 817/1638] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:53 2022] PUT /identity/v3/projects/806d5d9a9b914ef5b44c7693448eea53/users/d67a1beceb824b77b834ebae18e9dcc8/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:53.610777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34f564-dede-4b23-b8fe-6fae6a334987 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:53.716769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:53.728132 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316f4bb-a3ce-4f15-8d0a-50c95979e5d8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:53.732888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:53.776077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34f564-dede-4b23-b8fe-6fae6a334987 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:53.791092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d46e4-ade2-4a7e-9cd4-9f0ab79a1c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:53.791876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d46e4-ade2-4a7e-9cd4-9f0ab79a1c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:53.792233 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d46e4-ade2-4a7e-9cd4-9f0ab79a1c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:53.792654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d46e4-ade2-4a7e-9cd4-9f0ab79a1c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:53.793686 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d46e4-ade2-4a7e-9cd4-9f0ab79a1c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:53.795518 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d46e4-ade2-4a7e-9cd4-9f0ab79a1c19 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:53.799212 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337e41d-c081-4f22-bdd7-8749ab215813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:53.799993 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337e41d-c081-4f22-bdd7-8749ab215813 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:53.800398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337e41d-c081-4f22-bdd7-8749ab215813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:53.800848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337e41d-c081-4f22-bdd7-8749ab215813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:53.801866 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337e41d-c081-4f22-bdd7-8749ab215813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:53.803775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337e41d-c081-4f22-bdd7-8749ab215813 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:53.818730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 822/1639] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:53.818730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337e41d-c081-4f22-bdd7-8749ab215813 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:53.822341 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 818/1640] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:53.823380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d46e4-ade2-4a7e-9cd4-9f0ab79a1c19 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:53.827631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337e41d-c081-4f22-bdd7-8749ab215813 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:53.835468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1c46c-82b9-431a-8281-8120803e0ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:53.836484 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1c46c-82b9-431a-8281-8120803e0ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:53.836925 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1c46c-82b9-431a-8281-8120803e0ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:53.837482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1c46c-82b9-431a-8281-8120803e0ccf admin admin] PATH_INFO: `/v3/projects/1efc14e43fe34e65bc315ba79ef7f209/users/10c18b3e385049398d32d64027fed24f/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:53.847232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d46e4-ade2-4a7e-9cd4-9f0ab79a1c19 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:53.853055 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0d032-ab92-4103-8933-b5651664394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:53.853924 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0d032-ab92-4103-8933-b5651664394c admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:53.854386 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0d032-ab92-4103-8933-b5651664394c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:53.854771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0d032-ab92-4103-8933-b5651664394c admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:53.855588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0d032-ab92-4103-8933-b5651664394c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:53.858408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1c46c-82b9-431a-8281-8120803e0ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1efc14e43fe34e65bc315ba79ef7f209, user_id=10c18b3e385049398d32d64027fed24f, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:53.861716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1c46c-82b9-431a-8281-8120803e0ccf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:53.866086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0d032-ab92-4103-8933-b5651664394c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:53.894028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 819/1641] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:53.895133 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0d032-ab92-4103-8933-b5651664394c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:53.896613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 823/1642] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:53 2022] PUT /identity/v3/projects/1efc14e43fe34e65bc315ba79ef7f209/users/10c18b3e385049398d32d64027fed24f/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:53.899028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1c46c-82b9-431a-8281-8120803e0ccf admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:53.920875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0d032-ab92-4103-8933-b5651664394c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:54.007263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24092c-8d26-40f0-a192-b305c557ecbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:54.008122 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24092c-8d26-40f0-a192-b305c557ecbe admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:54.008755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24092c-8d26-40f0-a192-b305c557ecbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:54.008755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24092c-8d26-40f0-a192-b305c557ecbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:54.010692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24092c-8d26-40f0-a192-b305c557ecbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:54.011661 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24092c-8d26-40f0-a192-b305c557ecbe admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:54.027082 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 820/1643] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:54.027082 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24092c-8d26-40f0-a192-b305c557ecbe admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:54.035231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24092c-8d26-40f0-a192-b305c557ecbe admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:54.040314 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2026e-da27-4246-9718-f734b791a068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:54.041367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2026e-da27-4246-9718-f734b791a068 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:54.041763 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2026e-da27-4246-9718-f734b791a068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:54.042137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2026e-da27-4246-9718-f734b791a068 admin admin] PATH_INFO: `/v3/projects/4e57630f500748908317f3bfcebde4cc/users/89734fb79d7b4f4ea8960fd5e2ce0fca/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:54.044382 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2026e-da27-4246-9718-f734b791a068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e57630f500748908317f3bfcebde4cc, user_id=89734fb79d7b4f4ea8960fd5e2ce0fca, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:54.047346 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2026e-da27-4246-9718-f734b791a068 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:54.059927 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 821/1644] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:54 2022] PUT /identity/v3/projects/4e57630f500748908317f3bfcebde4cc/users/89734fb79d7b4f4ea8960fd5e2ce0fca/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:54.060956 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2026e-da27-4246-9718-f734b791a068 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:54.092499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1c46c-82b9-431a-8281-8120803e0ccf admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:54.139229 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2026e-da27-4246-9718-f734b791a068 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:54.149002 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb0f7-3aa6-4658-a3f4-c8f4284363f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:54.151614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb0f7-3aa6-4658-a3f4-c8f4284363f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:54.151926 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb0f7-3aa6-4658-a3f4-c8f4284363f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:54.152298 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb0f7-3aa6-4658-a3f4-c8f4284363f4 admin admin] PATH_INFO: `/v3/projects/849362069bd64d25bd00acd2d010dd3d/users/9e17daca875048eb964800f5daa57445/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:54.157748 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bb0f7-3aa6-4658-a3f4-c8f4284363f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849362069bd64d25bd00acd2d010dd3d, user_id=9e17daca875048eb964800f5daa57445, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:54.163983 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bb0f7-3aa6-4658-a3f4-c8f4284363f4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:54.189222 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 822/1645] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:54 2022] PUT /identity/v3/projects/849362069bd64d25bd00acd2d010dd3d/users/9e17daca875048eb964800f5daa57445/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:54.199537 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb0f7-3aa6-4658-a3f4-c8f4284363f4 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:54.246466 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404b565-c234-4b6c-b129-37446e732bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:54.247417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404b565-c234-4b6c-b129-37446e732bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:54.247710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404b565-c234-4b6c-b129-37446e732bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:54.247993 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404b565-c234-4b6c-b129-37446e732bfe admin admin] PATH_INFO: `/v3/projects/6903ec1b202e4d4d9e5cb0a651197bc9/users/92bafc0c408c4165bfd620b025b9dcae/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:54.278820 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404b565-c234-4b6c-b129-37446e732bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6903ec1b202e4d4d9e5cb0a651197bc9, user_id=92bafc0c408c4165bfd620b025b9dcae, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:54.282094 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404b565-c234-4b6c-b129-37446e732bfe admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:54.290046 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:54.308795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 824/1646] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:53 2022] PUT /identity/v3/projects/6903ec1b202e4d4d9e5cb0a651197bc9/users/92bafc0c408c4165bfd620b025b9dcae/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:54.309994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404b565-c234-4b6c-b129-37446e732bfe admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:54.325788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:54.350716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb0f7-3aa6-4658-a3f4-c8f4284363f4 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:54.415204 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404b565-c234-4b6c-b129-37446e732bfe admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:54.429741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d4e9c-4581-4d4b-bff1-17a296c4f8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:54.432170 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d4e9c-4581-4d4b-bff1-17a296c4f8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:54.432465 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d4e9c-4581-4d4b-bff1-17a296c4f8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:54.435410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d4e9c-4581-4d4b-bff1-17a296c4f8dd admin admin] PATH_INFO: `/v3/projects/806d5d9a9b914ef5b44c7693448eea53/users/d67a1beceb824b77b834ebae18e9dcc8/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:54.452817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff03e77-1ee4-4059-aabf-4ab6b6f787f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:54.453880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff03e77-1ee4-4059-aabf-4ab6b6f787f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:54.454423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff03e77-1ee4-4059-aabf-4ab6b6f787f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:54.455103 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff03e77-1ee4-4059-aabf-4ab6b6f787f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:54.456259 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff03e77-1ee4-4059-aabf-4ab6b6f787f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:54.458785 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff03e77-1ee4-4059-aabf-4ab6b6f787f7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:54.472668 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 823/1647] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:54.473728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d4e9c-4581-4d4b-bff1-17a296c4f8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=806d5d9a9b914ef5b44c7693448eea53, user_id=d67a1beceb824b77b834ebae18e9dcc8, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:54.474749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f49f4f-9fd3-40ab-ba58-0e6815743207 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:54.475517 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f49f4f-9fd3-40ab-ba58-0e6815743207 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:54.476073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f49f4f-9fd3-40ab-ba58-0e6815743207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:54.481029 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d4e9c-4581-4d4b-bff1-17a296c4f8dd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:54.509772 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 825/1648] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:54 2022] PUT /identity/v3/projects/806d5d9a9b914ef5b44c7693448eea53/users/d67a1beceb824b77b834ebae18e9dcc8/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:54.511507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7b728-cb00-4fdc-b9b5-79a5ca877f66 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:54.511851 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7b728-cb00-4fdc-b9b5-79a5ca877f66 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:54.512543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7b728-cb00-4fdc-b9b5-79a5ca877f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:54.547081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-31f49f4f-9fd3-40ab-ba58-0e6815743207 None None] MFA Rules not processed for user `89734fb79d7b4f4ea8960fd5e2ce0fca`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:54.549136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-31f49f4f-9fd3-40ab-ba58-0e6815743207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:54.550941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2cd7b728-cb00-4fdc-b9b5-79a5ca877f66 None None] MFA Rules not processed for user `9e17daca875048eb964800f5daa57445`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:54.552973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2cd7b728-cb00-4fdc-b9b5-79a5ca877f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:54.655873 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 824/1649] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:54 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:54.657747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd1a46-87bd-4d5c-b8fe-d964e02b351b None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:54.658049 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd1a46-87bd-4d5c-b8fe-d964e02b351b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:54.658720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd1a46-87bd-4d5c-b8fe-d964e02b351b None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:54.661484 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 825/1650] 10.222.0.36 () {54 vars in 961 bytes} [Wed Jun 15 00:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:54.662114 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd1a46-87bd-4d5c-b8fe-d964e02b351b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:54.674115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 826/1651] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:54.675236 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7b728-cb00-4fdc-b9b5-79a5ca877f66 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:54.755305 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7b728-cb00-4fdc-b9b5-79a5ca877f66 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:54.759275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd1a46-87bd-4d5c-b8fe-d964e02b351b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:54.760509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cbae4-763b-4555-9801-d672d5f6d2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:54.761610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cbae4-763b-4555-9801-d672d5f6d2fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:54.761968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cbae4-763b-4555-9801-d672d5f6d2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:54.762319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cbae4-763b-4555-9801-d672d5f6d2fb admin admin] PATH_INFO: `/v3/projects/1efc14e43fe34e65bc315ba79ef7f209/users/10c18b3e385049398d32d64027fed24f/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:54.764487 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cbae4-763b-4555-9801-d672d5f6d2fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1efc14e43fe34e65bc315ba79ef7f209, user_id=10c18b3e385049398d32d64027fed24f, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:54.764749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf15dac-58f4-4146-b54d-b04aa8fef778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:54.766036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf15dac-58f4-4146-b54d-b04aa8fef778 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:54.766385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf15dac-58f4-4146-b54d-b04aa8fef778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:54.766734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf15dac-58f4-4146-b54d-b04aa8fef778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:54.767555 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf15dac-58f4-4146-b54d-b04aa8fef778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:54.767688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cbae4-763b-4555-9801-d672d5f6d2fb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:54.769863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf15dac-58f4-4146-b54d-b04aa8fef778 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:54.776721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:54.790733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 826/1653] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:34:54.790733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b75a3-68e4-4b73-b174-239c3d4569bc None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:54.790733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b75a3-68e4-4b73-b174-239c3d4569bc None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:54.790733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b75a3-68e4-4b73-b174-239c3d4569bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:54.792202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 827/1653] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:54 2022] PUT /identity/v3/projects/1efc14e43fe34e65bc315ba79ef7f209/users/10c18b3e385049398d32d64027fed24f/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:54.793978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42cf3d-a12b-4631-9006-ba8d29ef0af6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:54.794370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42cf3d-a12b-4631-9006-ba8d29ef0af6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:54.794749 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42cf3d-a12b-4631-9006-ba8d29ef0af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:54.831597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-467b75a3-68e4-4b73-b174-239c3d4569bc None None] MFA Rules not processed for user `772b9a5e43034b37ae878024830ddd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:54.831807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8e42cf3d-a12b-4631-9006-ba8d29ef0af6 None None] MFA Rules not processed for user `d67a1beceb824b77b834ebae18e9dcc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:54.832965 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8e42cf3d-a12b-4631-9006-ba8d29ef0af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:54.833587 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-467b75a3-68e4-4b73-b174-239c3d4569bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:54.843768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:54.939483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 827/1654] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:54.944735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 828/1655] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:54 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:54.944735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42cf3d-a12b-4631-9006-ba8d29ef0af6 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:54.956442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cab1cd-f860-4f8c-8b8c-ac74cd5a6180 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:54.956740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cab1cd-f860-4f8c-8b8c-ac74cd5a6180 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:54.957088 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cab1cd-f860-4f8c-8b8c-ac74cd5a6180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:54.977836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c1cab1cd-f860-4f8c-8b8c-ac74cd5a6180 None None] MFA Rules not processed for user `6d0ae1707c7041a0989889dbefeaf267`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:54.978426 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c1cab1cd-f860-4f8c-8b8c-ac74cd5a6180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:55.052229 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42cf3d-a12b-4631-9006-ba8d29ef0af6 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:55.059505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50664825-70f0-4e30-8f0d-23b269f9a394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:55.061080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50664825-70f0-4e30-8f0d-23b269f9a394 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:55.061766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50664825-70f0-4e30-8f0d-23b269f9a394 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:55.062613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50664825-70f0-4e30-8f0d-23b269f9a394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:55.091740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 828/1656] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Jun 15 00:34:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:55.093794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cab1cd-f860-4f8c-8b8c-ac74cd5a6180 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:55.108166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cab1cd-f860-4f8c-8b8c-ac74cd5a6180 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:55.114751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727d99b-305a-4dcb-8247-e16c345b0322 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:55.115778 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727d99b-305a-4dcb-8247-e16c345b0322 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:55.116409 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727d99b-305a-4dcb-8247-e16c345b0322 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:55.116849 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727d99b-305a-4dcb-8247-e16c345b0322 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:55.145550 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50664825-70f0-4e30-8f0d-23b269f9a394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:55.147698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50664825-70f0-4e30-8f0d-23b269f9a394 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:55.160865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 829/1657] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:55.162149 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50664825-70f0-4e30-8f0d-23b269f9a394 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:55.272022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:55.281214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50664825-70f0-4e30-8f0d-23b269f9a394 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:55.283205 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727d99b-305a-4dcb-8247-e16c345b0322 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:55.284675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727d99b-305a-4dcb-8247-e16c345b0322 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:55.287724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316d579-d5bc-40fa-af96-09be3e147f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:55.287724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316d579-d5bc-40fa-af96-09be3e147f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:55.287724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316d579-d5bc-40fa-af96-09be3e147f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:55.288275 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316d579-d5bc-40fa-af96-09be3e147f19 admin admin] PATH_INFO: `/v3/projects/6903ec1b202e4d4d9e5cb0a651197bc9/users/92bafc0c408c4165bfd620b025b9dcae/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:55.291589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316d579-d5bc-40fa-af96-09be3e147f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6903ec1b202e4d4d9e5cb0a651197bc9, user_id=92bafc0c408c4165bfd620b025b9dcae, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:55.294816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316d579-d5bc-40fa-af96-09be3e147f19 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:55.295884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 829/1658] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:55.297251 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78b2e8-a3c3-46d9-b772-45cbbc7839f6 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:55.297688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78b2e8-a3c3-46d9-b772-45cbbc7839f6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:55.298446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78b2e8-a3c3-46d9-b772-45cbbc7839f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:55.312721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 830/1659] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:34:55 2022] PUT /identity/v3/projects/6903ec1b202e4d4d9e5cb0a651197bc9/users/92bafc0c408c4165bfd620b025b9dcae/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:55.318093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dde27d-7754-40c7-a74f-f6d0d8738d34 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:55.318487 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dde27d-7754-40c7-a74f-f6d0d8738d34 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:55.318776 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dde27d-7754-40c7-a74f-f6d0d8738d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:55.335274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9b78b2e8-a3c3-46d9-b772-45cbbc7839f6 None None] MFA Rules not processed for user `10c18b3e385049398d32d64027fed24f`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:55.336847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9b78b2e8-a3c3-46d9-b772-45cbbc7839f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:55.344096 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:55.370983 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-96dde27d-7754-40c7-a74f-f6d0d8738d34 None None] MFA Rules not processed for user `772b9a5e43034b37ae878024830ddd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:55.376611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-96dde27d-7754-40c7-a74f-f6d0d8738d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:55.496620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 830/1660] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:55.496620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864864d3-ad61-467f-a239-912fc65644af None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:55.496620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864864d3-ad61-467f-a239-912fc65644af None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:55.496620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864864d3-ad61-467f-a239-912fc65644af None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:55.497852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 831/1661] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:55.500939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dde27d-7754-40c7-a74f-f6d0d8738d34 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:55.503481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 831/1662] 10.222.0.36 () {54 vars in 912 bytes} [Wed Jun 15 00:34:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:55.506431 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a0b31-e64e-446e-a09d-c583f04246b5 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:55.506867 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a0b31-e64e-446e-a09d-c583f04246b5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:55.507269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a0b31-e64e-446e-a09d-c583f04246b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:55.532414 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-de8a0b31-e64e-446e-a09d-c583f04246b5 None None] MFA Rules not processed for user `6d0ae1707c7041a0989889dbefeaf267`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:55.533853 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-de8a0b31-e64e-446e-a09d-c583f04246b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:55.630084 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 832/1663] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 15 00:34:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:55.630792 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a0b31-e64e-446e-a09d-c583f04246b5 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:55.639833 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dde27d-7754-40c7-a74f-f6d0d8738d34 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:55.642378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a0b31-e64e-446e-a09d-c583f04246b5 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:55.645644 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c95d3-3075-4837-8b6d-8e5d56bfebad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:55.646285 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c95d3-3075-4837-8b6d-8e5d56bfebad service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:55.646568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c95d3-3075-4837-8b6d-8e5d56bfebad service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:55.646855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c95d3-3075-4837-8b6d-8e5d56bfebad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:55.653367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7740b6-86b5-425d-b8fb-60d33eb92b65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:55.654146 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7740b6-86b5-425d-b8fb-60d33eb92b65 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:55.654512 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7740b6-86b5-425d-b8fb-60d33eb92b65 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:55.654867 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7740b6-86b5-425d-b8fb-60d33eb92b65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:55.665568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7740b6-86b5-425d-b8fb-60d33eb92b65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:55.667305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7740b6-86b5-425d-b8fb-60d33eb92b65 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:55.687025 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 833/1664] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:55.688035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7740b6-86b5-425d-b8fb-60d33eb92b65 service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:55.700735 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7740b6-86b5-425d-b8fb-60d33eb92b65 service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:55.707006 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1745dac-fcf8-4e6a-bb8c-d7f8cda37d28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:55.707686 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1745dac-fcf8-4e6a-bb8c-d7f8cda37d28 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:55.708118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1745dac-fcf8-4e6a-bb8c-d7f8cda37d28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:55.708412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1745dac-fcf8-4e6a-bb8c-d7f8cda37d28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:55.762268 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c95d3-3075-4837-8b6d-8e5d56bfebad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:55.763799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c95d3-3075-4837-8b6d-8e5d56bfebad service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:55.792708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 832/1665] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:55 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:55.815526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1745dac-fcf8-4e6a-bb8c-d7f8cda37d28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:55.823330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1745dac-fcf8-4e6a-bb8c-d7f8cda37d28 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:55.848078 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 834/1666] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:55.870156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c95d3-3075-4837-8b6d-8e5d56bfebad service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:55.887709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c95d3-3075-4837-8b6d-8e5d56bfebad service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:55.897232 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aee261-b3d6-47c0-b22c-15dde6e14f04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:55.897655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aee261-b3d6-47c0-b22c-15dde6e14f04 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:55.897940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aee261-b3d6-47c0-b22c-15dde6e14f04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:55.898216 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aee261-b3d6-47c0-b22c-15dde6e14f04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:55.921688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aee261-b3d6-47c0-b22c-15dde6e14f04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:55.923423 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aee261-b3d6-47c0-b22c-15dde6e14f04 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:55.951573 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 833/1667] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:56.126887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1745dac-fcf8-4e6a-bb8c-d7f8cda37d28 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:56.138839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1745dac-fcf8-4e6a-bb8c-d7f8cda37d28 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:56.149329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95df93-e84e-4ab4-849d-cef1d39f8da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:56.150059 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95df93-e84e-4ab4-849d-cef1d39f8da9 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:56.150349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95df93-e84e-4ab4-849d-cef1d39f8da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:56.150630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95df93-e84e-4ab4-849d-cef1d39f8da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:56.182452 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:56.213502 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aee261-b3d6-47c0-b22c-15dde6e14f04 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:56.226617 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aee261-b3d6-47c0-b22c-15dde6e14f04 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:56.233282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df1f79-c84f-4a5d-9eef-4adc38c7da11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:56.234889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df1f79-c84f-4a5d-9eef-4adc38c7da11 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:56.234889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df1f79-c84f-4a5d-9eef-4adc38c7da11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:56.234889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df1f79-c84f-4a5d-9eef-4adc38c7da11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:56.255298 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df1f79-c84f-4a5d-9eef-4adc38c7da11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:56.256766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df1f79-c84f-4a5d-9eef-4adc38c7da11 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:56.285579 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95df93-e84e-4ab4-849d-cef1d39f8da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:56.287056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95df93-e84e-4ab4-849d-cef1d39f8da9 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:56.289114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 834/1668] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:56.302263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 835/1669] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:56.492735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a96188-7a30-4ca9-a2e1-32ca93e268ba None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:56.493213 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a96188-7a30-4ca9-a2e1-32ca93e268ba None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:56.493564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a96188-7a30-4ca9-a2e1-32ca93e268ba None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:56.495662 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 835/1670] 10.222.0.36 () {54 vars in 912 bytes} [Wed Jun 15 00:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:56.501039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae329b4a-0f99-4a70-a701-256a36cac07c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:56.501330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae329b4a-0f99-4a70-a701-256a36cac07c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:56.501671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae329b4a-0f99-4a70-a701-256a36cac07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:56.564732 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ae329b4a-0f99-4a70-a701-256a36cac07c None None] MFA Rules not processed for user `46c398ec4dcc438895f054f616fc9e41`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:56.567837 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ae329b4a-0f99-4a70-a701-256a36cac07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:56.680379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 836/1671] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 15 00:34:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:56.705864 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a96188-7a30-4ca9-a2e1-32ca93e268ba None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:56.724122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a96188-7a30-4ca9-a2e1-32ca93e268ba None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:56.735789 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5d657-3aaa-4caf-88ce-dfa178d44aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:56.739613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5d657-3aaa-4caf-88ce-dfa178d44aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:56.740542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5d657-3aaa-4caf-88ce-dfa178d44aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:56.742460 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5d657-3aaa-4caf-88ce-dfa178d44aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:56.765000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5d657-3aaa-4caf-88ce-dfa178d44aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:56.768030 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5d657-3aaa-4caf-88ce-dfa178d44aa1 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:56.801993 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 836/1672] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:56.885745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057dd5d-6434-4597-aca3-349b992990e6 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:56.886266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057dd5d-6434-4597-aca3-349b992990e6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:56.886380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057dd5d-6434-4597-aca3-349b992990e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:56.950956 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9057dd5d-6434-4597-aca3-349b992990e6 None None] MFA Rules not processed for user `92bafc0c408c4165bfd620b025b9dcae`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:56.954262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9057dd5d-6434-4597-aca3-349b992990e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:57.261988 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 837/1673] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:56 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:57.576871 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5d657-3aaa-4caf-88ce-dfa178d44aa1 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:57.593270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:57.835017 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5d657-3aaa-4caf-88ce-dfa178d44aa1 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:57.852019 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fbeb2-4e0a-49e3-94aa-5eee45bcfb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:57.853595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fbeb2-4e0a-49e3-94aa-5eee45bcfb14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:57.854068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fbeb2-4e0a-49e3-94aa-5eee45bcfb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:57.854512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fbeb2-4e0a-49e3-94aa-5eee45bcfb14 admin admin] PATH_INFO: `/v3/users/57ab69989e8642c8ada96ebd40cacfde` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:57.859234 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fbeb2-4e0a-49e3-94aa-5eee45bcfb14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ab69989e8642c8ada96ebd40cacfde)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:57.861235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: WARNING py.warnings [None req-b73fbeb2-4e0a-49e3-94aa-5eee45bcfb14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:34:57.861235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: warnings.warn(msg) Jun 15 00:34:57.861235 dv-cinder-835384-6-smb devstack@keystone.service[80189]: Jun 15 00:34:57.866013 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fbeb2-4e0a-49e3-94aa-5eee45bcfb14 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:57.949371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a632b-107d-4912-95d3-ebf48c01163c None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:57.951176 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a632b-107d-4912-95d3-ebf48c01163c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:57.951716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a632b-107d-4912-95d3-ebf48c01163c None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:57.958356 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 838/1674] 10.222.0.36 () {54 vars in 960 bytes} [Wed Jun 15 00:34:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:57.966237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefc1b0-e9a3-4769-a2d4-98e62c8bda5c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:57.968076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefc1b0-e9a3-4769-a2d4-98e62c8bda5c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:57.969119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefc1b0-e9a3-4769-a2d4-98e62c8bda5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:58.034560 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4eefc1b0-e9a3-4769-a2d4-98e62c8bda5c None None] MFA Rules not processed for user `24e6dd029a3d45f6aeb4da06db9753dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:58.039674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4eefc1b0-e9a3-4769-a2d4-98e62c8bda5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:58.044717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b73fbeb2-4e0a-49e3-94aa-5eee45bcfb14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ab69989e8642c8ada96ebd40cacfde'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:34:58.073054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b73fbeb2-4e0a-49e3-94aa-5eee45bcfb14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ab69989e8642c8ada96ebd40cacfde'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:34:58.074118 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b73fbeb2-4e0a-49e3-94aa-5eee45bcfb14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ab69989e8642c8ada96ebd40cacfde'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:34:58.074472 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b73fbeb2-4e0a-49e3-94aa-5eee45bcfb14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ab69989e8642c8ada96ebd40cacfde'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:34:58.163871 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b73fbeb2-4e0a-49e3-94aa-5eee45bcfb14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ab69989e8642c8ada96ebd40cacfde'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:34:58.174927 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:58.222451 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 837/1675] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:34:57 2022] DELETE /identity/v3/users/57ab69989e8642c8ada96ebd40cacfde => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:58.226404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40976a72-c7ca-4216-8551-d412e801be30 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:58.227191 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40976a72-c7ca-4216-8551-d412e801be30 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:58.228507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40976a72-c7ca-4216-8551-d412e801be30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:58.247526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 839/1676] 10.222.0.36 () {58 vars in 1057 bytes} [Wed Jun 15 00:34:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:58.256872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefc1b0-e9a3-4769-a2d4-98e62c8bda5c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:58.272644 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-40976a72-c7ca-4216-8551-d412e801be30 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:58.275685 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefc1b0-e9a3-4769-a2d4-98e62c8bda5c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:58.277174 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-40976a72-c7ca-4216-8551-d412e801be30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:58.477525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 838/1677] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:58.477525 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40976a72-c7ca-4216-8551-d412e801be30 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:58.477778 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25537c6f-6c6a-4e49-9777-c051d68e263d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e6dd029a3d45f6aeb4da06db9753dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:58.478065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-40976a72-c7ca-4216-8551-d412e801be30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:58.478479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25537c6f-6c6a-4e49-9777-c051d68e263d service placement] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:58.478769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25537c6f-6c6a-4e49-9777-c051d68e263d service placement] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:58.479169 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25537c6f-6c6a-4e49-9777-c051d68e263d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:58.481938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-25537c6f-6c6a-4e49-9777-c051d68e263d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:58.503290 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25537c6f-6c6a-4e49-9777-c051d68e263d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:58.504889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25537c6f-6c6a-4e49-9777-c051d68e263d service placement] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:58.520246 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40976a72-c7ca-4216-8551-d412e801be30 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:58.526307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89a12c-e4b7-4ccb-a166-204a7e03ad03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:58.527216 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89a12c-e4b7-4ccb-a166-204a7e03ad03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:58.527502 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89a12c-e4b7-4ccb-a166-204a7e03ad03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:58.527794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89a12c-e4b7-4ccb-a166-204a7e03ad03 admin admin] PATH_INFO: `/v3/users/3a5031b8154d4b18846b793fd8f7c1ef` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:58.530708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89a12c-e4b7-4ccb-a166-204a7e03ad03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5031b8154d4b18846b793fd8f7c1ef)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:58.532980 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89a12c-e4b7-4ccb-a166-204a7e03ad03 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:58.549853 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 840/1678] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:58.550916 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25537c6f-6c6a-4e49-9777-c051d68e263d service placement] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:58.556833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-25537c6f-6c6a-4e49-9777-c051d68e263d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:58.609790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:58.703497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4c89a12c-e4b7-4ccb-a166-204a7e03ad03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5031b8154d4b18846b793fd8f7c1ef'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:34:58.729596 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4c89a12c-e4b7-4ccb-a166-204a7e03ad03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5031b8154d4b18846b793fd8f7c1ef'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:34:58.730433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4c89a12c-e4b7-4ccb-a166-204a7e03ad03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5031b8154d4b18846b793fd8f7c1ef'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:34:58.733192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4c89a12c-e4b7-4ccb-a166-204a7e03ad03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5031b8154d4b18846b793fd8f7c1ef'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:34:58.767917 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25537c6f-6c6a-4e49-9777-c051d68e263d service placement] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:58.795475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a6f73-9abe-475e-bc20-813f99e6142d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:58.799244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a6f73-9abe-475e-bc20-813f99e6142d service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:58.799625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a6f73-9abe-475e-bc20-813f99e6142d service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:58.801401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a6f73-9abe-475e-bc20-813f99e6142d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:58.807421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2e1a6f73-9abe-475e-bc20-813f99e6142d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:58.807826 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4c89a12c-e4b7-4ccb-a166-204a7e03ad03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5031b8154d4b18846b793fd8f7c1ef'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:34:58.837269 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 839/1679] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:34:58 2022] DELETE /identity/v3/users/3a5031b8154d4b18846b793fd8f7c1ef => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:34:58.838828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a6f73-9abe-475e-bc20-813f99e6142d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:58.840560 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a6f73-9abe-475e-bc20-813f99e6142d service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:58.842507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c423aee-477c-41ba-b070-df707087dd71 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:58.843145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c423aee-477c-41ba-b070-df707087dd71 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:58.843618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c423aee-477c-41ba-b070-df707087dd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:58.871492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 841/1680] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:58.874536 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7c423aee-477c-41ba-b070-df707087dd71 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:58.876270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7c423aee-477c-41ba-b070-df707087dd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:59.033294 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 840/1681] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:34:59.046943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a6f73-9abe-475e-bc20-813f99e6142d service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:59.049608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2e1a6f73-9abe-475e-bc20-813f99e6142d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:59.079519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a6f73-9abe-475e-bc20-813f99e6142d service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:59.249648 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f02497-72a3-47b4-89ad-507cfaa7ab66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:59.250329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f02497-72a3-47b4-89ad-507cfaa7ab66 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:59.250613 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f02497-72a3-47b4-89ad-507cfaa7ab66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:59.251079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f02497-72a3-47b4-89ad-507cfaa7ab66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:59.272223 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f02497-72a3-47b4-89ad-507cfaa7ab66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:59.276871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f02497-72a3-47b4-89ad-507cfaa7ab66 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:59.300516 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 842/1682] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:34:59.589043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd0727-1c2d-4fa8-80e1-ef76ffbf4bd9 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:59.589889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd0727-1c2d-4fa8-80e1-ef76ffbf4bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:59.590399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd0727-1c2d-4fa8-80e1-ef76ffbf4bd9 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:59.592244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 841/1683] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 15 00:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:34:59.612913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059a21-47d5-4bb5-b480-f2b786dc1129 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:59.613714 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059a21-47d5-4bb5-b480-f2b786dc1129 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:59.614220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059a21-47d5-4bb5-b480-f2b786dc1129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:59.668333 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-20059a21-47d5-4bb5-b480-f2b786dc1129 None None] MFA Rules not processed for user `24e6dd029a3d45f6aeb4da06db9753dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:34:59.670041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-20059a21-47d5-4bb5-b480-f2b786dc1129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:59.690551 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:34:59.830756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 843/1684] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 15 00:34:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:34:59.867009 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd0727-1c2d-4fa8-80e1-ef76ffbf4bd9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:34:59.869071 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f1dd0727-1c2d-4fa8-80e1-ef76ffbf4bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:34:59.897294 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd0727-1c2d-4fa8-80e1-ef76ffbf4bd9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:34:59.908418 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809668c5-19a5-40be-b304-45ef09805d71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e6dd029a3d45f6aeb4da06db9753dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:34:59.909541 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809668c5-19a5-40be-b304-45ef09805d71 service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:34:59.909979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809668c5-19a5-40be-b304-45ef09805d71 service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:34:59.910414 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809668c5-19a5-40be-b304-45ef09805d71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:34:59.922881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809668c5-19a5-40be-b304-45ef09805d71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:34:59.927222 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809668c5-19a5-40be-b304-45ef09805d71 service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:34:59.955645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 842/1685] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:34:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:00.051852 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20059a21-47d5-4bb5-b480-f2b786dc1129 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:00.058552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-20059a21-47d5-4bb5-b480-f2b786dc1129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:00.082171 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20059a21-47d5-4bb5-b480-f2b786dc1129 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:00.093002 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd3de5-a64c-4a15-ad06-5327b4229005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:00.094526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd3de5-a64c-4a15-ad06-5327b4229005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:00.094816 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd3de5-a64c-4a15-ad06-5327b4229005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:00.095679 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd3de5-a64c-4a15-ad06-5327b4229005 admin admin] PATH_INFO: `/v3/users/5b0386fdb2454f629aba7e195275b885` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:00.097550 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd3de5-a64c-4a15-ad06-5327b4229005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0386fdb2454f629aba7e195275b885)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:00.099857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd3de5-a64c-4a15-ad06-5327b4229005 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:00.235099 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-eccd3de5-a64c-4a15-ad06-5327b4229005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0386fdb2454f629aba7e195275b885'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:00.258645 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-eccd3de5-a64c-4a15-ad06-5327b4229005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0386fdb2454f629aba7e195275b885'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:00.259296 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-eccd3de5-a64c-4a15-ad06-5327b4229005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0386fdb2454f629aba7e195275b885'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:00.260085 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-eccd3de5-a64c-4a15-ad06-5327b4229005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0386fdb2454f629aba7e195275b885'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:00.293701 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-eccd3de5-a64c-4a15-ad06-5327b4229005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0386fdb2454f629aba7e195275b885'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:00.322425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 844/1686] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:00 2022] DELETE /identity/v3/users/5b0386fdb2454f629aba7e195275b885 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:00.327698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42182a6a-4340-448f-93b4-0c4bd83fdcc9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:00.328286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42182a6a-4340-448f-93b4-0c4bd83fdcc9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:00.328767 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42182a6a-4340-448f-93b4-0c4bd83fdcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:00.361241 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-42182a6a-4340-448f-93b4-0c4bd83fdcc9 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:00.363626 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-42182a6a-4340-448f-93b4-0c4bd83fdcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:00.567653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 843/1687] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:00.629024 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd3de5-a64c-4a15-ad06-5327b4229005 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:00.630909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-eccd3de5-a64c-4a15-ad06-5327b4229005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:00.697642 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42182a6a-4340-448f-93b4-0c4bd83fdcc9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:00.699484 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-42182a6a-4340-448f-93b4-0c4bd83fdcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:00.728609 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42182a6a-4340-448f-93b4-0c4bd83fdcc9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:00.740046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3dd1f-5e60-4384-9995-4d81780826d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:00.741581 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3dd1f-5e60-4384-9995-4d81780826d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:00.742088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3dd1f-5e60-4384-9995-4d81780826d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:00.742586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3dd1f-5e60-4384-9995-4d81780826d8 admin admin] PATH_INFO: `/v3/projects/38b1cfd96f81441bab8821b8bf5abacf` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:00.754048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3dd1f-5e60-4384-9995-4d81780826d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b1cfd96f81441bab8821b8bf5abacf)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:00.756223 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3dd1f-5e60-4384-9995-4d81780826d8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:00.803045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd3de5-a64c-4a15-ad06-5327b4229005 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:00.804124 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:00.833970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03321977-de71-4793-8bb6-4bbd32a8845a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:00.835215 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03321977-de71-4793-8bb6-4bbd32a8845a service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:00.835734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03321977-de71-4793-8bb6-4bbd32a8845a service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:00.844684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03321977-de71-4793-8bb6-4bbd32a8845a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:00.861279 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-64a3dd1f-5e60-4384-9995-4d81780826d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b1cfd96f81441bab8821b8bf5abacf', 'request_id': 'req-64a3dd1f-5e60-4384-9995-4d81780826d8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:00.877601 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-64a3dd1f-5e60-4384-9995-4d81780826d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b1cfd96f81441bab8821b8bf5abacf', 'request_id': 'req-64a3dd1f-5e60-4384-9995-4d81780826d8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:00.878581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03321977-de71-4793-8bb6-4bbd32a8845a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:00.889192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-64a3dd1f-5e60-4384-9995-4d81780826d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b1cfd96f81441bab8821b8bf5abacf', 'request_id': 'req-64a3dd1f-5e60-4384-9995-4d81780826d8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:00.896367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03321977-de71-4793-8bb6-4bbd32a8845a service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:00.917068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-64a3dd1f-5e60-4384-9995-4d81780826d8 admin admin] The token cache is being invalidate because project 38b1cfd96f81441bab8821b8bf5abacf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:00.917740 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-64a3dd1f-5e60-4384-9995-4d81780826d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:00.919844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-64a3dd1f-5e60-4384-9995-4d81780826d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:00.926679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 844/1688] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:00 2022] DELETE /identity/v3/projects/38b1cfd96f81441bab8821b8bf5abacf => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:00.927908 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3dd1f-5e60-4384-9995-4d81780826d8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:00.932279 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-64a3dd1f-5e60-4384-9995-4d81780826d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:00.958677 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 845/1689] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:01.029575 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03321977-de71-4793-8bb6-4bbd32a8845a service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:01.031399 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-03321977-de71-4793-8bb6-4bbd32a8845a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:01.054794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03321977-de71-4793-8bb6-4bbd32a8845a service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:01.097870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3dd1f-5e60-4384-9995-4d81780826d8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:01.104839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:01.112124 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce39b5-6e00-48e4-8599-8e514ace723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:01.115629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce39b5-6e00-48e4-8599-8e514ace723c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:01.117334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce39b5-6e00-48e4-8599-8e514ace723c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:01.118021 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce39b5-6e00-48e4-8599-8e514ace723c admin admin] PATH_INFO: `/v3/users/d67a1beceb824b77b834ebae18e9dcc8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:01.124088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce39b5-6e00-48e4-8599-8e514ace723c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d67a1beceb824b77b834ebae18e9dcc8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:01.126816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce39b5-6e00-48e4-8599-8e514ace723c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:01.207994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333bd59-176d-4c4d-8741-ced032c9e309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:01.209156 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333bd59-176d-4c4d-8741-ced032c9e309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:01.209738 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333bd59-176d-4c4d-8741-ced032c9e309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:01.210191 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333bd59-176d-4c4d-8741-ced032c9e309 admin admin] PATH_INFO: `/v3/projects/54c128e73ca24206a1088f4babbab672` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:01.211688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333bd59-176d-4c4d-8741-ced032c9e309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c128e73ca24206a1088f4babbab672)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:01.212944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: WARNING py.warnings [None req-9333bd59-176d-4c4d-8741-ced032c9e309 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 15 00:35:01.212944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: warnings.warn(msg) Jun 15 00:35:01.212944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: Jun 15 00:35:01.214811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333bd59-176d-4c4d-8741-ced032c9e309 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:01.248234 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-80ce39b5-6e00-48e4-8599-8e514ace723c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd67a1beceb824b77b834ebae18e9dcc8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:01.264945 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-80ce39b5-6e00-48e4-8599-8e514ace723c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd67a1beceb824b77b834ebae18e9dcc8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:01.266010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-80ce39b5-6e00-48e4-8599-8e514ace723c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd67a1beceb824b77b834ebae18e9dcc8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:01.266675 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-80ce39b5-6e00-48e4-8599-8e514ace723c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd67a1beceb824b77b834ebae18e9dcc8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:01.297446 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-80ce39b5-6e00-48e4-8599-8e514ace723c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd67a1beceb824b77b834ebae18e9dcc8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:01.329100 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 845/1690] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:00 2022] DELETE /identity/v3/users/d67a1beceb824b77b834ebae18e9dcc8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:01.371703 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9333bd59-176d-4c4d-8741-ced032c9e309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c128e73ca24206a1088f4babbab672', 'request_id': 'req-9333bd59-176d-4c4d-8741-ced032c9e309'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:01.413022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9333bd59-176d-4c4d-8741-ced032c9e309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c128e73ca24206a1088f4babbab672', 'request_id': 'req-9333bd59-176d-4c4d-8741-ced032c9e309'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:01.456121 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9333bd59-176d-4c4d-8741-ced032c9e309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c128e73ca24206a1088f4babbab672', 'request_id': 'req-9333bd59-176d-4c4d-8741-ced032c9e309'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:01.483899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9333bd59-176d-4c4d-8741-ced032c9e309 admin admin] The token cache is being invalidate because project 54c128e73ca24206a1088f4babbab672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:01.484459 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9333bd59-176d-4c4d-8741-ced032c9e309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:01.485310 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9333bd59-176d-4c4d-8741-ced032c9e309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:01.488615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 846/1691] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:01 2022] DELETE /identity/v3/projects/54c128e73ca24206a1088f4babbab672 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:01.493572 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce39b5-6e00-48e4-8599-8e514ace723c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:01.495410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-80ce39b5-6e00-48e4-8599-8e514ace723c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:01.557789 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:01.625728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce39b5-6e00-48e4-8599-8e514ace723c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:01.701223 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333bd59-176d-4c4d-8741-ced032c9e309 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:01.702952 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9333bd59-176d-4c4d-8741-ced032c9e309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:01.763914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094cdd4-433f-464e-a271-4b4b863c6cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:01.764924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094cdd4-433f-464e-a271-4b4b863c6cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:01.765210 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094cdd4-433f-464e-a271-4b4b863c6cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:01.769696 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094cdd4-433f-464e-a271-4b4b863c6cd3 admin admin] PATH_INFO: `/v3/users/10c18b3e385049398d32d64027fed24f` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:01.774211 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094cdd4-433f-464e-a271-4b4b863c6cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c18b3e385049398d32d64027fed24f)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:01.781002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094cdd4-433f-464e-a271-4b4b863c6cd3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:01.882955 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333bd59-176d-4c4d-8741-ced032c9e309 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:01.888262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20605da-49b8-485d-aec4-2edb10ea4fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:01.889260 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20605da-49b8-485d-aec4-2edb10ea4fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:01.889735 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20605da-49b8-485d-aec4-2edb10ea4fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:01.890219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20605da-49b8-485d-aec4-2edb10ea4fa3 admin admin] PATH_INFO: `/v3/users/2a2896eda44743cbaea5903c0003bde6` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:01.891909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20605da-49b8-485d-aec4-2edb10ea4fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2896eda44743cbaea5903c0003bde6)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:01.894135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20605da-49b8-485d-aec4-2edb10ea4fa3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:01.958027 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9094cdd4-433f-464e-a271-4b4b863c6cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c18b3e385049398d32d64027fed24f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:01.982021 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9094cdd4-433f-464e-a271-4b4b863c6cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c18b3e385049398d32d64027fed24f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:01.983350 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9094cdd4-433f-464e-a271-4b4b863c6cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c18b3e385049398d32d64027fed24f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:01.984880 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9094cdd4-433f-464e-a271-4b4b863c6cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c18b3e385049398d32d64027fed24f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:01.991518 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c20605da-49b8-485d-aec4-2edb10ea4fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2896eda44743cbaea5903c0003bde6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:01.995232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:02.001328 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c20605da-49b8-485d-aec4-2edb10ea4fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2896eda44743cbaea5903c0003bde6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.002007 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c20605da-49b8-485d-aec4-2edb10ea4fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2896eda44743cbaea5903c0003bde6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.003158 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c20605da-49b8-485d-aec4-2edb10ea4fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2896eda44743cbaea5903c0003bde6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.008467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9094cdd4-433f-464e-a271-4b4b863c6cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c18b3e385049398d32d64027fed24f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.030639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c20605da-49b8-485d-aec4-2edb10ea4fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2896eda44743cbaea5903c0003bde6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.048883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 847/1692] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:01 2022] DELETE /identity/v3/users/2a2896eda44743cbaea5903c0003bde6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:02.049954 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20605da-49b8-485d-aec4-2edb10ea4fa3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:02.056333 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c20605da-49b8-485d-aec4-2edb10ea4fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:02.065677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 846/1693] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:01 2022] DELETE /identity/v3/users/10c18b3e385049398d32d64027fed24f => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:02.067244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1c191-080c-4f26-a1fa-b94d00d14991 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:02.067540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1c191-080c-4f26-a1fa-b94d00d14991 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:02.070028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1c191-080c-4f26-a1fa-b94d00d14991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:02.107547 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-dcb1c191-080c-4f26-a1fa-b94d00d14991 None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:02.116921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dcb1c191-080c-4f26-a1fa-b94d00d14991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:02.173008 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20605da-49b8-485d-aec4-2edb10ea4fa3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:02.181418 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6849f-7869-4836-99f9-0414de196acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:02.182751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6849f-7869-4836-99f9-0414de196acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:02.183446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6849f-7869-4836-99f9-0414de196acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:02.183835 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6849f-7869-4836-99f9-0414de196acb admin admin] PATH_INFO: `/v3/projects/93998b0d78f44acaa7d0a3427a0b793b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:02.192048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6849f-7869-4836-99f9-0414de196acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=93998b0d78f44acaa7d0a3427a0b793b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:02.194948 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6849f-7869-4836-99f9-0414de196acb admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:02.253800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:02.264890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 847/1694] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 15 00:35:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:02.265803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1c191-080c-4f26-a1fa-b94d00d14991 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:02.269384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dcb1c191-080c-4f26-a1fa-b94d00d14991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:02.326192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1c191-080c-4f26-a1fa-b94d00d14991 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:02.370374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a3c6849f-7869-4836-99f9-0414de196acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93998b0d78f44acaa7d0a3427a0b793b', 'request_id': 'req-a3c6849f-7869-4836-99f9-0414de196acb'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.384670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a3c6849f-7869-4836-99f9-0414de196acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93998b0d78f44acaa7d0a3427a0b793b', 'request_id': 'req-a3c6849f-7869-4836-99f9-0414de196acb'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.421910 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a3c6849f-7869-4836-99f9-0414de196acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93998b0d78f44acaa7d0a3427a0b793b', 'request_id': 'req-a3c6849f-7869-4836-99f9-0414de196acb'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.457302 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a3c6849f-7869-4836-99f9-0414de196acb admin admin] The token cache is being invalidate because project 93998b0d78f44acaa7d0a3427a0b793b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:02.458441 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a3c6849f-7869-4836-99f9-0414de196acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.459608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a3c6849f-7869-4836-99f9-0414de196acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.462144 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 848/1695] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:02 2022] DELETE /identity/v3/projects/93998b0d78f44acaa7d0a3427a0b793b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:02.471286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4cf87-8848-42a9-a5b6-2a7af22030fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:02.472511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4cf87-8848-42a9-a5b6-2a7af22030fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:02.472729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4cf87-8848-42a9-a5b6-2a7af22030fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:02.473010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4cf87-8848-42a9-a5b6-2a7af22030fb admin admin] PATH_INFO: `/v3/users/d6ae6bd14d1a437d9d40409061e65eee` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:02.476740 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4cf87-8848-42a9-a5b6-2a7af22030fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ae6bd14d1a437d9d40409061e65eee)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:02.480072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4cf87-8848-42a9-a5b6-2a7af22030fb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:02.481553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6849f-7869-4836-99f9-0414de196acb admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:02.490324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a3c6849f-7869-4836-99f9-0414de196acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:02.515834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6849f-7869-4836-99f9-0414de196acb admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:02.531215 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c32e07-1636-405d-88de-3cc5ca90ba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:02.534019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c32e07-1636-405d-88de-3cc5ca90ba55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:02.535897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c32e07-1636-405d-88de-3cc5ca90ba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:02.536234 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c32e07-1636-405d-88de-3cc5ca90ba55 admin admin] PATH_INFO: `/v3/users/89734fb79d7b4f4ea8960fd5e2ce0fca` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:02.541385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c32e07-1636-405d-88de-3cc5ca90ba55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89734fb79d7b4f4ea8960fd5e2ce0fca)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:02.546816 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c32e07-1636-405d-88de-3cc5ca90ba55 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:02.606032 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-15c4cf87-8848-42a9-a5b6-2a7af22030fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ae6bd14d1a437d9d40409061e65eee'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.618855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-15c4cf87-8848-42a9-a5b6-2a7af22030fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ae6bd14d1a437d9d40409061e65eee'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.621408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-15c4cf87-8848-42a9-a5b6-2a7af22030fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ae6bd14d1a437d9d40409061e65eee'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.622384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-15c4cf87-8848-42a9-a5b6-2a7af22030fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ae6bd14d1a437d9d40409061e65eee'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.647775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-15c4cf87-8848-42a9-a5b6-2a7af22030fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ae6bd14d1a437d9d40409061e65eee'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.662409 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a7c32e07-1636-405d-88de-3cc5ca90ba55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89734fb79d7b4f4ea8960fd5e2ce0fca'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.676818 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a7c32e07-1636-405d-88de-3cc5ca90ba55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89734fb79d7b4f4ea8960fd5e2ce0fca'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.677708 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a7c32e07-1636-405d-88de-3cc5ca90ba55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89734fb79d7b4f4ea8960fd5e2ce0fca'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.678838 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a7c32e07-1636-405d-88de-3cc5ca90ba55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89734fb79d7b4f4ea8960fd5e2ce0fca'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.680773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:02.683346 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 848/1696] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:02 2022] DELETE /identity/v3/users/d6ae6bd14d1a437d9d40409061e65eee => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:02.686031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4cf87-8848-42a9-a5b6-2a7af22030fb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:02.687983 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-15c4cf87-8848-42a9-a5b6-2a7af22030fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:02.734016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a7c32e07-1636-405d-88de-3cc5ca90ba55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89734fb79d7b4f4ea8960fd5e2ce0fca'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:02.755934 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 849/1697] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:02 2022] DELETE /identity/v3/users/89734fb79d7b4f4ea8960fd5e2ce0fca => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:02.757615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c32e07-1636-405d-88de-3cc5ca90ba55 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:02.759514 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a7c32e07-1636-405d-88de-3cc5ca90ba55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:02.835553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4cf87-8848-42a9-a5b6-2a7af22030fb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:02.863832 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:02.893303 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c32e07-1636-405d-88de-3cc5ca90ba55 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:02.904402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527954e-4fc6-4e10-803a-bb9d172f248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:02.907674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527954e-4fc6-4e10-803a-bb9d172f248d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:02.908591 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527954e-4fc6-4e10-803a-bb9d172f248d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:02.909735 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527954e-4fc6-4e10-803a-bb9d172f248d admin admin] PATH_INFO: `/v3/projects/19f23046a3b641c9b1368964b30df39a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:02.913586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527954e-4fc6-4e10-803a-bb9d172f248d admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f23046a3b641c9b1368964b30df39a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:02.919663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527954e-4fc6-4e10-803a-bb9d172f248d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:02.931874 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34defed0-3887-4197-806e-16a75535e2c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:02.933792 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34defed0-3887-4197-806e-16a75535e2c5 service swift] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:02.934498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34defed0-3887-4197-806e-16a75535e2c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:02.935001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34defed0-3887-4197-806e-16a75535e2c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:02.940613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-34defed0-3887-4197-806e-16a75535e2c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:03.038764 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b527954e-4fc6-4e10-803a-bb9d172f248d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f23046a3b641c9b1368964b30df39a', 'request_id': 'req-b527954e-4fc6-4e10-803a-bb9d172f248d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:03.040658 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34defed0-3887-4197-806e-16a75535e2c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:03.042950 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34defed0-3887-4197-806e-16a75535e2c5 service swift] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:03.056191 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 849/1698] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:35:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:35:03.059491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604b708-d084-4ed5-8b1f-919b3bbcedec None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:03.059935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604b708-d084-4ed5-8b1f-919b3bbcedec None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:03.060319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604b708-d084-4ed5-8b1f-919b3bbcedec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:03.065810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b527954e-4fc6-4e10-803a-bb9d172f248d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f23046a3b641c9b1368964b30df39a', 'request_id': 'req-b527954e-4fc6-4e10-803a-bb9d172f248d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:03.083327 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b527954e-4fc6-4e10-803a-bb9d172f248d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f23046a3b641c9b1368964b30df39a', 'request_id': 'req-b527954e-4fc6-4e10-803a-bb9d172f248d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:03.090078 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9604b708-d084-4ed5-8b1f-919b3bbcedec None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:03.091380 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9604b708-d084-4ed5-8b1f-919b3bbcedec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:03.138573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b527954e-4fc6-4e10-803a-bb9d172f248d admin admin] The token cache is being invalidate because project 19f23046a3b641c9b1368964b30df39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:03.138873 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b527954e-4fc6-4e10-803a-bb9d172f248d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:03.139907 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b527954e-4fc6-4e10-803a-bb9d172f248d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:03.143463 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 850/1699] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:02 2022] DELETE /identity/v3/projects/19f23046a3b641c9b1368964b30df39a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:03.145590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8a9e6-54cc-4470-ad7b-f4d141cc4925 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:03.145888 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8a9e6-54cc-4470-ad7b-f4d141cc4925 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:03.146251 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8a9e6-54cc-4470-ad7b-f4d141cc4925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:03.225548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-43d8a9e6-54cc-4470-ad7b-f4d141cc4925 None None] MFA Rules not processed for user `21c54bf3ff584c709731d3624aa187a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:03.227231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-43d8a9e6-54cc-4470-ad7b-f4d141cc4925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:03.246816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 850/1700] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:03.248152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604b708-d084-4ed5-8b1f-919b3bbcedec None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:03.266907 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9604b708-d084-4ed5-8b1f-919b3bbcedec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:03.300303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604b708-d084-4ed5-8b1f-919b3bbcedec None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:03.316412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab1976-2a04-4566-bd1b-12e6b8126575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:03.317852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab1976-2a04-4566-bd1b-12e6b8126575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:03.318140 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab1976-2a04-4566-bd1b-12e6b8126575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:03.318738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab1976-2a04-4566-bd1b-12e6b8126575 admin admin] PATH_INFO: `/v3/projects/1efc14e43fe34e65bc315ba79ef7f209` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:03.321289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab1976-2a04-4566-bd1b-12e6b8126575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1efc14e43fe34e65bc315ba79ef7f209)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:03.323414 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab1976-2a04-4566-bd1b-12e6b8126575 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:03.360983 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:03.410853 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 851/1701] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:03.411867 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8a9e6-54cc-4470-ad7b-f4d141cc4925 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:03.413488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-43d8a9e6-54cc-4470-ad7b-f4d141cc4925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:03.437444 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8a9e6-54cc-4470-ad7b-f4d141cc4925 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:03.444206 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdf330-f4a1-4dfb-97e9-88e1e42a199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:03.450846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdf330-f4a1-4dfb-97e9-88e1e42a199f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:03.450846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdf330-f4a1-4dfb-97e9-88e1e42a199f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:03.450846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdf330-f4a1-4dfb-97e9-88e1e42a199f admin admin] PATH_INFO: `/v3/users/92bafc0c408c4165bfd620b025b9dcae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:03.453421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdf330-f4a1-4dfb-97e9-88e1e42a199f admin admin] RBAC: Authorizing `identity:delete_user(user_id=92bafc0c408c4165bfd620b025b9dcae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:03.463364 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bdf330-f4a1-4dfb-97e9-88e1e42a199f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:03.496805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0ab1976-2a04-4566-bd1b-12e6b8126575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1efc14e43fe34e65bc315ba79ef7f209', 'request_id': 'req-a0ab1976-2a04-4566-bd1b-12e6b8126575'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:03.505755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0ab1976-2a04-4566-bd1b-12e6b8126575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1efc14e43fe34e65bc315ba79ef7f209', 'request_id': 'req-a0ab1976-2a04-4566-bd1b-12e6b8126575'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:03.508339 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:03.514425 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0ab1976-2a04-4566-bd1b-12e6b8126575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1efc14e43fe34e65bc315ba79ef7f209', 'request_id': 'req-a0ab1976-2a04-4566-bd1b-12e6b8126575'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:03.543980 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0ab1976-2a04-4566-bd1b-12e6b8126575 admin admin] The token cache is being invalidate because project 1efc14e43fe34e65bc315ba79ef7f209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:03.545091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0ab1976-2a04-4566-bd1b-12e6b8126575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:03.547013 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0ab1976-2a04-4566-bd1b-12e6b8126575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:03.553843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 851/1702] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:03 2022] DELETE /identity/v3/projects/1efc14e43fe34e65bc315ba79ef7f209 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:03.554911 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab1976-2a04-4566-bd1b-12e6b8126575 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:03.563762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a0ab1976-2a04-4566-bd1b-12e6b8126575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:03.585560 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-00bdf330-f4a1-4dfb-97e9-88e1e42a199f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92bafc0c408c4165bfd620b025b9dcae'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:03.598135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-00bdf330-f4a1-4dfb-97e9-88e1e42a199f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92bafc0c408c4165bfd620b025b9dcae'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:03.599140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-00bdf330-f4a1-4dfb-97e9-88e1e42a199f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92bafc0c408c4165bfd620b025b9dcae'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:03.600071 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-00bdf330-f4a1-4dfb-97e9-88e1e42a199f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92bafc0c408c4165bfd620b025b9dcae'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:03.635510 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-00bdf330-f4a1-4dfb-97e9-88e1e42a199f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92bafc0c408c4165bfd620b025b9dcae'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:03.681082 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 852/1703] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:03 2022] DELETE /identity/v3/users/92bafc0c408c4165bfd620b025b9dcae => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:03.684821 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdf330-f4a1-4dfb-97e9-88e1e42a199f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:03.689048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-00bdf330-f4a1-4dfb-97e9-88e1e42a199f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:03.732286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab1976-2a04-4566-bd1b-12e6b8126575 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:03.880078 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa8f0b-c6af-4285-862c-5493391c66db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:03.881049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa8f0b-c6af-4285-862c-5493391c66db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:03.881470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa8f0b-c6af-4285-862c-5493391c66db admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:03.888033 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa8f0b-c6af-4285-862c-5493391c66db admin admin] PATH_INFO: `/v3/projects/806d5d9a9b914ef5b44c7693448eea53` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:03.891437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa8f0b-c6af-4285-862c-5493391c66db admin admin] RBAC: Authorizing `identity:delete_project(project_id=806d5d9a9b914ef5b44c7693448eea53)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:03.893661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa8f0b-c6af-4285-862c-5493391c66db admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:03.925770 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdf330-f4a1-4dfb-97e9-88e1e42a199f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:03.950771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6aec5-82d9-4075-af54-450353b6600e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:03.951469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6aec5-82d9-4075-af54-450353b6600e service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:03.951759 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6aec5-82d9-4075-af54-450353b6600e service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:03.952045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6aec5-82d9-4075-af54-450353b6600e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:03.981025 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-07e6aec5-82d9-4075-af54-450353b6600e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:04.024433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a8fa8f0b-c6af-4285-862c-5493391c66db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '806d5d9a9b914ef5b44c7693448eea53', 'request_id': 'req-a8fa8f0b-c6af-4285-862c-5493391c66db'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:04.031162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6aec5-82d9-4075-af54-450353b6600e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:04.032755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6aec5-82d9-4075-af54-450353b6600e service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:04.039240 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a8fa8f0b-c6af-4285-862c-5493391c66db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '806d5d9a9b914ef5b44c7693448eea53', 'request_id': 'req-a8fa8f0b-c6af-4285-862c-5493391c66db'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:04.056166 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a8fa8f0b-c6af-4285-862c-5493391c66db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '806d5d9a9b914ef5b44c7693448eea53', 'request_id': 'req-a8fa8f0b-c6af-4285-862c-5493391c66db'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:04.086865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 853/1704] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:04.094443 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a8fa8f0b-c6af-4285-862c-5493391c66db admin admin] The token cache is being invalidate because project 806d5d9a9b914ef5b44c7693448eea53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:04.094663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6aec5-82d9-4075-af54-450353b6600e service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:04.094774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a8fa8f0b-c6af-4285-862c-5493391c66db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:04.097616 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a8fa8f0b-c6af-4285-862c-5493391c66db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:04.100388 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 852/1705] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:03 2022] DELETE /identity/v3/projects/806d5d9a9b914ef5b44c7693448eea53 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:04.104941 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-07e6aec5-82d9-4075-af54-450353b6600e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:04.105322 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16444a-7c9a-4d8e-b240-7dfb0adab0cc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:04.107779 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16444a-7c9a-4d8e-b240-7dfb0adab0cc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:04.108172 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16444a-7c9a-4d8e-b240-7dfb0adab0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:04.152407 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3f16444a-7c9a-4d8e-b240-7dfb0adab0cc None None] MFA Rules not processed for user `21c54bf3ff584c709731d3624aa187a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:04.156105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3f16444a-7c9a-4d8e-b240-7dfb0adab0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:04.166655 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6aec5-82d9-4075-af54-450353b6600e service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:04.202376 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:04.341953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4d9d0-e7e9-4652-bb87-fdee7409e54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:04.342864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4d9d0-e7e9-4652-bb87-fdee7409e54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:04.345106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4d9d0-e7e9-4652-bb87-fdee7409e54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:04.345445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4d9d0-e7e9-4652-bb87-fdee7409e54e admin admin] PATH_INFO: `/v3/projects/4e57630f500748908317f3bfcebde4cc` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:04.350405 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4d9d0-e7e9-4652-bb87-fdee7409e54e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e57630f500748908317f3bfcebde4cc)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:04.352574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4d9d0-e7e9-4652-bb87-fdee7409e54e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:04.372530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:04.386041 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 853/1706] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:04.405743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236b3f5-da13-46b8-a35e-5d6d13926520 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:04.406438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236b3f5-da13-46b8-a35e-5d6d13926520 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:04.406891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236b3f5-da13-46b8-a35e-5d6d13926520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:04.468172 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5236b3f5-da13-46b8-a35e-5d6d13926520 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:04.472278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5236b3f5-da13-46b8-a35e-5d6d13926520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:04.474517 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-81d4d9d0-e7e9-4652-bb87-fdee7409e54e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e57630f500748908317f3bfcebde4cc', 'request_id': 'req-81d4d9d0-e7e9-4652-bb87-fdee7409e54e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:04.494544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-81d4d9d0-e7e9-4652-bb87-fdee7409e54e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e57630f500748908317f3bfcebde4cc', 'request_id': 'req-81d4d9d0-e7e9-4652-bb87-fdee7409e54e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:04.505404 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-81d4d9d0-e7e9-4652-bb87-fdee7409e54e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e57630f500748908317f3bfcebde4cc', 'request_id': 'req-81d4d9d0-e7e9-4652-bb87-fdee7409e54e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:04.530029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-81d4d9d0-e7e9-4652-bb87-fdee7409e54e admin admin] The token cache is being invalidate because project 4e57630f500748908317f3bfcebde4cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:04.530587 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-81d4d9d0-e7e9-4652-bb87-fdee7409e54e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:04.531548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-81d4d9d0-e7e9-4652-bb87-fdee7409e54e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:04.533395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 854/1707] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:04 2022] DELETE /identity/v3/projects/4e57630f500748908317f3bfcebde4cc => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:04.536087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a1723-ad6e-4069-8404-6a5c716c13c2 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:04.545914 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a1723-ad6e-4069-8404-6a5c716c13c2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:04.546456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a1723-ad6e-4069-8404-6a5c716c13c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:04.591793 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-824a1723-ad6e-4069-8404-6a5c716c13c2 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:04.593504 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-824a1723-ad6e-4069-8404-6a5c716c13c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:04.649562 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 854/1708] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:04.649562 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450aee9-6f68-4c2c-ad44-5e250134109d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:04.649562 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450aee9-6f68-4c2c-ad44-5e250134109d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:04.649562 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450aee9-6f68-4c2c-ad44-5e250134109d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:04.690661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9450aee9-6f68-4c2c-ad44-5e250134109d None None] MFA Rules not processed for user `46c398ec4dcc438895f054f616fc9e41`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:04.702873 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9450aee9-6f68-4c2c-ad44-5e250134109d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:04.757453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 855/1709] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:04.758451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a1723-ad6e-4069-8404-6a5c716c13c2 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:04.766441 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-824a1723-ad6e-4069-8404-6a5c716c13c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:04.803515 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a1723-ad6e-4069-8404-6a5c716c13c2 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:04.827593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cf50a-f0d9-42dd-8baa-457c3db39f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:04.830861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cf50a-f0d9-42dd-8baa-457c3db39f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:04.832281 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cf50a-f0d9-42dd-8baa-457c3db39f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:04.832590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cf50a-f0d9-42dd-8baa-457c3db39f14 admin admin] PATH_INFO: `/v3/users/bd1d5a4ca2e3438fa01f4075cd654147` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:04.836099 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cf50a-f0d9-42dd-8baa-457c3db39f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd1d5a4ca2e3438fa01f4075cd654147)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:04.857858 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cf50a-f0d9-42dd-8baa-457c3db39f14 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:04.889122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 855/1710] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Jun 15 00:35:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:04.890330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450aee9-6f68-4c2c-ad44-5e250134109d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:04.891794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9450aee9-6f68-4c2c-ad44-5e250134109d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:04.919015 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450aee9-6f68-4c2c-ad44-5e250134109d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:04.925707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fb296-2663-4362-a4e6-f6092b9e76ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:04.927082 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb296-2663-4362-a4e6-f6092b9e76ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:04.927999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb296-2663-4362-a4e6-f6092b9e76ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:04.928384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb296-2663-4362-a4e6-f6092b9e76ef admin admin] PATH_INFO: `/v3/projects/6903ec1b202e4d4d9e5cb0a651197bc9` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:04.929983 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fb296-2663-4362-a4e6-f6092b9e76ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=6903ec1b202e4d4d9e5cb0a651197bc9)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:04.937720 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fb296-2663-4362-a4e6-f6092b9e76ef admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:05.002987 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-398cf50a-f0d9-42dd-8baa-457c3db39f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd1d5a4ca2e3438fa01f4075cd654147'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:05.019982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-398cf50a-f0d9-42dd-8baa-457c3db39f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd1d5a4ca2e3438fa01f4075cd654147'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:05.021000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-398cf50a-f0d9-42dd-8baa-457c3db39f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd1d5a4ca2e3438fa01f4075cd654147'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:05.021717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-398cf50a-f0d9-42dd-8baa-457c3db39f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd1d5a4ca2e3438fa01f4075cd654147'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:05.023434 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-861fb296-2663-4362-a4e6-f6092b9e76ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6903ec1b202e4d4d9e5cb0a651197bc9', 'request_id': 'req-861fb296-2663-4362-a4e6-f6092b9e76ef'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:05.033796 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-861fb296-2663-4362-a4e6-f6092b9e76ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6903ec1b202e4d4d9e5cb0a651197bc9', 'request_id': 'req-861fb296-2663-4362-a4e6-f6092b9e76ef'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:05.041771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-398cf50a-f0d9-42dd-8baa-457c3db39f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd1d5a4ca2e3438fa01f4075cd654147'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:05.050578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-861fb296-2663-4362-a4e6-f6092b9e76ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6903ec1b202e4d4d9e5cb0a651197bc9', 'request_id': 'req-861fb296-2663-4362-a4e6-f6092b9e76ef'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:05.068491 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 856/1711] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:04 2022] DELETE /identity/v3/users/bd1d5a4ca2e3438fa01f4075cd654147 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:05.072265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cf50a-f0d9-42dd-8baa-457c3db39f14 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:05.074556 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-861fb296-2663-4362-a4e6-f6092b9e76ef admin admin] The token cache is being invalidate because project 6903ec1b202e4d4d9e5cb0a651197bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:05.075735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-861fb296-2663-4362-a4e6-f6092b9e76ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:05.075835 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-398cf50a-f0d9-42dd-8baa-457c3db39f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:05.076870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-861fb296-2663-4362-a4e6-f6092b9e76ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:05.080245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 856/1712] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:04 2022] DELETE /identity/v3/projects/6903ec1b202e4d4d9e5cb0a651197bc9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:05.082574 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b674ece-e8cf-49f2-abad-5b83845640f7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:05.083333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b674ece-e8cf-49f2-abad-5b83845640f7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:05.083977 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b674ece-e8cf-49f2-abad-5b83845640f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:05.093906 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:05.116980 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2b674ece-e8cf-49f2-abad-5b83845640f7 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:05.123258 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2b674ece-e8cf-49f2-abad-5b83845640f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:05.123465 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:05.236226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 857/1713] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:05.239311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa1e35-e4e5-4e34-9d81-a15e04376d60 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:05.239932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa1e35-e4e5-4e34-9d81-a15e04376d60 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:05.240561 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa1e35-e4e5-4e34-9d81-a15e04376d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:05.263826 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e3fa1e35-e4e5-4e34-9d81-a15e04376d60 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:05.265449 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e3fa1e35-e4e5-4e34-9d81-a15e04376d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:05.274923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 858/1714] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:05.276354 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc5f92-b0a6-4354-a131-9a67c3ff9272 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:05.276645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc5f92-b0a6-4354-a131-9a67c3ff9272 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:05.276920 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc5f92-b0a6-4354-a131-9a67c3ff9272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:05.280058 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cf50a-f0d9-42dd-8baa-457c3db39f14 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:05.288794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad190b92-0ff1-4094-87eb-17b8a98f2652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:05.289715 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190b92-0ff1-4094-87eb-17b8a98f2652 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:05.290720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190b92-0ff1-4094-87eb-17b8a98f2652 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:05.291236 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190b92-0ff1-4094-87eb-17b8a98f2652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:05.294019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ad190b92-0ff1-4094-87eb-17b8a98f2652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:05.318280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d0fc5f92-b0a6-4354-a131-9a67c3ff9272 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:05.322197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d0fc5f92-b0a6-4354-a131-9a67c3ff9272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:05.344946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 859/1715] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:05.347503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc5f92-b0a6-4354-a131-9a67c3ff9272 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:05.349907 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d0fc5f92-b0a6-4354-a131-9a67c3ff9272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:05.372664 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad190b92-0ff1-4094-87eb-17b8a98f2652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:05.375933 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad190b92-0ff1-4094-87eb-17b8a98f2652 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:05.394533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 857/1716] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:05.396484 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4bf53-a26a-4f07-8a54-1261e41fa2a8 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:05.397057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4bf53-a26a-4f07-8a54-1261e41fa2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:05.397526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4bf53-a26a-4f07-8a54-1261e41fa2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:05.420057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-cdd4bf53-a26a-4f07-8a54-1261e41fa2a8 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:05.422536 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-cdd4bf53-a26a-4f07-8a54-1261e41fa2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:05.438367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 858/1717] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:05.440086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89d541-3e1c-41c8-b53d-52b62771649e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:05.440603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89d541-3e1c-41c8-b53d-52b62771649e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:05.441135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89d541-3e1c-41c8-b53d-52b62771649e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:05.471745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-cb89d541-3e1c-41c8-b53d-52b62771649e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:05.472963 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-cb89d541-3e1c-41c8-b53d-52b62771649e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:05.477899 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc5f92-b0a6-4354-a131-9a67c3ff9272 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:05.485990 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 859/1718] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:05.486858 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89d541-3e1c-41c8-b53d-52b62771649e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:05.490852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c94ec-266d-4d0b-ace7-ba9a700f5001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:05.491930 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c94ec-266d-4d0b-ace7-ba9a700f5001 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:05.492274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c94ec-266d-4d0b-ace7-ba9a700f5001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:05.492724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c94ec-266d-4d0b-ace7-ba9a700f5001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:05.494601 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-cb89d541-3e1c-41c8-b53d-52b62771649e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:05.495111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-395c94ec-266d-4d0b-ace7-ba9a700f5001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:05.509680 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c94ec-266d-4d0b-ace7-ba9a700f5001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:05.512995 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c94ec-266d-4d0b-ace7-ba9a700f5001 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:05.515395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89d541-3e1c-41c8-b53d-52b62771649e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:05.523195 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:05.524397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:05.525162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:05.527205 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac admin admin] PATH_INFO: `/v3/projects/7e81c359988f4cb8b315375e046a252d` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:05.529001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e81c359988f4cb8b315375e046a252d)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:05.532517 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:05.544216 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 860/1719] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:05.545841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39767ffd-203b-43e6-962a-7986b1ea6455 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:05.546137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39767ffd-203b-43e6-962a-7986b1ea6455 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:05.546422 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39767ffd-203b-43e6-962a-7986b1ea6455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:05.567170 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-39767ffd-203b-43e6-962a-7986b1ea6455 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:05.568609 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-39767ffd-203b-43e6-962a-7986b1ea6455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:05.578718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 861/1720] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:05.579767 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39767ffd-203b-43e6-962a-7986b1ea6455 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:05.592088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39767ffd-203b-43e6-962a-7986b1ea6455 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:05.597834 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8934c-e176-41d6-85e5-07786ab04189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:05.598547 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8934c-e176-41d6-85e5-07786ab04189 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:05.598845 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8934c-e176-41d6-85e5-07786ab04189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:05.599116 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8934c-e176-41d6-85e5-07786ab04189 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:05.600155 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8934c-e176-41d6-85e5-07786ab04189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:05.600476 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8934c-e176-41d6-85e5-07786ab04189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:05.603305 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8934c-e176-41d6-85e5-07786ab04189 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:05.624616 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 862/1721] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:05.632970 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8934c-e176-41d6-85e5-07786ab04189 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:05.668357 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8934c-e176-41d6-85e5-07786ab04189 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:05.676139 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e81c359988f4cb8b315375e046a252d', 'request_id': 'req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:05.698934 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e81c359988f4cb8b315375e046a252d', 'request_id': 'req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:05.718588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e81c359988f4cb8b315375e046a252d', 'request_id': 'req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:05.752971 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac admin admin] The token cache is being invalidate because project 7e81c359988f4cb8b315375e046a252d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:05.753275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:05.758403 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:05.766261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 860/1722] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:05 2022] DELETE /identity/v3/projects/7e81c359988f4cb8b315375e046a252d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:05.774922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:05.779311 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:05.863010 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:05.934813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74aab6-fc6e-430b-8b7c-57cb33e9c1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:05.936827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74aab6-fc6e-430b-8b7c-57cb33e9c1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:05.937825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74aab6-fc6e-430b-8b7c-57cb33e9c1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:05.938558 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74aab6-fc6e-430b-8b7c-57cb33e9c1e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:05.939978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74aab6-fc6e-430b-8b7c-57cb33e9c1e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:05.940502 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74aab6-fc6e-430b-8b7c-57cb33e9c1e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:05.943628 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74aab6-fc6e-430b-8b7c-57cb33e9c1e4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:05.977924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 863/1723] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:05.979521 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a400e0-cfef-4a87-ba17-dad33143e388 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:05.983620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a400e0-cfef-4a87-ba17-dad33143e388 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:05.984237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a400e0-cfef-4a87-ba17-dad33143e388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:06.015249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:06.038491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a1a400e0-cfef-4a87-ba17-dad33143e388 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:06.039815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a1a400e0-cfef-4a87-ba17-dad33143e388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:06.069011 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfa3a6-ef1e-44b1-b6f4-3a1a3beb89ac admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:06.078632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340cae1-b517-42e2-8467-19cc422b9a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:06.079505 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340cae1-b517-42e2-8467-19cc422b9a63 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:06.079963 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340cae1-b517-42e2-8467-19cc422b9a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:06.080156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 864/1724] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:06.080833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340cae1-b517-42e2-8467-19cc422b9a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:06.081054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a400e0-cfef-4a87-ba17-dad33143e388 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:06.085618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a1a400e0-cfef-4a87-ba17-dad33143e388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:06.086920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2340cae1-b517-42e2-8467-19cc422b9a63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:06.129847 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a400e0-cfef-4a87-ba17-dad33143e388 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:06.135433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340cae1-b517-42e2-8467-19cc422b9a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:06.137853 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340cae1-b517-42e2-8467-19cc422b9a63 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:06.142694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511b41b-2354-41d6-ab23-bc60bbd5ed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:06.143411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511b41b-2354-41d6-ab23-bc60bbd5ed06 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:06.143703 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511b41b-2354-41d6-ab23-bc60bbd5ed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:06.144016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511b41b-2354-41d6-ab23-bc60bbd5ed06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:06.145289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511b41b-2354-41d6-ab23-bc60bbd5ed06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:06.145652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511b41b-2354-41d6-ab23-bc60bbd5ed06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:06.152083 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511b41b-2354-41d6-ab23-bc60bbd5ed06 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:06.167206 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 861/1725] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:06.168285 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340cae1-b517-42e2-8467-19cc422b9a63 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:06.171872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2340cae1-b517-42e2-8467-19cc422b9a63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:06.197870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 865/1726] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:06.199495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039fe78-f5f6-4a08-9a3a-814bc142bf72 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:06.199800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039fe78-f5f6-4a08-9a3a-814bc142bf72 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:06.200108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039fe78-f5f6-4a08-9a3a-814bc142bf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:06.200924 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340cae1-b517-42e2-8467-19cc422b9a63 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:06.220543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134544d4-2808-4c09-9981-9947abaf5739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:06.221630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134544d4-2808-4c09-9981-9947abaf5739 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:06.222543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134544d4-2808-4c09-9981-9947abaf5739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:06.223046 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134544d4-2808-4c09-9981-9947abaf5739 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:06.226182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134544d4-2808-4c09-9981-9947abaf5739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:06.230280 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134544d4-2808-4c09-9981-9947abaf5739 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:06.277310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b039fe78-f5f6-4a08-9a3a-814bc142bf72 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:06.280850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b039fe78-f5f6-4a08-9a3a-814bc142bf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:06.299620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 862/1727] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:06 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:06.300639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134544d4-2808-4c09-9981-9947abaf5739 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:06.304266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-134544d4-2808-4c09-9981-9947abaf5739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:06.309666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 866/1728] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:06.310691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039fe78-f5f6-4a08-9a3a-814bc142bf72 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:06.326854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039fe78-f5f6-4a08-9a3a-814bc142bf72 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:06.496678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134544d4-2808-4c09-9981-9947abaf5739 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:06.497040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1df49-83eb-45e6-aa1a-0b225d509b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:06.497712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1df49-83eb-45e6-aa1a-0b225d509b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:06.498005 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1df49-83eb-45e6-aa1a-0b225d509b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:06.498438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1df49-83eb-45e6-aa1a-0b225d509b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:06.499068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1df49-83eb-45e6-aa1a-0b225d509b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:06.499387 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1df49-83eb-45e6-aa1a-0b225d509b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:06.507805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1df49-83eb-45e6-aa1a-0b225d509b45 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:06.508702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab27bb-1019-4394-9ac1-99cbca0f7399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:06.509651 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab27bb-1019-4394-9ac1-99cbca0f7399 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:06.510381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab27bb-1019-4394-9ac1-99cbca0f7399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:06.511186 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab27bb-1019-4394-9ac1-99cbca0f7399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:06.512130 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab27bb-1019-4394-9ac1-99cbca0f7399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:06.515942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab27bb-1019-4394-9ac1-99cbca0f7399 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:06.552733 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 867/1729] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:06.553954 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1df49-83eb-45e6-aa1a-0b225d509b45 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:06.571553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 863/1730] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:06 2022] POST /identity/v3/projects => generated 355 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:06.574777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab27bb-1019-4394-9ac1-99cbca0f7399 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:06.594155 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1df49-83eb-45e6-aa1a-0b225d509b45 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:06.793039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab27bb-1019-4394-9ac1-99cbca0f7399 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:06.798619 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcb4fd-0d42-4f80-b4e0-abb7872a5ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:06.802718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afed51e-50a0-4fd0-8701-56023f23680b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:06.803197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb4fd-0d42-4f80-b4e0-abb7872a5ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:06.804155 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed51e-50a0-4fd0-8701-56023f23680b admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:06.804874 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb4fd-0d42-4f80-b4e0-abb7872a5ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:06.805883 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcb4fd-0d42-4f80-b4e0-abb7872a5ab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:06.806287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed51e-50a0-4fd0-8701-56023f23680b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:06.806729 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed51e-50a0-4fd0-8701-56023f23680b admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:06.807621 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afed51e-50a0-4fd0-8701-56023f23680b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:06.808973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcb4fd-0d42-4f80-b4e0-abb7872a5ab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:06.811123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afed51e-50a0-4fd0-8701-56023f23680b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:06.813007 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcb4fd-0d42-4f80-b4e0-abb7872a5ab8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:06.868603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 864/1731] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:06 2022] POST /identity/v3/users => generated 282 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:06.870584 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c10e0d-49a9-44a0-9201-ef617677b48c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:06.870838 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c10e0d-49a9-44a0-9201-ef617677b48c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:06.871119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c10e0d-49a9-44a0-9201-ef617677b48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:06.896410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-16c10e0d-49a9-44a0-9201-ef617677b48c None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:06.898080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-16c10e0d-49a9-44a0-9201-ef617677b48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:06.899115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 868/1732] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:06 2022] POST /identity/v3/projects => generated 375 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:06.904167 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960a478-2e32-498b-a9e2-8b01992ec263 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:06.905438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960a478-2e32-498b-a9e2-8b01992ec263 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:06.905673 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960a478-2e32-498b-a9e2-8b01992ec263 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:06.911319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 869/1733] 10.222.0.36 () {54 vars in 912 bytes} [Wed Jun 15 00:35:06 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:35:06.912578 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:06.918397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960a478-2e32-498b-a9e2-8b01992ec263 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:07.011570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 865/1734] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:07.011570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c10e0d-49a9-44a0-9201-ef617677b48c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:07.021380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c10e0d-49a9-44a0-9201-ef617677b48c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:07.028871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f73b9-4844-412a-ae0a-ab6645e327ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:07.029616 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f73b9-4844-412a-ae0a-ab6645e327ad admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:07.030063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f73b9-4844-412a-ae0a-ab6645e327ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:07.030347 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f73b9-4844-412a-ae0a-ab6645e327ad admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:07.031061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f73b9-4844-412a-ae0a-ab6645e327ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:07.034801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f73b9-4844-412a-ae0a-ab6645e327ad admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:07.078037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 866/1735] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:07 2022] POST /identity/v3/users => generated 278 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:07.078037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f73b9-4844-412a-ae0a-ab6645e327ad admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:07.089906 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f73b9-4844-412a-ae0a-ab6645e327ad admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:07.096094 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220181b-062f-4fa4-9c12-26caafdc870d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:07.097009 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220181b-062f-4fa4-9c12-26caafdc870d admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:07.097224 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220181b-062f-4fa4-9c12-26caafdc870d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:07.097527 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220181b-062f-4fa4-9c12-26caafdc870d admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:07.098351 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220181b-062f-4fa4-9c12-26caafdc870d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:07.100581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220181b-062f-4fa4-9c12-26caafdc870d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:07.113148 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960a478-2e32-498b-a9e2-8b01992ec263 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:07.115819 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 867/1736] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:07.116746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220181b-062f-4fa4-9c12-26caafdc870d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:07.123899 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefbd6a-871e-4ec0-b40f-225a578d6a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:07.124704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefbd6a-871e-4ec0-b40f-225a578d6a1a admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:07.128801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220181b-062f-4fa4-9c12-26caafdc870d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:07.129378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefbd6a-871e-4ec0-b40f-225a578d6a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:07.129864 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefbd6a-871e-4ec0-b40f-225a578d6a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:07.130639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefbd6a-871e-4ec0-b40f-225a578d6a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:07.132737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefbd6a-871e-4ec0-b40f-225a578d6a1a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:07.134521 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e15cc-f7e0-4b20-9d11-5b40abf639a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:07.135281 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e15cc-f7e0-4b20-9d11-5b40abf639a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:07.135567 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e15cc-f7e0-4b20-9d11-5b40abf639a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:07.136142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e15cc-f7e0-4b20-9d11-5b40abf639a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:07.136620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e15cc-f7e0-4b20-9d11-5b40abf639a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:07.138818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:07.138947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e15cc-f7e0-4b20-9d11-5b40abf639a7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:07.173696 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 868/1737] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:07 2022] POST /identity/v3/users => generated 288 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:07.175579 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e15cc-f7e0-4b20-9d11-5b40abf639a7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:07.178456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d83e15cc-f7e0-4b20-9d11-5b40abf639a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:07.199041 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 870/1738] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:06 2022] POST /identity/v3/projects => generated 377 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:07.199041 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81d465-fde3-429e-ac85-c3ad9154ae91 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:07.199041 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81d465-fde3-429e-ac85-c3ad9154ae91 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:07.199041 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81d465-fde3-429e-ac85-c3ad9154ae91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:07.218509 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e15cc-f7e0-4b20-9d11-5b40abf639a7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:07.240692 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ae81d465-fde3-429e-ac85-c3ad9154ae91 None None] MFA Rules not processed for user `46c398ec4dcc438895f054f616fc9e41`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:07.246050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ae81d465-fde3-429e-ac85-c3ad9154ae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:07.384814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 871/1739] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 15 00:35:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:07.392262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81d465-fde3-429e-ac85-c3ad9154ae91 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:07.457859 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc07bc7-ba47-4e95-882d-ae4a1114f450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:07.459041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc07bc7-ba47-4e95-882d-ae4a1114f450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:07.459534 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc07bc7-ba47-4e95-882d-ae4a1114f450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:07.460025 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc07bc7-ba47-4e95-882d-ae4a1114f450 admin admin] PATH_INFO: `/v3/projects/bd45818aa5d34673ad78b39d8fcdfd79` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:07.467776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc07bc7-ba47-4e95-882d-ae4a1114f450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd45818aa5d34673ad78b39d8fcdfd79)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:07.470071 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc07bc7-ba47-4e95-882d-ae4a1114f450 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:07.602554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81d465-fde3-429e-ac85-c3ad9154ae91 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:07.633297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ffc07bc7-ba47-4e95-882d-ae4a1114f450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd45818aa5d34673ad78b39d8fcdfd79', 'request_id': 'req-ffc07bc7-ba47-4e95-882d-ae4a1114f450'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:07.649779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ffc07bc7-ba47-4e95-882d-ae4a1114f450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd45818aa5d34673ad78b39d8fcdfd79', 'request_id': 'req-ffc07bc7-ba47-4e95-882d-ae4a1114f450'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:07.674297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ffc07bc7-ba47-4e95-882d-ae4a1114f450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd45818aa5d34673ad78b39d8fcdfd79', 'request_id': 'req-ffc07bc7-ba47-4e95-882d-ae4a1114f450'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:07.680734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:07.702269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ffc07bc7-ba47-4e95-882d-ae4a1114f450 admin admin] The token cache is being invalidate because project bd45818aa5d34673ad78b39d8fcdfd79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:07.703168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ffc07bc7-ba47-4e95-882d-ae4a1114f450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:07.705317 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ffc07bc7-ba47-4e95-882d-ae4a1114f450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:07.709778 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 869/1740] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:07 2022] DELETE /identity/v3/projects/bd45818aa5d34673ad78b39d8fcdfd79 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:07.711091 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc07bc7-ba47-4e95-882d-ae4a1114f450 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:07.718116 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ffc07bc7-ba47-4e95-882d-ae4a1114f450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:07.767735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741c060-f3b7-4a07-bff6-035b30a6c505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:07.768562 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741c060-f3b7-4a07-bff6-035b30a6c505 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:07.768847 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741c060-f3b7-4a07-bff6-035b30a6c505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:07.769153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741c060-f3b7-4a07-bff6-035b30a6c505 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:07.769953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741c060-f3b7-4a07-bff6-035b30a6c505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:07.770282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741c060-f3b7-4a07-bff6-035b30a6c505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:07.775238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741c060-f3b7-4a07-bff6-035b30a6c505 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:07.814237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 872/1741] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:07.815174 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741c060-f3b7-4a07-bff6-035b30a6c505 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:07.818639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f741c060-f3b7-4a07-bff6-035b30a6c505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:07.845919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741c060-f3b7-4a07-bff6-035b30a6c505 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:07.846968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc07bc7-ba47-4e95-882d-ae4a1114f450 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:07.851454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555f782-1149-4343-8dba-3d3b7bc8f1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:07.852333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555f782-1149-4343-8dba-3d3b7bc8f1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:07.852776 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555f782-1149-4343-8dba-3d3b7bc8f1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:07.853189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555f782-1149-4343-8dba-3d3b7bc8f1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:07.854125 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555f782-1149-4343-8dba-3d3b7bc8f1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:07.855934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555f782-1149-4343-8dba-3d3b7bc8f1a7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:07.869436 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cc4c0-d193-4dcc-bdc9-5f9aed94d90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:07.869436 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cc4c0-d193-4dcc-bdc9-5f9aed94d90f admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:07.869436 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cc4c0-d193-4dcc-bdc9-5f9aed94d90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:07.869436 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cc4c0-d193-4dcc-bdc9-5f9aed94d90f admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:07.870853 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3cc4c0-d193-4dcc-bdc9-5f9aed94d90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:07.871824 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 873/1742] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:07.872616 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3cc4c0-d193-4dcc-bdc9-5f9aed94d90f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:07.872796 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555f782-1149-4343-8dba-3d3b7bc8f1a7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:07.874704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b555f782-1149-4343-8dba-3d3b7bc8f1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:07.892317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555f782-1149-4343-8dba-3d3b7bc8f1a7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:07.898020 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 870/1743] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:07.898020 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cc4c0-d193-4dcc-bdc9-5f9aed94d90f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:07.904076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ac3cc4c0-d193-4dcc-bdc9-5f9aed94d90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:07.905996 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6135bf-a0c0-4d89-a621-226d2c5251f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:07.906692 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6135bf-a0c0-4d89-a621-226d2c5251f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:07.906933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6135bf-a0c0-4d89-a621-226d2c5251f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:07.907234 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6135bf-a0c0-4d89-a621-226d2c5251f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:07.907956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6135bf-a0c0-4d89-a621-226d2c5251f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:07.909576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6135bf-a0c0-4d89-a621-226d2c5251f1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:07.935163 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 874/1744] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:07.935163 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6135bf-a0c0-4d89-a621-226d2c5251f1 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:07.935432 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cc4c0-d193-4dcc-bdc9-5f9aed94d90f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:07.943136 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7e6135bf-a0c0-4d89-a621-226d2c5251f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:07.958207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3883fb1-195b-42cf-878f-b0069e85817c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:07.958994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3883fb1-195b-42cf-878f-b0069e85817c admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:07.959560 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3883fb1-195b-42cf-878f-b0069e85817c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:07.959926 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3883fb1-195b-42cf-878f-b0069e85817c admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:07.960905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3883fb1-195b-42cf-878f-b0069e85817c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:07.970354 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3883fb1-195b-42cf-878f-b0069e85817c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:07.977929 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6135bf-a0c0-4d89-a621-226d2c5251f1 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:07.983277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7b0a6-ffff-44cb-9919-be09c563c028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:07.984198 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7b0a6-ffff-44cb-9919-be09c563c028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:07.984485 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7b0a6-ffff-44cb-9919-be09c563c028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:07.987557 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7b0a6-ffff-44cb-9919-be09c563c028 admin admin] PATH_INFO: `/v3/users/9e17daca875048eb964800f5daa57445` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:07.991808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7b0a6-ffff-44cb-9919-be09c563c028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e17daca875048eb964800f5daa57445)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:07.996515 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7b0a6-ffff-44cb-9919-be09c563c028 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:08.006622 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:08.010563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 871/1745] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:07 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:08.011634 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3883fb1-195b-42cf-878f-b0069e85817c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:08.014707 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b3883fb1-195b-42cf-878f-b0069e85817c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:08.081676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-adb7b0a6-ffff-44cb-9919-be09c563c028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e17daca875048eb964800f5daa57445'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:08.093524 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-adb7b0a6-ffff-44cb-9919-be09c563c028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e17daca875048eb964800f5daa57445'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:08.094494 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-adb7b0a6-ffff-44cb-9919-be09c563c028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e17daca875048eb964800f5daa57445'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:08.095365 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-adb7b0a6-ffff-44cb-9919-be09c563c028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e17daca875048eb964800f5daa57445'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:08.111066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3883fb1-195b-42cf-878f-b0069e85817c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:08.113701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-adb7b0a6-ffff-44cb-9919-be09c563c028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e17daca875048eb964800f5daa57445'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:08.115483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f250fe1-1e5b-4c36-95c7-b2f9900c3f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:08.116898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f250fe1-1e5b-4c36-95c7-b2f9900c3f82 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:08.121231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f250fe1-1e5b-4c36-95c7-b2f9900c3f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:08.121678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f250fe1-1e5b-4c36-95c7-b2f9900c3f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:08.124650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7f250fe1-1e5b-4c36-95c7-b2f9900c3f82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:08.133156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 875/1746] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:07 2022] DELETE /identity/v3/users/9e17daca875048eb964800f5daa57445 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:08.138172 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783a4f8-da47-4ec0-bfdd-2de81a9274e1 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:08.138476 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783a4f8-da47-4ec0-bfdd-2de81a9274e1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:08.138758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783a4f8-da47-4ec0-bfdd-2de81a9274e1 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:08.141808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 876/1747] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 15 00:35:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:35:08.142905 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783a4f8-da47-4ec0-bfdd-2de81a9274e1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:08.148587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7783a4f8-da47-4ec0-bfdd-2de81a9274e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:08.149399 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f250fe1-1e5b-4c36-95c7-b2f9900c3f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:08.151397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f250fe1-1e5b-4c36-95c7-b2f9900c3f82 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:08.178230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 872/1748] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:08.179152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f250fe1-1e5b-4c36-95c7-b2f9900c3f82 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:08.180554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7f250fe1-1e5b-4c36-95c7-b2f9900c3f82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:08.216337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f250fe1-1e5b-4c36-95c7-b2f9900c3f82 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:08.254164 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783a4f8-da47-4ec0-bfdd-2de81a9274e1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:08.259079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c48df-0cc2-4218-a82b-fe55764150ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:08.260328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c48df-0cc2-4218-a82b-fe55764150ed admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:08.260622 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c48df-0cc2-4218-a82b-fe55764150ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:08.261027 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c48df-0cc2-4218-a82b-fe55764150ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:08.262567 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c48df-0cc2-4218-a82b-fe55764150ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:08.264722 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c48df-0cc2-4218-a82b-fe55764150ed admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:08.306702 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 877/1749] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:08 2022] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:08.316659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c48df-0cc2-4218-a82b-fe55764150ed admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:08.318739 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bb6c48df-0cc2-4218-a82b-fe55764150ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:08.370846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198e982-3d10-404e-952e-a6e415b221c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:08.372127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198e982-3d10-404e-952e-a6e415b221c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:08.372612 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198e982-3d10-404e-952e-a6e415b221c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:08.373067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198e982-3d10-404e-952e-a6e415b221c1 admin admin] PATH_INFO: `/v3/projects/028114068076491abca6ac3655ac950c/users/aa07c20aa2de4d21bb6c09465fc2b5b6/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:08.404631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198e982-3d10-404e-952e-a6e415b221c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028114068076491abca6ac3655ac950c, user_id=aa07c20aa2de4d21bb6c09465fc2b5b6, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:08.409695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198e982-3d10-404e-952e-a6e415b221c1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:08.425108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c48df-0cc2-4218-a82b-fe55764150ed admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:08.437538 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:08.443024 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e96853-a12b-43ec-bc6e-0ffa2103ec79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:08.443853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e96853-a12b-43ec-bc6e-0ffa2103ec79 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:08.444344 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e96853-a12b-43ec-bc6e-0ffa2103ec79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:08.444643 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e96853-a12b-43ec-bc6e-0ffa2103ec79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:08.445685 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e96853-a12b-43ec-bc6e-0ffa2103ec79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:08.447412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 873/1750] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:08 2022] PUT /identity/v3/projects/028114068076491abca6ac3655ac950c/users/aa07c20aa2de4d21bb6c09465fc2b5b6/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:08.448477 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e96853-a12b-43ec-bc6e-0ffa2103ec79 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:08.462558 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 878/1751] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:08.468369 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e96853-a12b-43ec-bc6e-0ffa2103ec79 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:08.469863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198e982-3d10-404e-952e-a6e415b221c1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:08.472896 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-35e96853-a12b-43ec-bc6e-0ffa2103ec79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:08.475173 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d198e982-3d10-404e-952e-a6e415b221c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:08.503627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e96853-a12b-43ec-bc6e-0ffa2103ec79 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:08.513106 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:08.631196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198e982-3d10-404e-952e-a6e415b221c1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:08.646109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2022e5e4-3b91-4ec3-9dc8-d26615270d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:08.647333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022e5e4-3b91-4ec3-9dc8-d26615270d63 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:08.647333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022e5e4-3b91-4ec3-9dc8-d26615270d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:08.647514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022e5e4-3b91-4ec3-9dc8-d26615270d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:08.648173 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022e5e4-3b91-4ec3-9dc8-d26615270d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:08.649958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2022e5e4-3b91-4ec3-9dc8-d26615270d63 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:08.668909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa3e63-3dc2-4b4d-8304-2122a8342397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:08.670657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa3e63-3dc2-4b4d-8304-2122a8342397 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:08.672200 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa3e63-3dc2-4b4d-8304-2122a8342397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:08.672610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa3e63-3dc2-4b4d-8304-2122a8342397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:08.677570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa3e63-3dc2-4b4d-8304-2122a8342397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:08.686660 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa3e63-3dc2-4b4d-8304-2122a8342397 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:08.694517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 879/1752] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:08.694517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad44e93-8a48-43d6-b86c-df6933a2b1ce None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:08.694517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad44e93-8a48-43d6-b86c-df6933a2b1ce None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:08.694517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad44e93-8a48-43d6-b86c-df6933a2b1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:08.722433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 874/1753] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:08.726480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa3e63-3dc2-4b4d-8304-2122a8342397 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:08.744378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa3e63-3dc2-4b4d-8304-2122a8342397 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:08.746734 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1ad44e93-8a48-43d6-b86c-df6933a2b1ce None None] MFA Rules not processed for user `6d0ae1707c7041a0989889dbefeaf267`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:08.754403 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b508a-76fe-4d11-b368-c12147c7c722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:08.755224 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b508a-76fe-4d11-b368-c12147c7c722 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:08.755510 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b508a-76fe-4d11-b368-c12147c7c722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:08.755782 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b508a-76fe-4d11-b368-c12147c7c722 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:08.756551 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b508a-76fe-4d11-b368-c12147c7c722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:08.758827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b508a-76fe-4d11-b368-c12147c7c722 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:08.762107 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1ad44e93-8a48-43d6-b86c-df6933a2b1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:08.794218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 875/1754] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:08 2022] POST /identity/v3/users => generated 284 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:08.795760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fe60b-e2ae-4fde-83f7-a8d74fa71a56 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:08.796052 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fe60b-e2ae-4fde-83f7-a8d74fa71a56 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:08.796331 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fe60b-e2ae-4fde-83f7-a8d74fa71a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:08.889859 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8c1fe60b-e2ae-4fde-83f7-a8d74fa71a56 None None] MFA Rules not processed for user `aa07c20aa2de4d21bb6c09465fc2b5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:08.891149 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8c1fe60b-e2ae-4fde-83f7-a8d74fa71a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:08.945213 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 880/1755] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 15 00:35:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:08.946332 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad44e93-8a48-43d6-b86c-df6933a2b1ce None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:08.974868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad44e93-8a48-43d6-b86c-df6933a2b1ce None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:08.980321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa814bc-963b-4ed0-9b46-42a49839dc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:08.981946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa814bc-963b-4ed0-9b46-42a49839dc0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:08.982307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa814bc-963b-4ed0-9b46-42a49839dc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:08.982956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa814bc-963b-4ed0-9b46-42a49839dc0a admin admin] PATH_INFO: `/v3/projects/d297a8b7f5be401d9c405e6b349ccf9d/users/383d493bf686460185e8040c82a23e97/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:09.003180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa814bc-963b-4ed0-9b46-42a49839dc0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d297a8b7f5be401d9c405e6b349ccf9d, user_id=383d493bf686460185e8040c82a23e97, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:09.007122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa814bc-963b-4ed0-9b46-42a49839dc0a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:09.018868 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 876/1756] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:09.019863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fe60b-e2ae-4fde-83f7-a8d74fa71a56 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:09.021328 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8c1fe60b-e2ae-4fde-83f7-a8d74fa71a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:09.036765 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 881/1757] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:08 2022] PUT /identity/v3/projects/d297a8b7f5be401d9c405e6b349ccf9d/users/383d493bf686460185e8040c82a23e97/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:09.038626 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa814bc-963b-4ed0-9b46-42a49839dc0a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:09.052368 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fe60b-e2ae-4fde-83f7-a8d74fa71a56 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:09.150503 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15692d2-4148-4f40-8d95-04468412e76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:09.151410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15692d2-4148-4f40-8d95-04468412e76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:09.151693 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15692d2-4148-4f40-8d95-04468412e76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:09.151969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15692d2-4148-4f40-8d95-04468412e76f admin admin] PATH_INFO: `/v3/projects/849362069bd64d25bd00acd2d010dd3d` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:09.153209 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15692d2-4148-4f40-8d95-04468412e76f admin admin] RBAC: Authorizing `identity:delete_project(project_id=849362069bd64d25bd00acd2d010dd3d)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:09.155250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15692d2-4148-4f40-8d95-04468412e76f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:09.172117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:09.212180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa814bc-963b-4ed0-9b46-42a49839dc0a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:09.222582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4968b-506d-43c8-8be7-2e9eaf9dacd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:09.222715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4968b-506d-43c8-8be7-2e9eaf9dacd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:09.223216 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4968b-506d-43c8-8be7-2e9eaf9dacd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:09.223589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4968b-506d-43c8-8be7-2e9eaf9dacd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:09.224489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4968b-506d-43c8-8be7-2e9eaf9dacd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:09.229828 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4968b-506d-43c8-8be7-2e9eaf9dacd2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:09.243771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e15692d2-4148-4f40-8d95-04468412e76f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849362069bd64d25bd00acd2d010dd3d', 'request_id': 'req-e15692d2-4148-4f40-8d95-04468412e76f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:09.252869 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e15692d2-4148-4f40-8d95-04468412e76f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849362069bd64d25bd00acd2d010dd3d', 'request_id': 'req-e15692d2-4148-4f40-8d95-04468412e76f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:09.262691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 882/1758] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:09.262691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4968b-506d-43c8-8be7-2e9eaf9dacd2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:09.266536 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e15692d2-4148-4f40-8d95-04468412e76f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849362069bd64d25bd00acd2d010dd3d', 'request_id': 'req-e15692d2-4148-4f40-8d95-04468412e76f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:09.288467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e15692d2-4148-4f40-8d95-04468412e76f admin admin] The token cache is being invalidate because project 849362069bd64d25bd00acd2d010dd3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:09.288664 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e15692d2-4148-4f40-8d95-04468412e76f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:09.289633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e15692d2-4148-4f40-8d95-04468412e76f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:09.292534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4968b-506d-43c8-8be7-2e9eaf9dacd2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:09.295845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 877/1759] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:09 2022] DELETE /identity/v3/projects/849362069bd64d25bd00acd2d010dd3d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:09.296344 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15692d2-4148-4f40-8d95-04468412e76f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:09.297915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e15692d2-4148-4f40-8d95-04468412e76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:09.303140 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:09.408010 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15692d2-4148-4f40-8d95-04468412e76f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:09.414147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6840481-b57a-4a98-a5be-636e3f2ccb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:09.414927 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6840481-b57a-4a98-a5be-636e3f2ccb9a admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:09.416538 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6840481-b57a-4a98-a5be-636e3f2ccb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:09.416944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6840481-b57a-4a98-a5be-636e3f2ccb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:09.430238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3a7cb-7895-4121-80c9-9bf4176eed3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:09.431497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3a7cb-7895-4121-80c9-9bf4176eed3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:09.431947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3a7cb-7895-4121-80c9-9bf4176eed3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:09.432324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3a7cb-7895-4121-80c9-9bf4176eed3e admin admin] PATH_INFO: `/v3/projects/9295192420054671b7d447de153a1775/users/cb401093d4e14c66ac3652612ead2d5b/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:09.433558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6840481-b57a-4a98-a5be-636e3f2ccb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:09.437839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6840481-b57a-4a98-a5be-636e3f2ccb9a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:09.452653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3a7cb-7895-4121-80c9-9bf4176eed3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9295192420054671b7d447de153a1775, user_id=cb401093d4e14c66ac3652612ead2d5b, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:09.456983 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3a7cb-7895-4121-80c9-9bf4176eed3e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:09.470837 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 878/1760] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:09.470837 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6840481-b57a-4a98-a5be-636e3f2ccb9a admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:09.472202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d6840481-b57a-4a98-a5be-636e3f2ccb9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:09.490468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 883/1761] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:09 2022] PUT /identity/v3/projects/9295192420054671b7d447de153a1775/users/cb401093d4e14c66ac3652612ead2d5b/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:09.491362 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3a7cb-7895-4121-80c9-9bf4176eed3e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:09.495563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a6c3a7cb-7895-4121-80c9-9bf4176eed3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:09.651020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3a7cb-7895-4121-80c9-9bf4176eed3e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:09.655548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6840481-b57a-4a98-a5be-636e3f2ccb9a admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:09.657462 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97237f-3bfa-4b50-a827-6469204f16f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:09.658246 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97237f-3bfa-4b50-a827-6469204f16f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:09.658602 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97237f-3bfa-4b50-a827-6469204f16f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:09.658965 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97237f-3bfa-4b50-a827-6469204f16f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:09.663659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97237f-3bfa-4b50-a827-6469204f16f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:09.667603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97237f-3bfa-4b50-a827-6469204f16f8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:09.708731 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:09.743438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 884/1762] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:09 2022] POST /identity/v3/projects => generated 365 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:09.745679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2e2f0-1e0b-434f-bdac-aab66b2c5e80 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:09.746085 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2e2f0-1e0b-434f-bdac-aab66b2c5e80 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:09.746379 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2e2f0-1e0b-434f-bdac-aab66b2c5e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:09.791577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-88a2e2f0-1e0b-434f-bdac-aab66b2c5e80 None None] MFA Rules not processed for user `383d493bf686460185e8040c82a23e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:09.793094 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-88a2e2f0-1e0b-434f-bdac-aab66b2c5e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:09.795218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811f6f6-2924-4bb6-bb33-52a9fa879a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:09.796142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811f6f6-2924-4bb6-bb33-52a9fa879a0d service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:09.796646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811f6f6-2924-4bb6-bb33-52a9fa879a0d service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:09.797422 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811f6f6-2924-4bb6-bb33-52a9fa879a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:09.803504 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5811f6f6-2924-4bb6-bb33-52a9fa879a0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:09.837936 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811f6f6-2924-4bb6-bb33-52a9fa879a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:09.839968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5811f6f6-2924-4bb6-bb33-52a9fa879a0d service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:09.879269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 879/1763] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:09.884705 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811f6f6-2924-4bb6-bb33-52a9fa879a0d service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:09.886569 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5811f6f6-2924-4bb6-bb33-52a9fa879a0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:09.903750 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 885/1764] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:09 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:09.909431 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426141-f834-4c8a-9101-04714e91113b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:09.910075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426141-f834-4c8a-9101-04714e91113b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:09.912095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426141-f834-4c8a-9101-04714e91113b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:09.929036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811f6f6-2924-4bb6-bb33-52a9fa879a0d service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:09.933404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:09.973954 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-30426141-f834-4c8a-9101-04714e91113b None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:09.976091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-30426141-f834-4c8a-9101-04714e91113b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:10.112772 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72208aa0-a56c-45c0-af42-f2377f72f1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:10.113796 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72208aa0-a56c-45c0-af42-f2377f72f1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:10.114086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72208aa0-a56c-45c0-af42-f2377f72f1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:10.114365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72208aa0-a56c-45c0-af42-f2377f72f1c8 admin admin] PATH_INFO: `/v3/projects/5f75dc5823694353ad0284b013d4a3a1/users/e71e0e7e4af14ca1b1c9bc7dbe151752/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:10.138789 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 886/1765] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:10.149694 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72208aa0-a56c-45c0-af42-f2377f72f1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f75dc5823694353ad0284b013d4a3a1, user_id=e71e0e7e4af14ca1b1c9bc7dbe151752, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:10.150203 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9dd77-7368-4df6-b8e2-a412473bd31b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:10.150507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9dd77-7368-4df6-b8e2-a412473bd31b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:10.150792 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9dd77-7368-4df6-b8e2-a412473bd31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:10.154238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72208aa0-a56c-45c0-af42-f2377f72f1c8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:10.189172 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 880/1766] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:09 2022] PUT /identity/v3/projects/5f75dc5823694353ad0284b013d4a3a1/users/e71e0e7e4af14ca1b1c9bc7dbe151752/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:10.190199 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-19b9dd77-7368-4df6-b8e2-a412473bd31b None None] MFA Rules not processed for user `21c54bf3ff584c709731d3624aa187a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:10.190320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72208aa0-a56c-45c0-af42-f2377f72f1c8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:10.193099 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-19b9dd77-7368-4df6-b8e2-a412473bd31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:10.335008 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 887/1767] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:10.337214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7205257-2eb6-43a0-86b3-8257865bedbf None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:10.337537 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7205257-2eb6-43a0-86b3-8257865bedbf None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:10.337820 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7205257-2eb6-43a0-86b3-8257865bedbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:10.346225 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72208aa0-a56c-45c0-af42-f2377f72f1c8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:10.357770 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0aa8d-40c6-423b-b785-2c40ad5f6c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:10.359562 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0aa8d-40c6-423b-b785-2c40ad5f6c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:10.360178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0aa8d-40c6-423b-b785-2c40ad5f6c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:10.360480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0aa8d-40c6-423b-b785-2c40ad5f6c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:10.362168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0aa8d-40c6-423b-b785-2c40ad5f6c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:10.363541 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0aa8d-40c6-423b-b785-2c40ad5f6c0f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:10.368904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f7205257-2eb6-43a0-86b3-8257865bedbf None None] MFA Rules not processed for user `cb401093d4e14c66ac3652612ead2d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:10.370637 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f7205257-2eb6-43a0-86b3-8257865bedbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:10.388431 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 881/1768] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:10.389292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0aa8d-40c6-423b-b785-2c40ad5f6c0f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:10.419004 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0aa8d-40c6-423b-b785-2c40ad5f6c0f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:10.435447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8edc37-50b5-44d0-9229-10d4ca939416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:10.436314 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8edc37-50b5-44d0-9229-10d4ca939416 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:10.436603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8edc37-50b5-44d0-9229-10d4ca939416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:10.436884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8edc37-50b5-44d0-9229-10d4ca939416 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:10.437745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8edc37-50b5-44d0-9229-10d4ca939416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:10.439811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8edc37-50b5-44d0-9229-10d4ca939416 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:10.466202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 888/1769] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:10.474560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7205257-2eb6-43a0-86b3-8257865bedbf None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:10.481839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 882/1770] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:10 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:10.483012 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f7205257-2eb6-43a0-86b3-8257865bedbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:10.483432 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175bfb4-64d6-45ea-83f2-85eba05bd038 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:10.483904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175bfb4-64d6-45ea-83f2-85eba05bd038 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:10.484595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175bfb4-64d6-45ea-83f2-85eba05bd038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:10.508144 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2175bfb4-64d6-45ea-83f2-85eba05bd038 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:10.509931 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2175bfb4-64d6-45ea-83f2-85eba05bd038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:10.512124 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7205257-2eb6-43a0-86b3-8257865bedbf None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:10.518211 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359329d1-049c-4fae-bbf1-d9b75fa8b100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:10.519288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359329d1-049c-4fae-bbf1-d9b75fa8b100 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:10.519749 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359329d1-049c-4fae-bbf1-d9b75fa8b100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:10.520024 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359329d1-049c-4fae-bbf1-d9b75fa8b100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:10.520745 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359329d1-049c-4fae-bbf1-d9b75fa8b100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:10.524361 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 883/1771] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:10.526494 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8704cd-d16f-4740-99d4-e456478071c6 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:10.526794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8704cd-d16f-4740-99d4-e456478071c6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:10.527080 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8704cd-d16f-4740-99d4-e456478071c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:10.533657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359329d1-049c-4fae-bbf1-d9b75fa8b100 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:10.557163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:10.563357 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-fb8704cd-d16f-4740-99d4-e456478071c6 None None] MFA Rules not processed for user `e71e0e7e4af14ca1b1c9bc7dbe151752`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:10.565149 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fb8704cd-d16f-4740-99d4-e456478071c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:10.603306 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 889/1772] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:10 2022] POST /identity/v3/projects => generated 357 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:10.604030 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359329d1-049c-4fae-bbf1-d9b75fa8b100 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:10.654445 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:10.698587 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 884/1773] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:10.701171 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8704cd-d16f-4740-99d4-e456478071c6 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:10.708385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fb8704cd-d16f-4740-99d4-e456478071c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:10.735663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8704cd-d16f-4740-99d4-e456478071c6 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:10.753719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359329d1-049c-4fae-bbf1-d9b75fa8b100 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:10.759635 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6f2f3-db14-4263-a0c2-71b9b2b7775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:10.760885 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6f2f3-db14-4263-a0c2-71b9b2b7775a admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:10.761531 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6f2f3-db14-4263-a0c2-71b9b2b7775a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:10.761855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6f2f3-db14-4263-a0c2-71b9b2b7775a admin admin] PATH_INFO: `/v3/projects/f23e17290e8441c4b4d493cc56a66266/users/cbb03f073bf348d0ac55ab0dd4689528/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:10.792137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6f2f3-db14-4263-a0c2-71b9b2b7775a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23e17290e8441c4b4d493cc56a66266, user_id=cbb03f073bf348d0ac55ab0dd4689528, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:10.793428 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6f2f3-db14-4263-a0c2-71b9b2b7775a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:10.827612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 890/1774] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:10 2022] PUT /identity/v3/projects/f23e17290e8441c4b4d493cc56a66266/users/cbb03f073bf348d0ac55ab0dd4689528/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:10.827612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6f2f3-db14-4263-a0c2-71b9b2b7775a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:10.829890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6271954-c95c-424b-a2fb-3aa5ee98764b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:10.830675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6271954-c95c-424b-a2fb-3aa5ee98764b admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:10.831031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6271954-c95c-424b-a2fb-3aa5ee98764b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:10.831383 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6271954-c95c-424b-a2fb-3aa5ee98764b admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:10.832293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6271954-c95c-424b-a2fb-3aa5ee98764b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:10.835228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6271954-c95c-424b-a2fb-3aa5ee98764b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:10.896190 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 885/1775] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:10 2022] POST /identity/v3/projects => generated 375 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:10.898020 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6271954-c95c-424b-a2fb-3aa5ee98764b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:10.935651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6f2f3-db14-4263-a0c2-71b9b2b7775a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:10.992221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6271954-c95c-424b-a2fb-3aa5ee98764b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:10.998417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676c9ec-d751-4d3b-adb4-4de9afcef2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:10.999102 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676c9ec-d751-4d3b-adb4-4de9afcef2eb admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:10.999506 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676c9ec-d751-4d3b-adb4-4de9afcef2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:10.999787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676c9ec-d751-4d3b-adb4-4de9afcef2eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:11.000529 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676c9ec-d751-4d3b-adb4-4de9afcef2eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:11.000842 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676c9ec-d751-4d3b-adb4-4de9afcef2eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:11.002687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676c9ec-d751-4d3b-adb4-4de9afcef2eb admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:11.026148 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 886/1776] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:11.027700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676c9ec-d751-4d3b-adb4-4de9afcef2eb admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:11.040940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676c9ec-d751-4d3b-adb4-4de9afcef2eb admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:11.043402 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698c248-7803-4d80-b2d0-666764933bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:11.044655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698c248-7803-4d80-b2d0-666764933bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:11.045232 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698c248-7803-4d80-b2d0-666764933bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:11.045839 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698c248-7803-4d80-b2d0-666764933bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:11.046747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23da05-aca8-4506-8703-2c29b3bd7a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:11.047027 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698c248-7803-4d80-b2d0-666764933bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:11.048871 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698c248-7803-4d80-b2d0-666764933bc0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:11.049238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23da05-aca8-4506-8703-2c29b3bd7a19 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:11.049570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23da05-aca8-4506-8703-2c29b3bd7a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:11.049937 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23da05-aca8-4506-8703-2c29b3bd7a19 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:11.052435 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23da05-aca8-4506-8703-2c29b3bd7a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:11.055252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23da05-aca8-4506-8703-2c29b3bd7a19 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:11.068926 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 891/1777] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:11.069970 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698c248-7803-4d80-b2d0-666764933bc0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:11.089124 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698c248-7803-4d80-b2d0-666764933bc0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:11.093422 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 887/1778] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:11 2022] POST /identity/v3/users => generated 285 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:11.095248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7171e-798f-4b96-8091-9c009f977b05 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:11.095765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7171e-798f-4b96-8091-9c009f977b05 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:11.096240 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7171e-798f-4b96-8091-9c009f977b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:11.100394 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc30001-3b15-4745-9afd-a300305681f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:11.102090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc30001-3b15-4745-9afd-a300305681f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:11.104946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc30001-3b15-4745-9afd-a300305681f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:11.104946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc30001-3b15-4745-9afd-a300305681f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:11.104946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc30001-3b15-4745-9afd-a300305681f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:11.107119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc30001-3b15-4745-9afd-a300305681f0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:11.110909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:11.138326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2fa7171e-798f-4b96-8091-9c009f977b05 None None] MFA Rules not processed for user `cbb03f073bf348d0ac55ab0dd4689528`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:11.139499 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2fa7171e-798f-4b96-8091-9c009f977b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:11.298142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 888/1779] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:11.300475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7171e-798f-4b96-8091-9c009f977b05 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:11.329031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7171e-798f-4b96-8091-9c009f977b05 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:11.337299 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09070c1a-452c-4289-b122-20c87bebe3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:11.338488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09070c1a-452c-4289-b122-20c87bebe3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:11.339041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09070c1a-452c-4289-b122-20c87bebe3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:11.339547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09070c1a-452c-4289-b122-20c87bebe3a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:11.340792 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09070c1a-452c-4289-b122-20c87bebe3a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:11.343881 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09070c1a-452c-4289-b122-20c87bebe3a8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:11.380008 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 889/1780] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:11 2022] POST /identity/v3/users => generated 294 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:11.381141 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09070c1a-452c-4289-b122-20c87bebe3a8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:11.401884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09070c1a-452c-4289-b122-20c87bebe3a8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:11.428202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958b6ba-768a-42d1-8950-3f68a51bc2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:11.430000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958b6ba-768a-42d1-8950-3f68a51bc2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:11.430984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 892/1781] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:11 2022] POST /identity/v3/projects => generated 379 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:11.431848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc30001-3b15-4745-9afd-a300305681f0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:11.433591 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958b6ba-768a-42d1-8950-3f68a51bc2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:11.442103 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958b6ba-768a-42d1-8950-3f68a51bc2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:11.442103 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958b6ba-768a-42d1-8950-3f68a51bc2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:11.447652 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958b6ba-768a-42d1-8950-3f68a51bc2c4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:11.504994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:11.532530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 890/1782] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:11 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:11.533760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958b6ba-768a-42d1-8950-3f68a51bc2c4 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:11.677158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc30001-3b15-4745-9afd-a300305681f0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:11.806800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958b6ba-768a-42d1-8950-3f68a51bc2c4 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:11.815973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c72c0-7cd1-43a4-944b-7758349aad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:11.817022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c72c0-7cd1-43a4-944b-7758349aad6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:11.817460 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c72c0-7cd1-43a4-944b-7758349aad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:11.817746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c72c0-7cd1-43a4-944b-7758349aad6b admin admin] PATH_INFO: `/v3/projects/6828794cd55f4c4cb68085233d1496b3/users/f97a71aabf16454aaa1a15b72f43648d/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:11.819090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c667dcf-b6f7-4d8c-9e63-8ef81b1a6755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:11.819804 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c667dcf-b6f7-4d8c-9e63-8ef81b1a6755 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:11.820094 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c667dcf-b6f7-4d8c-9e63-8ef81b1a6755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:11.820373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c667dcf-b6f7-4d8c-9e63-8ef81b1a6755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:11.821284 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c667dcf-b6f7-4d8c-9e63-8ef81b1a6755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:11.822793 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c667dcf-b6f7-4d8c-9e63-8ef81b1a6755 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:11.843015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 891/1783] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:11.844055 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c667dcf-b6f7-4d8c-9e63-8ef81b1a6755 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:11.845861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5c667dcf-b6f7-4d8c-9e63-8ef81b1a6755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:11.846859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c72c0-7cd1-43a4-944b-7758349aad6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6828794cd55f4c4cb68085233d1496b3, user_id=f97a71aabf16454aaa1a15b72f43648d, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:11.849650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c72c0-7cd1-43a4-944b-7758349aad6b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:11.881387 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 893/1784] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:11 2022] PUT /identity/v3/projects/6828794cd55f4c4cb68085233d1496b3/users/f97a71aabf16454aaa1a15b72f43648d/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:11.882220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c72c0-7cd1-43a4-944b-7758349aad6b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:11.965503 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c667dcf-b6f7-4d8c-9e63-8ef81b1a6755 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:11.971603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:12.035113 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc5588-0f4a-4a3e-a027-d9a2b36073a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:12.035800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc5588-0f4a-4a3e-a027-d9a2b36073a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.036086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc5588-0f4a-4a3e-a027-d9a2b36073a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.036364 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc5588-0f4a-4a3e-a027-d9a2b36073a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.043586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c72c0-7cd1-43a4-944b-7758349aad6b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:12.057463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d64fd4-2981-4788-8306-95408d35a74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:12.058547 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d64fd4-2981-4788-8306-95408d35a74d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.059198 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d64fd4-2981-4788-8306-95408d35a74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.059941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d64fd4-2981-4788-8306-95408d35a74d admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.061115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d64fd4-2981-4788-8306-95408d35a74d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:12.063873 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d64fd4-2981-4788-8306-95408d35a74d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:12.081962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 894/1785] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:12.082904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d64fd4-2981-4788-8306-95408d35a74d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:12.096958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d64fd4-2981-4788-8306-95408d35a74d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:12.102616 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da72ac-5153-475b-92ef-5f526903fbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:12.103309 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da72ac-5153-475b-92ef-5f526903fbed admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.103622 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da72ac-5153-475b-92ef-5f526903fbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.103915 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da72ac-5153-475b-92ef-5f526903fbed admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.104549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da72ac-5153-475b-92ef-5f526903fbed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:12.107080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da72ac-5153-475b-92ef-5f526903fbed admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:12.135017 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 895/1786] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:12 2022] POST /identity/v3/users => generated 296 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:12.136771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da72ac-5153-475b-92ef-5f526903fbed admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:12.138536 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc5588-0f4a-4a3e-a027-d9a2b36073a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:12.140205 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc5588-0f4a-4a3e-a027-d9a2b36073a8 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:12.155741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da72ac-5153-475b-92ef-5f526903fbed admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:12.160837 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495d734-4095-4ad5-b426-4ca1744bcab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:12.161649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495d734-4095-4ad5-b426-4ca1744bcab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.162676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495d734-4095-4ad5-b426-4ca1744bcab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.162676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495d734-4095-4ad5-b426-4ca1744bcab9 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.162972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495d734-4095-4ad5-b426-4ca1744bcab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:12.164872 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495d734-4095-4ad5-b426-4ca1744bcab9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:12.165484 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 892/1787] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:12.167447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc5588-0f4a-4a3e-a027-d9a2b36073a8 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:12.187314 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc5588-0f4a-4a3e-a027-d9a2b36073a8 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:12.189420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 896/1788] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:12 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:12.189420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495d734-4095-4ad5-b426-4ca1744bcab9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:12.195648 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c1958-0adc-4ca7-a607-b6ce0bf3c910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:12.196772 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c1958-0adc-4ca7-a607-b6ce0bf3c910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.197139 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c1958-0adc-4ca7-a607-b6ce0bf3c910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.197515 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c1958-0adc-4ca7-a607-b6ce0bf3c910 admin admin] PATH_INFO: `/v3/projects/7d2259d4597b47b5942fc767a11ab70b/users/83faded479ce4dddbbd63de27647613d/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.201688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495d734-4095-4ad5-b426-4ca1744bcab9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:12.206518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a0adc-7517-46ff-ac6e-7e7395db2517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:12.207365 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a0adc-7517-46ff-ac6e-7e7395db2517 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.207649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a0adc-7517-46ff-ac6e-7e7395db2517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.208063 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a0adc-7517-46ff-ac6e-7e7395db2517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.208802 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a0adc-7517-46ff-ac6e-7e7395db2517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:12.210506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a0adc-7517-46ff-ac6e-7e7395db2517 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:12.219605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c1958-0adc-4ca7-a607-b6ce0bf3c910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2259d4597b47b5942fc767a11ab70b, user_id=83faded479ce4dddbbd63de27647613d, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:12.223324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 897/1789] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:12.224154 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a0adc-7517-46ff-ac6e-7e7395db2517 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:12.225597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c1958-0adc-4ca7-a607-b6ce0bf3c910 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:12.229229 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:12.235023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a0adc-7517-46ff-ac6e-7e7395db2517 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:12.246357 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 893/1790] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:12 2022] PUT /identity/v3/projects/7d2259d4597b47b5942fc767a11ab70b/users/83faded479ce4dddbbd63de27647613d/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:12.246357 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c1958-0adc-4ca7-a607-b6ce0bf3c910 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:12.301387 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a961325-d740-427c-9a4d-239dd320f67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:12.302408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a961325-d740-427c-9a4d-239dd320f67e admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.302698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a961325-d740-427c-9a4d-239dd320f67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.303035 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a961325-d740-427c-9a4d-239dd320f67e admin admin] PATH_INFO: `/v3/projects/63abd07df84745799a9282525661532b/users/e4482cadec43483da3c8d2397adb475a/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.313894 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c1958-0adc-4ca7-a607-b6ce0bf3c910 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:12.319059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a961325-d740-427c-9a4d-239dd320f67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=63abd07df84745799a9282525661532b, user_id=e4482cadec43483da3c8d2397adb475a, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:12.319575 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe1f05-3c83-4013-938e-c1ee5f6b8d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:12.320370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe1f05-3c83-4013-938e-c1ee5f6b8d92 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.320660 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe1f05-3c83-4013-938e-c1ee5f6b8d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.320935 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe1f05-3c83-4013-938e-c1ee5f6b8d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.321704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe1f05-3c83-4013-938e-c1ee5f6b8d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:12.321819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a961325-d740-427c-9a4d-239dd320f67e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:12.323395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe1f05-3c83-4013-938e-c1ee5f6b8d92 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:12.336079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 894/1791] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:12.337281 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe1f05-3c83-4013-938e-c1ee5f6b8d92 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:12.339091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 898/1792] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:12 2022] PUT /identity/v3/projects/63abd07df84745799a9282525661532b/users/e4482cadec43483da3c8d2397adb475a/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:12.340759 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a961325-d740-427c-9a4d-239dd320f67e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:12.352272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe1f05-3c83-4013-938e-c1ee5f6b8d92 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:12.405588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:12.437482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a961325-d740-427c-9a4d-239dd320f67e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:12.438045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426460f2-c9bf-468a-83a7-abaaf002e472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:12.438654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426460f2-c9bf-468a-83a7-abaaf002e472 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.438950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426460f2-c9bf-468a-83a7-abaaf002e472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.439227 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426460f2-c9bf-468a-83a7-abaaf002e472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.439965 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426460f2-c9bf-468a-83a7-abaaf002e472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:12.441925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426460f2-c9bf-468a-83a7-abaaf002e472 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:12.444040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768423e-4991-44ec-aa3b-edbac96a3063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:12.445473 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768423e-4991-44ec-aa3b-edbac96a3063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.445905 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768423e-4991-44ec-aa3b-edbac96a3063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.446338 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768423e-4991-44ec-aa3b-edbac96a3063 admin admin] PATH_INFO: `/v3/projects/6828794cd55f4c4cb68085233d1496b3/users/f97a71aabf16454aaa1a15b72f43648d/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.449046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768423e-4991-44ec-aa3b-edbac96a3063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6828794cd55f4c4cb68085233d1496b3, user_id=f97a71aabf16454aaa1a15b72f43648d, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:12.453080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768423e-4991-44ec-aa3b-edbac96a3063 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:12.453557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 895/1793] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:12.454427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426460f2-c9bf-468a-83a7-abaaf002e472 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:12.474633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 899/1794] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:12 2022] PUT /identity/v3/projects/6828794cd55f4c4cb68085233d1496b3/users/f97a71aabf16454aaa1a15b72f43648d/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:12.476072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768423e-4991-44ec-aa3b-edbac96a3063 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:12.479139 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426460f2-c9bf-468a-83a7-abaaf002e472 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:12.555453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f8a51-7987-49ef-95b5-1e235bf5f130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:12.558253 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f8a51-7987-49ef-95b5-1e235bf5f130 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.558253 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f8a51-7987-49ef-95b5-1e235bf5f130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.558253 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f8a51-7987-49ef-95b5-1e235bf5f130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.558253 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f8a51-7987-49ef-95b5-1e235bf5f130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:12.559718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f8a51-7987-49ef-95b5-1e235bf5f130 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:12.580912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 896/1795] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:12.584951 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f8a51-7987-49ef-95b5-1e235bf5f130 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:12.604686 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768423e-4991-44ec-aa3b-edbac96a3063 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:12.607691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f8a51-7987-49ef-95b5-1e235bf5f130 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:12.615842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7de9d5-321b-49c6-80a5-9f570a068ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:12.616689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7de9d5-321b-49c6-80a5-9f570a068ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.616882 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd67b4-cb4c-48a8-8ca4-1112b428d6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:12.617007 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7de9d5-321b-49c6-80a5-9f570a068ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.617254 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7de9d5-321b-49c6-80a5-9f570a068ea7 admin admin] PATH_INFO: `/v3/projects/98790531130344ec9440ced73ab3d809/users/4c5a2a74e13241ab88b43613a8489035/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.618304 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd67b4-cb4c-48a8-8ca4-1112b428d6fa admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.618742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd67b4-cb4c-48a8-8ca4-1112b428d6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.619279 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd67b4-cb4c-48a8-8ca4-1112b428d6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.620258 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd67b4-cb4c-48a8-8ca4-1112b428d6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:12.622320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd67b4-cb4c-48a8-8ca4-1112b428d6fa admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:12.635346 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7de9d5-321b-49c6-80a5-9f570a068ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98790531130344ec9440ced73ab3d809, user_id=4c5a2a74e13241ab88b43613a8489035, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:12.638784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7de9d5-321b-49c6-80a5-9f570a068ea7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:12.655853 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 897/1796] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:12.656761 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd67b4-cb4c-48a8-8ca4-1112b428d6fa admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:12.669888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 900/1797] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:12 2022] PUT /identity/v3/projects/98790531130344ec9440ced73ab3d809/users/4c5a2a74e13241ab88b43613a8489035/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:12.669888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f89216-e69d-4ebe-91c6-a2fa8e6b5037 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.669888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f89216-e69d-4ebe-91c6-a2fa8e6b5037 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.670293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd67b4-cb4c-48a8-8ca4-1112b428d6fa admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:12.670368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f89216-e69d-4ebe-91c6-a2fa8e6b5037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.677325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:12.713124 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-64f89216-e69d-4ebe-91c6-a2fa8e6b5037 None None] MFA Rules not processed for user `f97a71aabf16454aaa1a15b72f43648d`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:12.714536 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-64f89216-e69d-4ebe-91c6-a2fa8e6b5037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:12.755116 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0321a-7389-4843-a5fc-65bb83e8405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:12.760418 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0321a-7389-4843-a5fc-65bb83e8405e admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.761570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0321a-7389-4843-a5fc-65bb83e8405e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.762176 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0321a-7389-4843-a5fc-65bb83e8405e admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.764226 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0321a-7389-4843-a5fc-65bb83e8405e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:12.765958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0321a-7389-4843-a5fc-65bb83e8405e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:12.782040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 898/1798] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:12.786373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0321a-7389-4843-a5fc-65bb83e8405e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:12.797174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0321a-7389-4843-a5fc-65bb83e8405e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:12.803101 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a2499-d904-4d1b-96a9-5b855680767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:12.804099 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a2499-d904-4d1b-96a9-5b855680767c admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.804462 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a2499-d904-4d1b-96a9-5b855680767c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.804823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a2499-d904-4d1b-96a9-5b855680767c admin admin] PATH_INFO: `/v3/projects/7d2259d4597b47b5942fc767a11ab70b/users/83faded479ce4dddbbd63de27647613d/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.807396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a2499-d904-4d1b-96a9-5b855680767c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d2259d4597b47b5942fc767a11ab70b, user_id=83faded479ce4dddbbd63de27647613d, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:12.811760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a2499-d904-4d1b-96a9-5b855680767c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:12.826716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 901/1799] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:12.828008 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f89216-e69d-4ebe-91c6-a2fa8e6b5037 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:12.837569 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 899/1800] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:12 2022] PUT /identity/v3/projects/7d2259d4597b47b5942fc767a11ab70b/users/83faded479ce4dddbbd63de27647613d/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:12.838584 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a2499-d904-4d1b-96a9-5b855680767c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:12.848824 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f89216-e69d-4ebe-91c6-a2fa8e6b5037 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:12.928176 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:12.940227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05663e8e-1a6b-436b-bd1a-03c7d36e3ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:12.942087 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05663e8e-1a6b-436b-bd1a-03c7d36e3ff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:12.942555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05663e8e-1a6b-436b-bd1a-03c7d36e3ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:12.943024 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05663e8e-1a6b-436b-bd1a-03c7d36e3ff0 admin admin] PATH_INFO: `/v3/projects/63abd07df84745799a9282525661532b/users/e4482cadec43483da3c8d2397adb475a/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:12.946087 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05663e8e-1a6b-436b-bd1a-03c7d36e3ff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63abd07df84745799a9282525661532b, user_id=e4482cadec43483da3c8d2397adb475a, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:12.949168 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05663e8e-1a6b-436b-bd1a-03c7d36e3ff0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:12.960980 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a2499-d904-4d1b-96a9-5b855680767c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:12.968195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 902/1801] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:12 2022] PUT /identity/v3/projects/63abd07df84745799a9282525661532b/users/e4482cadec43483da3c8d2397adb475a/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:12.969715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05663e8e-1a6b-436b-bd1a-03c7d36e3ff0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:13.042856 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0de85-de2c-43b6-8251-cba37029ca81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:13.043556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0de85-de2c-43b6-8251-cba37029ca81 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:13.043841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0de85-de2c-43b6-8251-cba37029ca81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:13.044171 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0de85-de2c-43b6-8251-cba37029ca81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:13.045884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0de85-de2c-43b6-8251-cba37029ca81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:13.048538 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0de85-de2c-43b6-8251-cba37029ca81 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:13.064670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 900/1802] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:13.066032 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0de85-de2c-43b6-8251-cba37029ca81 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:13.091093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05663e8e-1a6b-436b-bd1a-03c7d36e3ff0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:13.102152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea03f8-feba-43b5-b734-74501adc5148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:13.104378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea03f8-feba-43b5-b734-74501adc5148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:13.104668 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea03f8-feba-43b5-b734-74501adc5148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:13.104955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea03f8-feba-43b5-b734-74501adc5148 admin admin] PATH_INFO: `/v3/projects/03309ef1ce404faca95425c0ca9138e5/users/ee98412de2314e2dbe954922dfdaa2fb/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:13.127863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea03f8-feba-43b5-b734-74501adc5148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03309ef1ce404faca95425c0ca9138e5, user_id=ee98412de2314e2dbe954922dfdaa2fb, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:13.130792 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea03f8-feba-43b5-b734-74501adc5148 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:13.148709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 903/1803] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:12 2022] PUT /identity/v3/projects/03309ef1ce404faca95425c0ca9138e5/users/ee98412de2314e2dbe954922dfdaa2fb/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:13.150331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3536e2-b8f1-455f-b62e-44ad3949b8d8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:13.151557 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3536e2-b8f1-455f-b62e-44ad3949b8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:13.151841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3536e2-b8f1-455f-b62e-44ad3949b8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:13.162514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:13.165947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0de85-de2c-43b6-8251-cba37029ca81 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:13.182852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fd3536e2-b8f1-455f-b62e-44ad3949b8d8 None None] MFA Rules not processed for user `83faded479ce4dddbbd63de27647613d`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:13.184170 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fd3536e2-b8f1-455f-b62e-44ad3949b8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:13.217249 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2c544-54af-45d4-b575-b69fe9fdc286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:13.218053 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2c544-54af-45d4-b575-b69fe9fdc286 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:13.218401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2c544-54af-45d4-b575-b69fe9fdc286 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:13.218623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2c544-54af-45d4-b575-b69fe9fdc286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:13.251933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 904/1804] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:13 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:13.253307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eba8b8-2dad-4f81-87a5-75dc5a59bd96 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:13.253630 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eba8b8-2dad-4f81-87a5-75dc5a59bd96 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:13.253909 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eba8b8-2dad-4f81-87a5-75dc5a59bd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:13.265704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:13.280308 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2c544-54af-45d4-b575-b69fe9fdc286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:13.281807 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2c544-54af-45d4-b575-b69fe9fdc286 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:13.282146 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d3eba8b8-2dad-4f81-87a5-75dc5a59bd96 None None] MFA Rules not processed for user `e4482cadec43483da3c8d2397adb475a`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:13.283337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d3eba8b8-2dad-4f81-87a5-75dc5a59bd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:13.291791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 901/1805] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:13.292570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2c544-54af-45d4-b575-b69fe9fdc286 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:13.378962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2c544-54af-45d4-b575-b69fe9fdc286 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:13.381546 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 905/1806] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:13.382932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd8251-1802-4205-9f45-9e3a5b750622 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:13.383226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd8251-1802-4205-9f45-9e3a5b750622 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:13.383505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd8251-1802-4205-9f45-9e3a5b750622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:13.388989 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08fc81-555b-4923-b702-58cba3b91942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:13.390018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08fc81-555b-4923-b702-58cba3b91942 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:13.390568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08fc81-555b-4923-b702-58cba3b91942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:13.391130 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08fc81-555b-4923-b702-58cba3b91942 admin admin] PATH_INFO: `/v3/projects/98790531130344ec9440ced73ab3d809/users/4c5a2a74e13241ab88b43613a8489035/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:13.395341 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08fc81-555b-4923-b702-58cba3b91942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98790531130344ec9440ced73ab3d809, user_id=4c5a2a74e13241ab88b43613a8489035, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:13.398167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08fc81-555b-4923-b702-58cba3b91942 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:13.411610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 902/1807] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:13 2022] PUT /identity/v3/projects/98790531130344ec9440ced73ab3d809/users/4c5a2a74e13241ab88b43613a8489035/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:13.412504 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08fc81-555b-4923-b702-58cba3b91942 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:13.417287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1e08fc81-555b-4923-b702-58cba3b91942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:13.444694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f1cd8251-1802-4205-9f45-9e3a5b750622 None None] MFA Rules not processed for user `ee98412de2314e2dbe954922dfdaa2fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:13.446080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f1cd8251-1802-4205-9f45-9e3a5b750622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:13.493047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08fc81-555b-4923-b702-58cba3b91942 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:13.496561 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20210b3a-c1e6-4b6f-9f5f-508971fd5932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:13.497216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20210b3a-c1e6-4b6f-9f5f-508971fd5932 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:13.497531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20210b3a-c1e6-4b6f-9f5f-508971fd5932 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:13.497808 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20210b3a-c1e6-4b6f-9f5f-508971fd5932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:13.525943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 906/1808] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:13.527236 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd3faa-f6fc-47ae-b087-ccb5506d77fc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:13.527534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd3faa-f6fc-47ae-b087-ccb5506d77fc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:13.527820 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd3faa-f6fc-47ae-b087-ccb5506d77fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:13.536424 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:13.560205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d4dd3faa-f6fc-47ae-b087-ccb5506d77fc None None] MFA Rules not processed for user `4c5a2a74e13241ab88b43613a8489035`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:13.561579 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d4dd3faa-f6fc-47ae-b087-ccb5506d77fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:13.561711 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20210b3a-c1e6-4b6f-9f5f-508971fd5932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:13.563181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20210b3a-c1e6-4b6f-9f5f-508971fd5932 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:13.575221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 903/1809] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:13 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:13.575881 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20210b3a-c1e6-4b6f-9f5f-508971fd5932 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:13.583368 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20210b3a-c1e6-4b6f-9f5f-508971fd5932 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:13.587095 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e94d6-27d0-458e-9eb4-062009a9d280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:13.587733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e94d6-27d0-458e-9eb4-062009a9d280 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:13.588016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e94d6-27d0-458e-9eb4-062009a9d280 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:13.588297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e94d6-27d0-458e-9eb4-062009a9d280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:13.619930 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:13.648317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 907/1810] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:13.649252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd3faa-f6fc-47ae-b087-ccb5506d77fc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:13.664179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e94d6-27d0-458e-9eb4-062009a9d280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:13.666050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e94d6-27d0-458e-9eb4-062009a9d280 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:13.685835 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 904/1811] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:13.758520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd3faa-f6fc-47ae-b087-ccb5506d77fc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:13.767689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46b505-8f15-446a-8dcb-da1c171f7b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:13.768736 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46b505-8f15-446a-8dcb-da1c171f7b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:13.769165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46b505-8f15-446a-8dcb-da1c171f7b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:13.769598 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46b505-8f15-446a-8dcb-da1c171f7b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:13.770928 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46b505-8f15-446a-8dcb-da1c171f7b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:13.773647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46b505-8f15-446a-8dcb-da1c171f7b92 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:13.825596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e94d6-27d0-458e-9eb4-062009a9d280 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:13.827587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 908/1812] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:13 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:13.834548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46b505-8f15-446a-8dcb-da1c171f7b92 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:13.871881 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e94d6-27d0-458e-9eb4-062009a9d280 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:13.946473 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46b505-8f15-446a-8dcb-da1c171f7b92 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:13.958628 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead65094-1e01-4ef3-8ead-b012b83c2ed2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:13.959507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead65094-1e01-4ef3-8ead-b012b83c2ed2 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:13.959909 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead65094-1e01-4ef3-8ead-b012b83c2ed2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:13.960159 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead65094-1e01-4ef3-8ead-b012b83c2ed2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:14.033894 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5457f8f-7197-4680-91d9-e40ac19c056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:14.035221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5457f8f-7197-4680-91d9-e40ac19c056d admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:14.035948 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5457f8f-7197-4680-91d9-e40ac19c056d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:14.036437 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5457f8f-7197-4680-91d9-e40ac19c056d admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:14.037625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5457f8f-7197-4680-91d9-e40ac19c056d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:14.055884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5457f8f-7197-4680-91d9-e40ac19c056d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:14.087326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:14.112887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 905/1813] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:13 2022] POST /identity/v3/users => generated 296 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:14.118887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5457f8f-7197-4680-91d9-e40ac19c056d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:14.171776 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead65094-1e01-4ef3-8ead-b012b83c2ed2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:14.173244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead65094-1e01-4ef3-8ead-b012b83c2ed2 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:14.173795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5457f8f-7197-4680-91d9-e40ac19c056d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:14.185217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03324e-9d25-4028-b125-c9a32008622b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:14.186547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03324e-9d25-4028-b125-c9a32008622b admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:14.187300 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03324e-9d25-4028-b125-c9a32008622b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:14.188290 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03324e-9d25-4028-b125-c9a32008622b admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:14.189664 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03324e-9d25-4028-b125-c9a32008622b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:14.192589 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03324e-9d25-4028-b125-c9a32008622b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:14.217335 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 906/1814] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:14.217335 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03324e-9d25-4028-b125-c9a32008622b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:14.218117 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 909/1815] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:35:14.234937 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03324e-9d25-4028-b125-c9a32008622b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:14.253285 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead65094-1e01-4ef3-8ead-b012b83c2ed2 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:14.257662 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dc923-d1bd-4d74-a691-4509ad52d16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:14.258535 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dc923-d1bd-4d74-a691-4509ad52d16d admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:14.258856 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dc923-d1bd-4d74-a691-4509ad52d16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:14.259160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004dc923-d1bd-4d74-a691-4509ad52d16d admin admin] PATH_INFO: `/v3/projects/ba1311bd66884dfb915018ec198a716e/users/c57cd9a0bb224e52b6f381aa35c5dc16/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:14.265690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead65094-1e01-4ef3-8ead-b012b83c2ed2 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:14.276146 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d91bc4-83a0-4cef-97dd-0b202553a3aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:14.276909 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d91bc4-83a0-4cef-97dd-0b202553a3aa service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:14.277201 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d91bc4-83a0-4cef-97dd-0b202553a3aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:14.277551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d91bc4-83a0-4cef-97dd-0b202553a3aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:14.308387 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004dc923-d1bd-4d74-a691-4509ad52d16d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1311bd66884dfb915018ec198a716e, user_id=c57cd9a0bb224e52b6f381aa35c5dc16, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:14.311294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004dc923-d1bd-4d74-a691-4509ad52d16d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:14.335043 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 907/1816] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:14 2022] PUT /identity/v3/projects/ba1311bd66884dfb915018ec198a716e/users/c57cd9a0bb224e52b6f381aa35c5dc16/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:35:14.341095 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dc923-d1bd-4d74-a691-4509ad52d16d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:14.346899 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d91bc4-83a0-4cef-97dd-0b202553a3aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:14.349746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d91bc4-83a0-4cef-97dd-0b202553a3aa service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:14.374677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 910/1817] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:14 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:35:14.499934 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004dc923-d1bd-4d74-a691-4509ad52d16d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:14.513727 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297b9c3-cade-4c70-a752-cc55ee62da86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:14.514690 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b9c3-cade-4c70-a752-cc55ee62da86 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:14.515849 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b9c3-cade-4c70-a752-cc55ee62da86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:14.516929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b9c3-cade-4c70-a752-cc55ee62da86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:14.520396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297b9c3-cade-4c70-a752-cc55ee62da86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:14.524440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297b9c3-cade-4c70-a752-cc55ee62da86 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:14.532202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d91bc4-83a0-4cef-97dd-0b202553a3aa service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:14.541792 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d91bc4-83a0-4cef-97dd-0b202553a3aa service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:14.551730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 908/1818] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:14.556300 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297b9c3-cade-4c70-a752-cc55ee62da86 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:14.575572 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297b9c3-cade-4c70-a752-cc55ee62da86 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:14.582336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd2020-4b35-4df5-926c-94921aea83ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:14.584972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd2020-4b35-4df5-926c-94921aea83ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:14.584972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd2020-4b35-4df5-926c-94921aea83ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:14.585170 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd2020-4b35-4df5-926c-94921aea83ba admin admin] PATH_INFO: `/v3/projects/ba1311bd66884dfb915018ec198a716e/users/c57cd9a0bb224e52b6f381aa35c5dc16/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:14.587444 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd2020-4b35-4df5-926c-94921aea83ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1311bd66884dfb915018ec198a716e, user_id=c57cd9a0bb224e52b6f381aa35c5dc16, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:14.591771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd2020-4b35-4df5-926c-94921aea83ba admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:14.605953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfd86-313e-4e55-b03b-d88ad3cc13a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:14.606524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 909/1819] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:14 2022] PUT /identity/v3/projects/ba1311bd66884dfb915018ec198a716e/users/c57cd9a0bb224e52b6f381aa35c5dc16/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:14.616919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfd86-313e-4e55-b03b-d88ad3cc13a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:14.617223 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfd86-313e-4e55-b03b-d88ad3cc13a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:14.617563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfd86-313e-4e55-b03b-d88ad3cc13a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:14.621039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212e830-73dd-46ae-8c3a-19958d89ce09 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:14.621814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212e830-73dd-46ae-8c3a-19958d89ce09 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:14.623353 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212e830-73dd-46ae-8c3a-19958d89ce09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:14.647603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:14.672795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b212e830-73dd-46ae-8c3a-19958d89ce09 None None] MFA Rules not processed for user `c57cd9a0bb224e52b6f381aa35c5dc16`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:14.674687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b212e830-73dd-46ae-8c3a-19958d89ce09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:14.681607 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bfd86-313e-4e55-b03b-d88ad3cc13a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:14.683079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bfd86-313e-4e55-b03b-d88ad3cc13a5 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:14.705781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 911/1820] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:14.825442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 910/1821] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:14.947519 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfd86-313e-4e55-b03b-d88ad3cc13a5 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:14.960065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfd86-313e-4e55-b03b-d88ad3cc13a5 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:15.003661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:15.058607 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe1c3-ac30-4ba8-9751-77f52b4e319d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:15.059778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe1c3-ac30-4ba8-9751-77f52b4e319d service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:15.060215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe1c3-ac30-4ba8-9751-77f52b4e319d service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:15.060846 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe1c3-ac30-4ba8-9751-77f52b4e319d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:15.150709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fe1c3-ac30-4ba8-9751-77f52b4e319d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:15.152255 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fe1c3-ac30-4ba8-9751-77f52b4e319d service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:15.163378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 912/1822] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:15.461015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212e830-73dd-46ae-8c3a-19958d89ce09 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:15.568205 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212e830-73dd-46ae-8c3a-19958d89ce09 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:15.574698 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a02f3-07b0-4b4e-b465-084447994416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:15.575747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a02f3-07b0-4b4e-b465-084447994416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:15.576085 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a02f3-07b0-4b4e-b465-084447994416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:15.576363 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a02f3-07b0-4b4e-b465-084447994416 admin admin] PATH_INFO: `/v3/users/aa07c20aa2de4d21bb6c09465fc2b5b6` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:15.577749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a02f3-07b0-4b4e-b465-084447994416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa07c20aa2de4d21bb6c09465fc2b5b6)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:15.581210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a02f3-07b0-4b4e-b465-084447994416 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:15.658556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5e7a02f3-07b0-4b4e-b465-084447994416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa07c20aa2de4d21bb6c09465fc2b5b6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:15.667716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5e7a02f3-07b0-4b4e-b465-084447994416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa07c20aa2de4d21bb6c09465fc2b5b6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:15.669239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5e7a02f3-07b0-4b4e-b465-084447994416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa07c20aa2de4d21bb6c09465fc2b5b6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:15.670062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5e7a02f3-07b0-4b4e-b465-084447994416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa07c20aa2de4d21bb6c09465fc2b5b6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:15.686792 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5e7a02f3-07b0-4b4e-b465-084447994416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa07c20aa2de4d21bb6c09465fc2b5b6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:15.704866 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 911/1823] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:15 2022] DELETE /identity/v3/users/aa07c20aa2de4d21bb6c09465fc2b5b6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:15.711122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e9ef-beb3-4a1a-ba32-8c99979cd2ec None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:15.711768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e9ef-beb3-4a1a-ba32-8c99979cd2ec None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:15.711768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e9ef-beb3-4a1a-ba32-8c99979cd2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:15.731934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c065e9ef-beb3-4a1a-ba32-8c99979cd2ec None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:15.733696 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c065e9ef-beb3-4a1a-ba32-8c99979cd2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:15.813705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 913/1824] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:15.824182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a02f3-07b0-4b4e-b465-084447994416 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:15.825624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5e7a02f3-07b0-4b4e-b465-084447994416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:15.839019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:15.890379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a02f3-07b0-4b4e-b465-084447994416 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:15.894512 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa64ce9-4702-40f0-aaf8-39adf3597e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:15.895184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa64ce9-4702-40f0-aaf8-39adf3597e8a service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:15.895474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa64ce9-4702-40f0-aaf8-39adf3597e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:15.895759 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa64ce9-4702-40f0-aaf8-39adf3597e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:15.907685 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa64ce9-4702-40f0-aaf8-39adf3597e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:15.909468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa64ce9-4702-40f0-aaf8-39adf3597e8a service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:15.922407 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 912/1825] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:16.377674 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065e9ef-beb3-4a1a-ba32-8c99979cd2ec None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:16.379177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c065e9ef-beb3-4a1a-ba32-8c99979cd2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:16.391179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065e9ef-beb3-4a1a-ba32-8c99979cd2ec None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:16.397994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c956ebf-4b50-44ae-ad44-196d158e969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:16.398887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c956ebf-4b50-44ae-ad44-196d158e969d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:16.399215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c956ebf-4b50-44ae-ad44-196d158e969d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:16.399489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c956ebf-4b50-44ae-ad44-196d158e969d admin admin] PATH_INFO: `/v3/projects/028114068076491abca6ac3655ac950c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:16.400904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c956ebf-4b50-44ae-ad44-196d158e969d admin admin] RBAC: Authorizing `identity:delete_project(project_id=028114068076491abca6ac3655ac950c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:16.403734 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c956ebf-4b50-44ae-ad44-196d158e969d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:16.483752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0c956ebf-4b50-44ae-ad44-196d158e969d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028114068076491abca6ac3655ac950c', 'request_id': 'req-0c956ebf-4b50-44ae-ad44-196d158e969d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:16.492316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0c956ebf-4b50-44ae-ad44-196d158e969d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028114068076491abca6ac3655ac950c', 'request_id': 'req-0c956ebf-4b50-44ae-ad44-196d158e969d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:16.499891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0c956ebf-4b50-44ae-ad44-196d158e969d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028114068076491abca6ac3655ac950c', 'request_id': 'req-0c956ebf-4b50-44ae-ad44-196d158e969d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:16.503791 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:16.515339 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0c956ebf-4b50-44ae-ad44-196d158e969d admin admin] The token cache is being invalidate because project 028114068076491abca6ac3655ac950c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:16.515454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0c956ebf-4b50-44ae-ad44-196d158e969d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:16.516269 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0c956ebf-4b50-44ae-ad44-196d158e969d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:16.520078 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 914/1826] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:16 2022] DELETE /identity/v3/projects/028114068076491abca6ac3655ac950c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:16.524162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa64ce9-4702-40f0-aaf8-39adf3597e8a service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:16.554443 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa64ce9-4702-40f0-aaf8-39adf3597e8a service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:16.642172 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc91f6-1323-4287-8374-d498cb3867c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:16.643685 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc91f6-1323-4287-8374-d498cb3867c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:16.644676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc91f6-1323-4287-8374-d498cb3867c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:16.645005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc91f6-1323-4287-8374-d498cb3867c7 admin admin] PATH_INFO: `/v3/users/f97a71aabf16454aaa1a15b72f43648d` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:16.649831 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc91f6-1323-4287-8374-d498cb3867c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f97a71aabf16454aaa1a15b72f43648d)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:16.653103 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc91f6-1323-4287-8374-d498cb3867c7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:16.744885 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dafc91f6-1323-4287-8374-d498cb3867c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f97a71aabf16454aaa1a15b72f43648d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:16.767206 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dafc91f6-1323-4287-8374-d498cb3867c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f97a71aabf16454aaa1a15b72f43648d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:16.768105 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dafc91f6-1323-4287-8374-d498cb3867c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f97a71aabf16454aaa1a15b72f43648d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:16.768925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dafc91f6-1323-4287-8374-d498cb3867c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f97a71aabf16454aaa1a15b72f43648d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:16.787937 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dafc91f6-1323-4287-8374-d498cb3867c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f97a71aabf16454aaa1a15b72f43648d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:16.806285 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 913/1827] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:16 2022] DELETE /identity/v3/users/f97a71aabf16454aaa1a15b72f43648d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:16.875568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c956ebf-4b50-44ae-ad44-196d158e969d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:16.877326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0c956ebf-4b50-44ae-ad44-196d158e969d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:16.970233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c956ebf-4b50-44ae-ad44-196d158e969d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:17.087483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeac79b-8ff9-4d73-9fa1-386e7f53ed60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:17.091532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeac79b-8ff9-4d73-9fa1-386e7f53ed60 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:17.091824 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeac79b-8ff9-4d73-9fa1-386e7f53ed60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:17.092106 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeac79b-8ff9-4d73-9fa1-386e7f53ed60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:17.101757 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bdeac79b-8ff9-4d73-9fa1-386e7f53ed60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:17.212755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc91f6-1323-4287-8374-d498cb3867c7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:17.214458 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-dafc91f6-1323-4287-8374-d498cb3867c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:17.233176 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc91f6-1323-4287-8374-d498cb3867c7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:17.246228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2996419-f8d0-4a94-b3c1-1978d1f49d10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:17.246911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2996419-f8d0-4a94-b3c1-1978d1f49d10 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:17.247275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2996419-f8d0-4a94-b3c1-1978d1f49d10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:17.247551 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2996419-f8d0-4a94-b3c1-1978d1f49d10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:17.248736 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeac79b-8ff9-4d73-9fa1-386e7f53ed60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:17.250860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeac79b-8ff9-4d73-9fa1-386e7f53ed60 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:17.261442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e2996419-f8d0-4a94-b3c1-1978d1f49d10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:17.297566 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 915/1828] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:17.301276 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeac79b-8ff9-4d73-9fa1-386e7f53ed60 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:17.302712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bdeac79b-8ff9-4d73-9fa1-386e7f53ed60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:17.318565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:17.396189 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2996419-f8d0-4a94-b3c1-1978d1f49d10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:17.399841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2996419-f8d0-4a94-b3c1-1978d1f49d10 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:17.434418 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeac79b-8ff9-4d73-9fa1-386e7f53ed60 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:17.440174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 914/1829] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:17.441753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72aa97-0328-400c-86d4-d88e00f30cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:17.443368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72aa97-0328-400c-86d4-d88e00f30cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:17.443845 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72aa97-0328-400c-86d4-d88e00f30cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:17.444265 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72aa97-0328-400c-86d4-d88e00f30cf9 admin admin] PATH_INFO: `/v3/projects/6828794cd55f4c4cb68085233d1496b3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:17.446920 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72aa97-0328-400c-86d4-d88e00f30cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6828794cd55f4c4cb68085233d1496b3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:17.449221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72aa97-0328-400c-86d4-d88e00f30cf9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:17.452448 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:17.584192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1b72aa97-0328-400c-86d4-d88e00f30cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6828794cd55f4c4cb68085233d1496b3', 'request_id': 'req-1b72aa97-0328-400c-86d4-d88e00f30cf9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:17.598814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1b72aa97-0328-400c-86d4-d88e00f30cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6828794cd55f4c4cb68085233d1496b3', 'request_id': 'req-1b72aa97-0328-400c-86d4-d88e00f30cf9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:17.607565 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1b72aa97-0328-400c-86d4-d88e00f30cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6828794cd55f4c4cb68085233d1496b3', 'request_id': 'req-1b72aa97-0328-400c-86d4-d88e00f30cf9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:17.639630 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1b72aa97-0328-400c-86d4-d88e00f30cf9 admin admin] The token cache is being invalidate because project 6828794cd55f4c4cb68085233d1496b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:17.640256 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1b72aa97-0328-400c-86d4-d88e00f30cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:17.642818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1b72aa97-0328-400c-86d4-d88e00f30cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:17.645240 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 916/1830] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:17 2022] DELETE /identity/v3/projects/6828794cd55f4c4cb68085233d1496b3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:17.651467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92283fbe-00c0-4e32-953c-1ca140e87fcf None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:17.651887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92283fbe-00c0-4e32-953c-1ca140e87fcf None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:17.651887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92283fbe-00c0-4e32-953c-1ca140e87fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:17.676585 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-92283fbe-00c0-4e32-953c-1ca140e87fcf None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:17.678644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-92283fbe-00c0-4e32-953c-1ca140e87fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:17.845377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 915/1831] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:17.858359 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583019a-e57e-41c7-8eb4-a1ec1baae55b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:17.858665 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583019a-e57e-41c7-8eb4-a1ec1baae55b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:17.858956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583019a-e57e-41c7-8eb4-a1ec1baae55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:17.896973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d583019a-e57e-41c7-8eb4-a1ec1baae55b None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:17.897979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d583019a-e57e-41c7-8eb4-a1ec1baae55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:17.918723 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 917/1832] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:17.924730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92283fbe-00c0-4e32-953c-1ca140e87fcf None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:17.940079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92283fbe-00c0-4e32-953c-1ca140e87fcf None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:17.945770 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97931a89-e392-4df5-9aea-1873fb69b9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:17.946726 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97931a89-e392-4df5-9aea-1873fb69b9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:17.947081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97931a89-e392-4df5-9aea-1873fb69b9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:17.947608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97931a89-e392-4df5-9aea-1873fb69b9d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:17.948548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97931a89-e392-4df5-9aea-1873fb69b9d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:17.948956 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97931a89-e392-4df5-9aea-1873fb69b9d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:17.950687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97931a89-e392-4df5-9aea-1873fb69b9d7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:17.977756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 916/1833] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:17.982339 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583019a-e57e-41c7-8eb4-a1ec1baae55b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:17.998387 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583019a-e57e-41c7-8eb4-a1ec1baae55b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:18.004535 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6cc32-aaaf-4533-98c2-aae7f454f608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:18.005391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6cc32-aaaf-4533-98c2-aae7f454f608 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:18.005979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6cc32-aaaf-4533-98c2-aae7f454f608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:18.006436 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6cc32-aaaf-4533-98c2-aae7f454f608 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:18.007286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6cc32-aaaf-4533-98c2-aae7f454f608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:18.009278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6cc32-aaaf-4533-98c2-aae7f454f608 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:18.057783 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 918/1834] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:17 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:18.066691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97931a89-e392-4df5-9aea-1873fb69b9d7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:18.077245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97931a89-e392-4df5-9aea-1873fb69b9d7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:18.177219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf414-29ef-4b71-8d87-421a93ce2e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:18.178221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf414-29ef-4b71-8d87-421a93ce2e15 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:18.178533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf414-29ef-4b71-8d87-421a93ce2e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:18.178929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf414-29ef-4b71-8d87-421a93ce2e15 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:18.179710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edf414-29ef-4b71-8d87-421a93ce2e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:18.183140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edf414-29ef-4b71-8d87-421a93ce2e15 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:18.210790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 917/1835] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:18 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:18.214773 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6cc32-aaaf-4533-98c2-aae7f454f608 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:18.238490 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6cc32-aaaf-4533-98c2-aae7f454f608 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:18.252409 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d94d7-33da-464e-bbdb-4ec70c9c1966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:18.253575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d94d7-33da-464e-bbdb-4ec70c9c1966 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:18.253998 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d94d7-33da-464e-bbdb-4ec70c9c1966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:18.254331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d94d7-33da-464e-bbdb-4ec70c9c1966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:18.255168 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d94d7-33da-464e-bbdb-4ec70c9c1966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:18.257115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d94d7-33da-464e-bbdb-4ec70c9c1966 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:18.287027 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 919/1836] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:18.288812 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf414-29ef-4b71-8d87-421a93ce2e15 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:18.302060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf414-29ef-4b71-8d87-421a93ce2e15 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:18.312790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e7052-6e58-44bf-8842-adb77aec567a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:18.314651 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7052-6e58-44bf-8842-adb77aec567a admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:18.314969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7052-6e58-44bf-8842-adb77aec567a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:18.315254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e7052-6e58-44bf-8842-adb77aec567a admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:18.318113 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e7052-6e58-44bf-8842-adb77aec567a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:18.320050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e7052-6e58-44bf-8842-adb77aec567a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:18.336458 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 918/1837] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:18.337736 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d94d7-33da-464e-bbdb-4ec70c9c1966 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:18.349759 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d94d7-33da-464e-bbdb-4ec70c9c1966 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:18.355322 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2243db-9c29-47ec-890c-7c9e0f99c665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:18.356558 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2243db-9c29-47ec-890c-7c9e0f99c665 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:18.356843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2243db-9c29-47ec-890c-7c9e0f99c665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:18.357124 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2243db-9c29-47ec-890c-7c9e0f99c665 admin admin] PATH_INFO: `/v3/projects/cdc969a4c045472fbe5f34b88acf08c0/users/1ae3dbe1676d4acd98f5326b11560c94/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:18.401096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2243db-9c29-47ec-890c-7c9e0f99c665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc969a4c045472fbe5f34b88acf08c0, user_id=1ae3dbe1676d4acd98f5326b11560c94, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:18.408509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2243db-9c29-47ec-890c-7c9e0f99c665 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:18.428195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 920/1838] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:18 2022] PUT /identity/v3/projects/cdc969a4c045472fbe5f34b88acf08c0/users/1ae3dbe1676d4acd98f5326b11560c94/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:18.439618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f807da-4418-41a2-b0fb-af08b8c93f42 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:18.440011 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f807da-4418-41a2-b0fb-af08b8c93f42 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:18.440449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f807da-4418-41a2-b0fb-af08b8c93f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:18.476646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-94f807da-4418-41a2-b0fb-af08b8c93f42 None None] MFA Rules not processed for user `1ae3dbe1676d4acd98f5326b11560c94`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:18.477745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-94f807da-4418-41a2-b0fb-af08b8c93f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:18.519673 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:18.574562 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 919/1839] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:18.578936 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2243db-9c29-47ec-890c-7c9e0f99c665 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:18.678944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2243db-9c29-47ec-890c-7c9e0f99c665 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:18.691803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc461c-1f1a-4db8-b27c-1cbd9a8d819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:18.692591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc461c-1f1a-4db8-b27c-1cbd9a8d819f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:18.692879 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc461c-1f1a-4db8-b27c-1cbd9a8d819f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:18.693500 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc461c-1f1a-4db8-b27c-1cbd9a8d819f admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:18.694233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc461c-1f1a-4db8-b27c-1cbd9a8d819f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:18.696654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc461c-1f1a-4db8-b27c-1cbd9a8d819f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:18.745830 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 921/1840] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:18 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:35:18.754654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f807da-4418-41a2-b0fb-af08b8c93f42 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:18.779468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f807da-4418-41a2-b0fb-af08b8c93f42 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:18.942525 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bead5fc-b9ab-423f-ba79-9ca28c814846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:18.943296 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bead5fc-b9ab-423f-ba79-9ca28c814846 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:18.943588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bead5fc-b9ab-423f-ba79-9ca28c814846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:18.943916 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bead5fc-b9ab-423f-ba79-9ca28c814846 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:18.944638 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bead5fc-b9ab-423f-ba79-9ca28c814846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:18.946718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bead5fc-b9ab-423f-ba79-9ca28c814846 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:18.988573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 920/1841] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:18 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:35:18.992366 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc461c-1f1a-4db8-b27c-1cbd9a8d819f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:19.016766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc461c-1f1a-4db8-b27c-1cbd9a8d819f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:19.028423 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d962aa-a674-4479-b61d-1cdebd61d779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:19.029127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d962aa-a674-4479-b61d-1cdebd61d779 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:19.029439 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d962aa-a674-4479-b61d-1cdebd61d779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:19.030293 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d962aa-a674-4479-b61d-1cdebd61d779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:19.031046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d962aa-a674-4479-b61d-1cdebd61d779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:19.032917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d962aa-a674-4479-b61d-1cdebd61d779 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:19.046858 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 922/1842] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:35:19.051138 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bead5fc-b9ab-423f-ba79-9ca28c814846 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:19.074730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bead5fc-b9ab-423f-ba79-9ca28c814846 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:19.088734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef78196-af8f-4934-905f-0bdfb211ea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:19.091062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef78196-af8f-4934-905f-0bdfb211ea06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:19.091556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef78196-af8f-4934-905f-0bdfb211ea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:19.091862 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef78196-af8f-4934-905f-0bdfb211ea06 admin admin] PATH_INFO: `/v3/projects/4dc2f993c66a4a468644cff4abf51d49/users/955e9795993e46d38de51592602737b3/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:19.113230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef78196-af8f-4934-905f-0bdfb211ea06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc2f993c66a4a468644cff4abf51d49, user_id=955e9795993e46d38de51592602737b3, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:19.116681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef78196-af8f-4934-905f-0bdfb211ea06 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:19.135854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 921/1843] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:19 2022] PUT /identity/v3/projects/4dc2f993c66a4a468644cff4abf51d49/users/955e9795993e46d38de51592602737b3/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:19.149107 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d962aa-a674-4479-b61d-1cdebd61d779 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:19.155564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:19.162551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d962aa-a674-4479-b61d-1cdebd61d779 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:19.278656 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c8160-4438-42b9-9db9-8300b42acb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:19.279357 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c8160-4438-42b9-9db9-8300b42acb54 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:19.279652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c8160-4438-42b9-9db9-8300b42acb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:19.279924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c8160-4438-42b9-9db9-8300b42acb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:19.280693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c8160-4438-42b9-9db9-8300b42acb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:19.282479 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c8160-4438-42b9-9db9-8300b42acb54 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:19.295071 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 923/1844] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:19.301862 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef78196-af8f-4934-905f-0bdfb211ea06 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:19.315264 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef78196-af8f-4934-905f-0bdfb211ea06 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:19.320903 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc4290-05fd-4fc2-b67a-de25569d3f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:19.321979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4290-05fd-4fc2-b67a-de25569d3f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:19.322263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4290-05fd-4fc2-b67a-de25569d3f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:19.322556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4290-05fd-4fc2-b67a-de25569d3f0f admin admin] PATH_INFO: `/v3/projects/4dc2f993c66a4a468644cff4abf51d49/users/955e9795993e46d38de51592602737b3/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:19.324675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc4290-05fd-4fc2-b67a-de25569d3f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc2f993c66a4a468644cff4abf51d49, user_id=955e9795993e46d38de51592602737b3, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:19.327506 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc4290-05fd-4fc2-b67a-de25569d3f0f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:19.346573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 922/1845] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:19 2022] PUT /identity/v3/projects/4dc2f993c66a4a468644cff4abf51d49/users/955e9795993e46d38de51592602737b3/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:19.358254 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f026a-90fc-48a5-8bdb-3e58e3a934c3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:19.358548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f026a-90fc-48a5-8bdb-3e58e3a934c3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:19.358831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f026a-90fc-48a5-8bdb-3e58e3a934c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:19.391013 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-bc1f026a-90fc-48a5-8bdb-3e58e3a934c3 None None] MFA Rules not processed for user `955e9795993e46d38de51592602737b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:19.393716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bc1f026a-90fc-48a5-8bdb-3e58e3a934c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:19.488174 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 924/1846] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:19.554183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc4290-05fd-4fc2-b67a-de25569d3f0f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:19.556145 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6abc4290-05fd-4fc2-b67a-de25569d3f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:19.622849 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc4290-05fd-4fc2-b67a-de25569d3f0f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:19.626484 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c0744-a6be-4193-89aa-09c62edf7aef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:19.627161 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c0744-a6be-4193-89aa-09c62edf7aef service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:19.627448 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c0744-a6be-4193-89aa-09c62edf7aef service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:19.627734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c0744-a6be-4193-89aa-09c62edf7aef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:19.648399 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c0744-a6be-4193-89aa-09c62edf7aef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:19.649976 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c0744-a6be-4193-89aa-09c62edf7aef service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:19.661406 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 923/1847] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:20.263070 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f026a-90fc-48a5-8bdb-3e58e3a934c3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:20.273959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f026a-90fc-48a5-8bdb-3e58e3a934c3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:20.286675 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7276e10-c6b5-41fc-bf86-d6bc0729ecfc tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955e9795993e46d38de51592602737b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc2f993c66a4a468644cff4abf51d49', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:20.287962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7276e10-c6b5-41fc-bf86-d6bc0729ecfc tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:20.288242 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7276e10-c6b5-41fc-bf86-d6bc0729ecfc tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:20.288662 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7276e10-c6b5-41fc-bf86-d6bc0729ecfc tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:20.289986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7276e10-c6b5-41fc-bf86-d6bc0729ecfc tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:20.291555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7276e10-c6b5-41fc-bf86-d6bc0729ecfc tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:20.294839 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7276e10-c6b5-41fc-bf86-d6bc0729ecfc tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:20.308770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 925/1848] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:35:20.312620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c0744-a6be-4193-89aa-09c62edf7aef service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:20.321931 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c0744-a6be-4193-89aa-09c62edf7aef service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:20.326755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2cdd6-9fa6-4d2d-b88e-3fe8bdb9d7b0 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955e9795993e46d38de51592602737b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc2f993c66a4a468644cff4abf51d49', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:20.327544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2cdd6-9fa6-4d2d-b88e-3fe8bdb9d7b0 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:20.327839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2cdd6-9fa6-4d2d-b88e-3fe8bdb9d7b0 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:20.328121 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2cdd6-9fa6-4d2d-b88e-3fe8bdb9d7b0 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:20.328830 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2cdd6-9fa6-4d2d-b88e-3fe8bdb9d7b0 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:20.330747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2cdd6-9fa6-4d2d-b88e-3fe8bdb9d7b0 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:20.351221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:20.366292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 924/1849] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:20 2022] POST /identity/v3/projects => generated 354 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:20.371610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7276e10-c6b5-41fc-bf86-d6bc0729ecfc tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:20.382389 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7276e10-c6b5-41fc-bf86-d6bc0729ecfc tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:20.450784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dc1c3-3cff-48f0-8cd6-8ece2545f279 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955e9795993e46d38de51592602737b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc2f993c66a4a468644cff4abf51d49', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:20.451449 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dc1c3-3cff-48f0-8cd6-8ece2545f279 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:20.451756 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dc1c3-3cff-48f0-8cd6-8ece2545f279 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:20.452136 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dc1c3-3cff-48f0-8cd6-8ece2545f279 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:20.452879 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dc1c3-3cff-48f0-8cd6-8ece2545f279 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:20.453227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dc1c3-3cff-48f0-8cd6-8ece2545f279 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:20.454938 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97dc1c3-3cff-48f0-8cd6-8ece2545f279 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:20.469368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 926/1850] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:20.511118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2cdd6-9fa6-4d2d-b88e-3fe8bdb9d7b0 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:20.522166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2cdd6-9fa6-4d2d-b88e-3fe8bdb9d7b0 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:20.528139 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31804421-e0f8-4d78-9226-cd90ef8cbbf5 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '955e9795993e46d38de51592602737b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc2f993c66a4a468644cff4abf51d49', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:20.529236 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31804421-e0f8-4d78-9226-cd90ef8cbbf5 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:20.529568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31804421-e0f8-4d78-9226-cd90ef8cbbf5 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:20.530032 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31804421-e0f8-4d78-9226-cd90ef8cbbf5 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] PATH_INFO: `/v3/projects/11076db1d2a54750a927d905c8c03229` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:20.531691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31804421-e0f8-4d78-9226-cd90ef8cbbf5 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] RBAC: Authorizing `identity:delete_project(project_id=11076db1d2a54750a927d905c8c03229)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:20.533663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31804421-e0f8-4d78-9226-cd90ef8cbbf5 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:20.588062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-31804421-e0f8-4d78-9226-cd90ef8cbbf5 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11076db1d2a54750a927d905c8c03229', 'request_id': 'req-31804421-e0f8-4d78-9226-cd90ef8cbbf5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:20.594058 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-31804421-e0f8-4d78-9226-cd90ef8cbbf5 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11076db1d2a54750a927d905c8c03229', 'request_id': 'req-31804421-e0f8-4d78-9226-cd90ef8cbbf5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:20.600616 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-31804421-e0f8-4d78-9226-cd90ef8cbbf5 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11076db1d2a54750a927d905c8c03229', 'request_id': 'req-31804421-e0f8-4d78-9226-cd90ef8cbbf5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:20.613479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-31804421-e0f8-4d78-9226-cd90ef8cbbf5 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] The token cache is being invalidate because project 11076db1d2a54750a927d905c8c03229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:20.613700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-31804421-e0f8-4d78-9226-cd90ef8cbbf5 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:20.614331 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-31804421-e0f8-4d78-9226-cd90ef8cbbf5 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:20.615965 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 925/1851] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:20 2022] DELETE /identity/v3/projects/11076db1d2a54750a927d905c8c03229 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:20.835990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dc1c3-3cff-48f0-8cd6-8ece2545f279 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:20.837932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f97dc1c3-3cff-48f0-8cd6-8ece2545f279 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:20.847202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:20.946372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dc1c3-3cff-48f0-8cd6-8ece2545f279 tempest-VolumeQuotaClassesTest-1758264021 tempest-VolumeQuotaClassesTest-1758264021-project-admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:21.092434 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9c829-f18c-4f48-8354-b5baedc1fbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:21.096761 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9c829-f18c-4f48-8354-b5baedc1fbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:21.096761 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9c829-f18c-4f48-8354-b5baedc1fbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:21.096761 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9c829-f18c-4f48-8354-b5baedc1fbbf admin admin] PATH_INFO: `/v3/users/1ae3dbe1676d4acd98f5326b11560c94` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:21.098052 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9c829-f18c-4f48-8354-b5baedc1fbbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae3dbe1676d4acd98f5326b11560c94)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:21.100470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9c829-f18c-4f48-8354-b5baedc1fbbf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:21.162353 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97551952-4987-4f95-9a67-434d768aa063 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:21.162640 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97551952-4987-4f95-9a67-434d768aa063 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:21.162923 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97551952-4987-4f95-9a67-434d768aa063 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:21.165428 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 926/1852] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 15 00:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:35:21.175939 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265346a6-e5fb-445e-ae13-39c00fa6d49e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:21.175939 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265346a6-e5fb-445e-ae13-39c00fa6d49e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:21.175939 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265346a6-e5fb-445e-ae13-39c00fa6d49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:21.201220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8ba9c829-f18c-4f48-8354-b5baedc1fbbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae3dbe1676d4acd98f5326b11560c94'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:21.227455 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8ba9c829-f18c-4f48-8354-b5baedc1fbbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae3dbe1676d4acd98f5326b11560c94'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:21.228139 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8ba9c829-f18c-4f48-8354-b5baedc1fbbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae3dbe1676d4acd98f5326b11560c94'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:21.228276 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-265346a6-e5fb-445e-ae13-39c00fa6d49e None None] MFA Rules not processed for user `6d0ae1707c7041a0989889dbefeaf267`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:21.228949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8ba9c829-f18c-4f48-8354-b5baedc1fbbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae3dbe1676d4acd98f5326b11560c94'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:21.233761 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-265346a6-e5fb-445e-ae13-39c00fa6d49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:21.258171 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8ba9c829-f18c-4f48-8354-b5baedc1fbbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae3dbe1676d4acd98f5326b11560c94'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:21.282818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 927/1853] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:20 2022] DELETE /identity/v3/users/1ae3dbe1676d4acd98f5326b11560c94 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:21.305727 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1670a-eafe-478a-b226-834a788e2f73 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:21.305968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1670a-eafe-478a-b226-834a788e2f73 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:21.306208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1670a-eafe-478a-b226-834a788e2f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:21.343412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c9f1670a-eafe-478a-b226-834a788e2f73 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:21.344650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c9f1670a-eafe-478a-b226-834a788e2f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:21.387495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 927/1854] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 15 00:35:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:35:21.399594 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:21.408241 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265346a6-e5fb-445e-ae13-39c00fa6d49e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:21.411241 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-265346a6-e5fb-445e-ae13-39c00fa6d49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:21.439030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265346a6-e5fb-445e-ae13-39c00fa6d49e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:21.454172 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 928/1855] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:21.471255 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1670a-eafe-478a-b226-834a788e2f73 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:21.475186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c9f1670a-eafe-478a-b226-834a788e2f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:21.554990 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5e043-a90a-49e6-99d6-d1b513577ef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:21.559523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5e043-a90a-49e6-99d6-d1b513577ef9 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:21.559960 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5e043-a90a-49e6-99d6-d1b513577ef9 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:21.560380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5e043-a90a-49e6-99d6-d1b513577ef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:21.577294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:21.585293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5e043-a90a-49e6-99d6-d1b513577ef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:21.595588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5e043-a90a-49e6-99d6-d1b513577ef9 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:21.596975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1670a-eafe-478a-b226-834a788e2f73 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:21.601217 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecd4f9-3a3d-426b-9da0-173162c45252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:21.601863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecd4f9-3a3d-426b-9da0-173162c45252 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:21.602333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecd4f9-3a3d-426b-9da0-173162c45252 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:21.602620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecd4f9-3a3d-426b-9da0-173162c45252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:21.615959 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 928/1856] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:21.618719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecd4f9-3a3d-426b-9da0-173162c45252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:21.620456 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecd4f9-3a3d-426b-9da0-173162c45252 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:21.633649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 929/1857] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:21.967196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5e043-a90a-49e6-99d6-d1b513577ef9 service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:21.969851 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-52a5e043-a90a-49e6-99d6-d1b513577ef9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:21.987370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5e043-a90a-49e6-99d6-d1b513577ef9 service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:21.994156 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c9f71-f2f4-4571-9b60-41a059bf6ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:21.995143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c9f71-f2f4-4571-9b60-41a059bf6ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:21.995496 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c9f71-f2f4-4571-9b60-41a059bf6ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:21.995990 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c9f71-f2f4-4571-9b60-41a059bf6ae4 admin admin] PATH_INFO: `/v3/users/ee98412de2314e2dbe954922dfdaa2fb` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:21.997578 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c9f71-f2f4-4571-9b60-41a059bf6ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee98412de2314e2dbe954922dfdaa2fb)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:21.999734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c9f71-f2f4-4571-9b60-41a059bf6ae4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:22.112494 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6a2c9f71-f2f4-4571-9b60-41a059bf6ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee98412de2314e2dbe954922dfdaa2fb'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:22.130360 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6a2c9f71-f2f4-4571-9b60-41a059bf6ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee98412de2314e2dbe954922dfdaa2fb'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:22.131097 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6a2c9f71-f2f4-4571-9b60-41a059bf6ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee98412de2314e2dbe954922dfdaa2fb'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:22.131716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6a2c9f71-f2f4-4571-9b60-41a059bf6ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee98412de2314e2dbe954922dfdaa2fb'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:22.155486 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6a2c9f71-f2f4-4571-9b60-41a059bf6ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee98412de2314e2dbe954922dfdaa2fb'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:22.192806 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecd4f9-3a3d-426b-9da0-173162c45252 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:22.194294 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f5ecd4f9-3a3d-426b-9da0-173162c45252 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:22.196476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 929/1858] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:21 2022] DELETE /identity/v3/users/ee98412de2314e2dbe954922dfdaa2fb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:22.202762 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4afa1-16d6-4705-9fb7-859ffe50d436 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:22.203054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4afa1-16d6-4705-9fb7-859ffe50d436 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:22.203334 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4afa1-16d6-4705-9fb7-859ffe50d436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:22.228433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecd4f9-3a3d-426b-9da0-173162c45252 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:22.249229 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a1f4afa1-16d6-4705-9fb7-859ffe50d436 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:22.251309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a1f4afa1-16d6-4705-9fb7-859ffe50d436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:22.309434 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2776b8-80bf-4606-8afb-000e92abd911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:22.310537 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2776b8-80bf-4606-8afb-000e92abd911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:22.311893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2776b8-80bf-4606-8afb-000e92abd911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:22.312480 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2776b8-80bf-4606-8afb-000e92abd911 admin admin] PATH_INFO: `/v3/projects/cdc969a4c045472fbe5f34b88acf08c0` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:22.314459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2776b8-80bf-4606-8afb-000e92abd911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc969a4c045472fbe5f34b88acf08c0)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:22.317515 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2776b8-80bf-4606-8afb-000e92abd911 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:22.360030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 930/1859] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:22.370261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4afa1-16d6-4705-9fb7-859ffe50d436 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:22.372333 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a1f4afa1-16d6-4705-9fb7-859ffe50d436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:22.404808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-eb2776b8-80bf-4606-8afb-000e92abd911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc969a4c045472fbe5f34b88acf08c0', 'request_id': 'req-eb2776b8-80bf-4606-8afb-000e92abd911'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:22.414257 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-eb2776b8-80bf-4606-8afb-000e92abd911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc969a4c045472fbe5f34b88acf08c0', 'request_id': 'req-eb2776b8-80bf-4606-8afb-000e92abd911'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:22.421957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-eb2776b8-80bf-4606-8afb-000e92abd911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc969a4c045472fbe5f34b88acf08c0', 'request_id': 'req-eb2776b8-80bf-4606-8afb-000e92abd911'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:22.437372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-eb2776b8-80bf-4606-8afb-000e92abd911 admin admin] The token cache is being invalidate because project cdc969a4c045472fbe5f34b88acf08c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:22.437372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-eb2776b8-80bf-4606-8afb-000e92abd911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:22.438169 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-eb2776b8-80bf-4606-8afb-000e92abd911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:22.440204 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 930/1860] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:22 2022] DELETE /identity/v3/projects/cdc969a4c045472fbe5f34b88acf08c0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:35:22.443851 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2776b8-80bf-4606-8afb-000e92abd911 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:22.446202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-eb2776b8-80bf-4606-8afb-000e92abd911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:22.456982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:22.496173 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4afa1-16d6-4705-9fb7-859ffe50d436 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:22.527906 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:22.536356 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2776b8-80bf-4606-8afb-000e92abd911 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:22.546167 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96e02c-8017-40ea-9bb2-57f9d43117bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:22.548554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96e02c-8017-40ea-9bb2-57f9d43117bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:22.549695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96e02c-8017-40ea-9bb2-57f9d43117bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:22.550220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96e02c-8017-40ea-9bb2-57f9d43117bb admin admin] PATH_INFO: `/v3/users/955e9795993e46d38de51592602737b3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:22.552439 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96e02c-8017-40ea-9bb2-57f9d43117bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=955e9795993e46d38de51592602737b3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:22.556833 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96e02c-8017-40ea-9bb2-57f9d43117bb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:22.565307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71c7a7-f1da-45fa-99e3-b18a889e6093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:22.566062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c7a7-f1da-45fa-99e3-b18a889e6093 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:22.566360 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c7a7-f1da-45fa-99e3-b18a889e6093 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:22.566780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71c7a7-f1da-45fa-99e3-b18a889e6093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:22.569633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-af71c7a7-f1da-45fa-99e3-b18a889e6093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:22.587936 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71c7a7-f1da-45fa-99e3-b18a889e6093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:22.590017 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71c7a7-f1da-45fa-99e3-b18a889e6093 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:22.601531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 931/1861] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:22.631533 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3e96e02c-8017-40ea-9bb2-57f9d43117bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '955e9795993e46d38de51592602737b3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:22.641290 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3e96e02c-8017-40ea-9bb2-57f9d43117bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '955e9795993e46d38de51592602737b3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:22.642433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3e96e02c-8017-40ea-9bb2-57f9d43117bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '955e9795993e46d38de51592602737b3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:22.643981 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3e96e02c-8017-40ea-9bb2-57f9d43117bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '955e9795993e46d38de51592602737b3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:22.671766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3e96e02c-8017-40ea-9bb2-57f9d43117bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '955e9795993e46d38de51592602737b3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:22.691913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 931/1862] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:22 2022] DELETE /identity/v3/users/955e9795993e46d38de51592602737b3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:35:23.031588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71c7a7-f1da-45fa-99e3-b18a889e6093 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:23.033105 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-af71c7a7-f1da-45fa-99e3-b18a889e6093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:23.059111 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71c7a7-f1da-45fa-99e3-b18a889e6093 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:23.140175 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96e02c-8017-40ea-9bb2-57f9d43117bb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:23.140175 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3e96e02c-8017-40ea-9bb2-57f9d43117bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:23.182561 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e1838-f73f-45a7-bb45-0799162d2702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:23.183886 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e1838-f73f-45a7-bb45-0799162d2702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:23.184169 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e1838-f73f-45a7-bb45-0799162d2702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:23.184784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e1838-f73f-45a7-bb45-0799162d2702 admin admin] PATH_INFO: `/v3/projects/03309ef1ce404faca95425c0ca9138e5` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:23.186854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e1838-f73f-45a7-bb45-0799162d2702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03309ef1ce404faca95425c0ca9138e5)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:23.190343 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e1838-f73f-45a7-bb45-0799162d2702 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:23.262734 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96e02c-8017-40ea-9bb2-57f9d43117bb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:23.263857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-947e1838-f73f-45a7-bb45-0799162d2702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03309ef1ce404faca95425c0ca9138e5', 'request_id': 'req-947e1838-f73f-45a7-bb45-0799162d2702'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.270039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-947e1838-f73f-45a7-bb45-0799162d2702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03309ef1ce404faca95425c0ca9138e5', 'request_id': 'req-947e1838-f73f-45a7-bb45-0799162d2702'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.280433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-947e1838-f73f-45a7-bb45-0799162d2702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03309ef1ce404faca95425c0ca9138e5', 'request_id': 'req-947e1838-f73f-45a7-bb45-0799162d2702'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.296521 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:23.298744 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-947e1838-f73f-45a7-bb45-0799162d2702 admin admin] The token cache is being invalidate because project 03309ef1ce404faca95425c0ca9138e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:23.299071 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-947e1838-f73f-45a7-bb45-0799162d2702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.299787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-947e1838-f73f-45a7-bb45-0799162d2702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.301556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 932/1863] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:23 2022] DELETE /identity/v3/projects/03309ef1ce404faca95425c0ca9138e5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:23.302389 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e1838-f73f-45a7-bb45-0799162d2702 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:23.303753 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-947e1838-f73f-45a7-bb45-0799162d2702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:23.331809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:23.332940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:23.333302 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:23.333711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c admin admin] PATH_INFO: `/v3/projects/4dc2f993c66a4a468644cff4abf51d49` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:23.335005 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dc2f993c66a4a468644cff4abf51d49)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:23.337240 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:23.373606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:23.378084 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e1838-f73f-45a7-bb45-0799162d2702 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:23.392567 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dc2f993c66a4a468644cff4abf51d49', 'request_id': 'req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.399088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dc2f993c66a4a468644cff4abf51d49', 'request_id': 'req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.405435 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dc2f993c66a4a468644cff4abf51d49', 'request_id': 'req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.418473 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c admin admin] The token cache is being invalidate because project 4dc2f993c66a4a468644cff4abf51d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:23.418814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.419440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.421049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 932/1864] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:23 2022] DELETE /identity/v3/projects/4dc2f993c66a4a468644cff4abf51d49 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:23.424431 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:23.424431 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:23.442653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f0b9d-181b-4b6f-9f6b-f14aee4697a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:23.443601 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f0b9d-181b-4b6f-9f6b-f14aee4697a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:23.443881 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f0b9d-181b-4b6f-9f6b-f14aee4697a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:23.444157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f0b9d-181b-4b6f-9f6b-f14aee4697a3 admin admin] PATH_INFO: `/v3/users/e71e0e7e4af14ca1b1c9bc7dbe151752` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:23.445392 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f0b9d-181b-4b6f-9f6b-f14aee4697a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e71e0e7e4af14ca1b1c9bc7dbe151752)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:23.447305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f0b9d-181b-4b6f-9f6b-f14aee4697a3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:23.490604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7d581-e4e0-4836-ae16-ee9c8551d06c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:23.494312 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-545f0b9d-181b-4b6f-9f6b-f14aee4697a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e71e0e7e4af14ca1b1c9bc7dbe151752'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.496114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64e719-d2e8-4dc9-be7d-a3542ea1a062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:23.497007 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64e719-d2e8-4dc9-be7d-a3542ea1a062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:23.497283 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64e719-d2e8-4dc9-be7d-a3542ea1a062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:23.497592 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64e719-d2e8-4dc9-be7d-a3542ea1a062 admin admin] PATH_INFO: `/v3/users/cbb03f073bf348d0ac55ab0dd4689528` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:23.498924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64e719-d2e8-4dc9-be7d-a3542ea1a062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb03f073bf348d0ac55ab0dd4689528)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:23.500991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64e719-d2e8-4dc9-be7d-a3542ea1a062 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:23.502067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-545f0b9d-181b-4b6f-9f6b-f14aee4697a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e71e0e7e4af14ca1b1c9bc7dbe151752'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.502810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-545f0b9d-181b-4b6f-9f6b-f14aee4697a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e71e0e7e4af14ca1b1c9bc7dbe151752'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.503448 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-545f0b9d-181b-4b6f-9f6b-f14aee4697a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e71e0e7e4af14ca1b1c9bc7dbe151752'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.515886 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-545f0b9d-181b-4b6f-9f6b-f14aee4697a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e71e0e7e4af14ca1b1c9bc7dbe151752'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.529014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 933/1865] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:23 2022] DELETE /identity/v3/users/e71e0e7e4af14ca1b1c9bc7dbe151752 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:23.530176 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f0b9d-181b-4b6f-9f6b-f14aee4697a3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:23.531567 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-545f0b9d-181b-4b6f-9f6b-f14aee4697a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:23.551308 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-af64e719-d2e8-4dc9-be7d-a3542ea1a062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb03f073bf348d0ac55ab0dd4689528'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.560105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-af64e719-d2e8-4dc9-be7d-a3542ea1a062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb03f073bf348d0ac55ab0dd4689528'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.560868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-af64e719-d2e8-4dc9-be7d-a3542ea1a062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb03f073bf348d0ac55ab0dd4689528'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.561731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-af64e719-d2e8-4dc9-be7d-a3542ea1a062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb03f073bf348d0ac55ab0dd4689528'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.569473 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:23.575894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-af64e719-d2e8-4dc9-be7d-a3542ea1a062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb03f073bf348d0ac55ab0dd4689528'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.595870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 933/1866] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:23 2022] DELETE /identity/v3/users/cbb03f073bf348d0ac55ab0dd4689528 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:23.595870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a45f3-1435-41fe-be2f-f167bf9838ea None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:23.595870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a45f3-1435-41fe-be2f-f167bf9838ea None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:23.595870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a45f3-1435-41fe-be2f-f167bf9838ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:23.605332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f0b9d-181b-4b6f-9f6b-f14aee4697a3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:23.614799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-672a45f3-1435-41fe-be2f-f167bf9838ea None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:23.616075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-672a45f3-1435-41fe-be2f-f167bf9838ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:23.640008 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:23.676912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30cd92-f70d-4dd5-aeb5-11e923927fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:23.678110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30cd92-f70d-4dd5-aeb5-11e923927fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:23.678542 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30cd92-f70d-4dd5-aeb5-11e923927fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:23.678880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30cd92-f70d-4dd5-aeb5-11e923927fbe admin admin] PATH_INFO: `/v3/users/c57cd9a0bb224e52b6f381aa35c5dc16` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:23.680218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30cd92-f70d-4dd5-aeb5-11e923927fbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c57cd9a0bb224e52b6f381aa35c5dc16)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:23.682238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30cd92-f70d-4dd5-aeb5-11e923927fbe admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:23.691190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 934/1867] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:23.692692 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e362e-ada2-45ea-b433-5a4a128d437a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:23.693198 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e362e-ada2-45ea-b433-5a4a128d437a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:23.693679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e362e-ada2-45ea-b433-5a4a128d437a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:23.712443 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-101e362e-ada2-45ea-b433-5a4a128d437a None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:23.713695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-101e362e-ada2-45ea-b433-5a4a128d437a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:23.722130 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 935/1868] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:23.723314 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ce23f-02d8-4045-83df-dbdb6efbebd1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:23.723602 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ce23f-02d8-4045-83df-dbdb6efbebd1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:23.723878 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ce23f-02d8-4045-83df-dbdb6efbebd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:23.749692 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-674ce23f-02d8-4045-83df-dbdb6efbebd1 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:23.751278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-674ce23f-02d8-4045-83df-dbdb6efbebd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:23.759606 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 936/1869] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:23.761020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f050f8e-b45d-404c-9a55-0dd373840c91 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:23.761454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f050f8e-b45d-404c-9a55-0dd373840c91 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:23.761875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f050f8e-b45d-404c-9a55-0dd373840c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:23.763950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dd30cd92-f70d-4dd5-aeb5-11e923927fbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c57cd9a0bb224e52b6f381aa35c5dc16'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.772811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dd30cd92-f70d-4dd5-aeb5-11e923927fbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c57cd9a0bb224e52b6f381aa35c5dc16'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.773546 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dd30cd92-f70d-4dd5-aeb5-11e923927fbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c57cd9a0bb224e52b6f381aa35c5dc16'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.774283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dd30cd92-f70d-4dd5-aeb5-11e923927fbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c57cd9a0bb224e52b6f381aa35c5dc16'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.780375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0f050f8e-b45d-404c-9a55-0dd373840c91 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:23.781676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0f050f8e-b45d-404c-9a55-0dd373840c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:23.787574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dd30cd92-f70d-4dd5-aeb5-11e923927fbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c57cd9a0bb224e52b6f381aa35c5dc16'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:23.791287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 937/1870] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:23.792252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f050f8e-b45d-404c-9a55-0dd373840c91 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:23.793600 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0f050f8e-b45d-404c-9a55-0dd373840c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:23.805243 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 934/1871] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:23 2022] DELETE /identity/v3/users/c57cd9a0bb224e52b6f381aa35c5dc16 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:23.806154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30cd92-f70d-4dd5-aeb5-11e923927fbe admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:23.807416 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-dd30cd92-f70d-4dd5-aeb5-11e923927fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:23.874953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f050f8e-b45d-404c-9a55-0dd373840c91 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:23.882232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30cd92-f70d-4dd5-aeb5-11e923927fbe admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:23.884774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b73561-7118-455a-af1e-93d72657e3d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:23.885841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b73561-7118-455a-af1e-93d72657e3d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:23.886132 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b73561-7118-455a-af1e-93d72657e3d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:23.886413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b73561-7118-455a-af1e-93d72657e3d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:23.891563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-91b73561-7118-455a-af1e-93d72657e3d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:23.893457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3db84-6bda-45c7-97d0-ac640902dd15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:23.894147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3db84-6bda-45c7-97d0-ac640902dd15 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:23.894497 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3db84-6bda-45c7-97d0-ac640902dd15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:23.894781 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3db84-6bda-45c7-97d0-ac640902dd15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:23.903069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f3e3db84-6bda-45c7-97d0-ac640902dd15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:24.014724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b73561-7118-455a-af1e-93d72657e3d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:24.017611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b73561-7118-455a-af1e-93d72657e3d8 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:24.041612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 938/1872] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:24.042490 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b73561-7118-455a-af1e-93d72657e3d8 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:24.060674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3db84-6bda-45c7-97d0-ac640902dd15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:24.062154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3db84-6bda-45c7-97d0-ac640902dd15 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:24.069604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b73561-7118-455a-af1e-93d72657e3d8 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:24.076766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:24.087366 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0165d8-dfa5-486c-b62e-de2b3532bc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:24.088678 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0165d8-dfa5-486c-b62e-de2b3532bc17 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:24.088678 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0165d8-dfa5-486c-b62e-de2b3532bc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:24.089824 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0165d8-dfa5-486c-b62e-de2b3532bc17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:24.091075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0165d8-dfa5-486c-b62e-de2b3532bc17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:24.091886 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0165d8-dfa5-486c-b62e-de2b3532bc17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:24.093747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 935/1873] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:24.095808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0165d8-dfa5-486c-b62e-de2b3532bc17 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:24.116477 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:24.132705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 939/1874] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:24.133937 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3db84-6bda-45c7-97d0-ac640902dd15 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:24.149576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3db84-6bda-45c7-97d0-ac640902dd15 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:24.185225 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5d50c-120a-4281-814f-34df986dee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:24.190700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5d50c-120a-4281-814f-34df986dee00 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:24.191276 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5d50c-120a-4281-814f-34df986dee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:24.191990 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5d50c-120a-4281-814f-34df986dee00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:24.193531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5d50c-120a-4281-814f-34df986dee00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:24.199297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5d50c-120a-4281-814f-34df986dee00 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:24.275709 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 936/1875] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:24 2022] POST /identity/v3/projects => generated 393 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:35:24.276890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0165d8-dfa5-486c-b62e-de2b3532bc17 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:24.292731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0165d8-dfa5-486c-b62e-de2b3532bc17 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:24.463834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5d50c-120a-4281-814f-34df986dee00 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:24.465880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-52d5d50c-120a-4281-814f-34df986dee00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:24.473298 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb19c8-ebba-47e1-aca1-89ed863642e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:24.474823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb19c8-ebba-47e1-aca1-89ed863642e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:24.475114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb19c8-ebba-47e1-aca1-89ed863642e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:24.475393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb19c8-ebba-47e1-aca1-89ed863642e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:24.476100 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb19c8-ebba-47e1-aca1-89ed863642e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:24.478094 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb19c8-ebba-47e1-aca1-89ed863642e0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:24.509164 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5d50c-120a-4281-814f-34df986dee00 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:24.517081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934c407-b243-4078-9da2-be1c91cffc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:24.518200 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934c407-b243-4078-9da2-be1c91cffc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:24.518612 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934c407-b243-4078-9da2-be1c91cffc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:24.518963 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934c407-b243-4078-9da2-be1c91cffc9d admin admin] PATH_INFO: `/v3/projects/ba1311bd66884dfb915018ec198a716e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:24.519718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 940/1876] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:24 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:24.523590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934c407-b243-4078-9da2-be1c91cffc9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1311bd66884dfb915018ec198a716e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:24.524031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb19c8-ebba-47e1-aca1-89ed863642e0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:24.526783 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934c407-b243-4078-9da2-be1c91cffc9d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:24.536408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb19c8-ebba-47e1-aca1-89ed863642e0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:24.541876 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dc405-fe61-4c73-aa61-56d151466277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:24.542585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dc405-fe61-4c73-aa61-56d151466277 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:24.542919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dc405-fe61-4c73-aa61-56d151466277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:24.543329 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dc405-fe61-4c73-aa61-56d151466277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:24.544200 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3dc405-fe61-4c73-aa61-56d151466277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:24.545995 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3dc405-fe61-4c73-aa61-56d151466277 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:24.565655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 941/1877] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:24.570099 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dc405-fe61-4c73-aa61-56d151466277 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:24.581499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dc405-fe61-4c73-aa61-56d151466277 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:24.587089 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9a505-c166-42e5-b361-8a3c9de7cdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:24.587775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9a505-c166-42e5-b361-8a3c9de7cdfd admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:24.588065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9a505-c166-42e5-b361-8a3c9de7cdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:24.588350 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9a505-c166-42e5-b361-8a3c9de7cdfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:24.589091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9a505-c166-42e5-b361-8a3c9de7cdfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:24.590964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9a505-c166-42e5-b361-8a3c9de7cdfd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:24.603453 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 942/1878] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:35:24.608001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9a505-c166-42e5-b361-8a3c9de7cdfd admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:24.618798 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9a505-c166-42e5-b361-8a3c9de7cdfd admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:24.623981 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862da04-9ff1-43d9-9fc6-c186e94a541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:24.624910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862da04-9ff1-43d9-9fc6-c186e94a541d admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:24.625196 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862da04-9ff1-43d9-9fc6-c186e94a541d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:24.625517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862da04-9ff1-43d9-9fc6-c186e94a541d admin admin] PATH_INFO: `/v3/projects/9090f8a2682643ac9f700f1079f4e8d5/users/fbd2037aa5464e4eb3772ce65ce46b5c/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:24.644162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862da04-9ff1-43d9-9fc6-c186e94a541d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9090f8a2682643ac9f700f1079f4e8d5, user_id=fbd2037aa5464e4eb3772ce65ce46b5c, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:24.647226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862da04-9ff1-43d9-9fc6-c186e94a541d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:24.683588 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 943/1879] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:24 2022] PUT /identity/v3/projects/9090f8a2682643ac9f700f1079f4e8d5/users/fbd2037aa5464e4eb3772ce65ce46b5c/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:24.688271 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ce3e9-dd6a-4fda-ac0a-6a14f21415b3 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:24.688569 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ce3e9-dd6a-4fda-ac0a-6a14f21415b3 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:24.688992 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ce3e9-dd6a-4fda-ac0a-6a14f21415b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:24.720744 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-396ce3e9-dd6a-4fda-ac0a-6a14f21415b3 None None] MFA Rules not processed for user `fbd2037aa5464e4eb3772ce65ce46b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:24.722264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-396ce3e9-dd6a-4fda-ac0a-6a14f21415b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:24.735066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7934c407-b243-4078-9da2-be1c91cffc9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1311bd66884dfb915018ec198a716e', 'request_id': 'req-7934c407-b243-4078-9da2-be1c91cffc9d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:24.743077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7934c407-b243-4078-9da2-be1c91cffc9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1311bd66884dfb915018ec198a716e', 'request_id': 'req-7934c407-b243-4078-9da2-be1c91cffc9d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:24.751284 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7934c407-b243-4078-9da2-be1c91cffc9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1311bd66884dfb915018ec198a716e', 'request_id': 'req-7934c407-b243-4078-9da2-be1c91cffc9d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:24.780680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7934c407-b243-4078-9da2-be1c91cffc9d admin admin] The token cache is being invalidate because project ba1311bd66884dfb915018ec198a716e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:24.781116 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7934c407-b243-4078-9da2-be1c91cffc9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:24.782072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7934c407-b243-4078-9da2-be1c91cffc9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:24.784318 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 937/1880] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:24 2022] DELETE /identity/v3/projects/ba1311bd66884dfb915018ec198a716e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:24.791511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc338c-7156-4bb4-ae75-59a4cce80df4 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:24.792145 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc338c-7156-4bb4-ae75-59a4cce80df4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:24.794127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc338c-7156-4bb4-ae75-59a4cce80df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:24.819623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e6bc338c-7156-4bb4-ae75-59a4cce80df4 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:24.823627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 944/1881] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:24.824207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e6bc338c-7156-4bb4-ae75-59a4cce80df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:24.828129 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ce3e9-dd6a-4fda-ac0a-6a14f21415b3 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:24.830083 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-396ce3e9-dd6a-4fda-ac0a-6a14f21415b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:24.874708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:24.931639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ce3e9-dd6a-4fda-ac0a-6a14f21415b3 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:24.941530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 938/1882] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:24.941946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e493c-afe2-4926-b7d8-17ebcc9a5f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:24.944432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e493c-afe2-4926-b7d8-17ebcc9a5f0d admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:24.944555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e493c-afe2-4926-b7d8-17ebcc9a5f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:24.944781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e493c-afe2-4926-b7d8-17ebcc9a5f0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:24.945562 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e493c-afe2-4926-b7d8-17ebcc9a5f0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:24.949859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e493c-afe2-4926-b7d8-17ebcc9a5f0d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:24.951576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d452a-d5a2-476e-bb20-2dd5d415827b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:24.952259 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d452a-d5a2-476e-bb20-2dd5d415827b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:24.952741 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d452a-d5a2-476e-bb20-2dd5d415827b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:25.004556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-033d452a-d5a2-476e-bb20-2dd5d415827b None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:25.008598 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 945/1883] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:24 2022] POST /identity/v3/projects => generated 391 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:25.008732 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-033d452a-d5a2-476e-bb20-2dd5d415827b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:25.009809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e493c-afe2-4926-b7d8-17ebcc9a5f0d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:25.121933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e493c-afe2-4926-b7d8-17ebcc9a5f0d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:25.128425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 939/1884] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:25.128425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d452a-d5a2-476e-bb20-2dd5d415827b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:25.129790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-033d452a-d5a2-476e-bb20-2dd5d415827b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:25.132631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fe35e-a2ae-461c-aca5-2fbff35c7569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:25.133443 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fe35e-a2ae-461c-aca5-2fbff35c7569 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:25.133796 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fe35e-a2ae-461c-aca5-2fbff35c7569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:25.134132 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fe35e-a2ae-461c-aca5-2fbff35c7569 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:25.135098 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fe35e-a2ae-461c-aca5-2fbff35c7569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:25.137709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fe35e-a2ae-461c-aca5-2fbff35c7569 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:25.138393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:25.146091 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d452a-d5a2-476e-bb20-2dd5d415827b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:25.152819 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800408d-a7f4-48fd-b860-92f0c23bc81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:25.153947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800408d-a7f4-48fd-b860-92f0c23bc81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:25.154772 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800408d-a7f4-48fd-b860-92f0c23bc81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:25.155351 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800408d-a7f4-48fd-b860-92f0c23bc81a admin admin] PATH_INFO: `/v3/projects/5f75dc5823694353ad0284b013d4a3a1` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:25.156693 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800408d-a7f4-48fd-b860-92f0c23bc81a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f75dc5823694353ad0284b013d4a3a1)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:25.159790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800408d-a7f4-48fd-b860-92f0c23bc81a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:25.161956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 946/1885] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:25 2022] POST /identity/v3/users => generated 302 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:25.162805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fe35e-a2ae-461c-aca5-2fbff35c7569 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:25.164400 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2a1fe35e-a2ae-461c-aca5-2fbff35c7569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:25.178014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fe35e-a2ae-461c-aca5-2fbff35c7569 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:25.185129 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc4cbd-85f0-41c9-852e-5170cec1d59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:25.185824 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc4cbd-85f0-41c9-852e-5170cec1d59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:25.186181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc4cbd-85f0-41c9-852e-5170cec1d59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:25.186941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc4cbd-85f0-41c9-852e-5170cec1d59b admin admin] PATH_INFO: `/v3/projects/f23e17290e8441c4b4d493cc56a66266` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:25.188795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc4cbd-85f0-41c9-852e-5170cec1d59b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f23e17290e8441c4b4d493cc56a66266)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:25.191011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc4cbd-85f0-41c9-852e-5170cec1d59b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:25.219481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a800408d-a7f4-48fd-b860-92f0c23bc81a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f75dc5823694353ad0284b013d4a3a1', 'request_id': 'req-a800408d-a7f4-48fd-b860-92f0c23bc81a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:25.226182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a800408d-a7f4-48fd-b860-92f0c23bc81a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f75dc5823694353ad0284b013d4a3a1', 'request_id': 'req-a800408d-a7f4-48fd-b860-92f0c23bc81a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:25.234475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a800408d-a7f4-48fd-b860-92f0c23bc81a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f75dc5823694353ad0284b013d4a3a1', 'request_id': 'req-a800408d-a7f4-48fd-b860-92f0c23bc81a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:25.247225 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8efc4cbd-85f0-41c9-852e-5170cec1d59b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f23e17290e8441c4b4d493cc56a66266', 'request_id': 'req-8efc4cbd-85f0-41c9-852e-5170cec1d59b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:25.253531 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8efc4cbd-85f0-41c9-852e-5170cec1d59b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f23e17290e8441c4b4d493cc56a66266', 'request_id': 'req-8efc4cbd-85f0-41c9-852e-5170cec1d59b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:25.254311 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a800408d-a7f4-48fd-b860-92f0c23bc81a admin admin] The token cache is being invalidate because project 5f75dc5823694353ad0284b013d4a3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:25.254836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a800408d-a7f4-48fd-b860-92f0c23bc81a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:25.255559 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a800408d-a7f4-48fd-b860-92f0c23bc81a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:25.257184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 940/1886] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:25 2022] DELETE /identity/v3/projects/5f75dc5823694353ad0284b013d4a3a1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:25.260447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800408d-a7f4-48fd-b860-92f0c23bc81a admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:25.260447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a800408d-a7f4-48fd-b860-92f0c23bc81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:25.263645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8efc4cbd-85f0-41c9-852e-5170cec1d59b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f23e17290e8441c4b4d493cc56a66266', 'request_id': 'req-8efc4cbd-85f0-41c9-852e-5170cec1d59b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:25.282428 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8efc4cbd-85f0-41c9-852e-5170cec1d59b admin admin] The token cache is being invalidate because project f23e17290e8441c4b4d493cc56a66266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:25.282822 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8efc4cbd-85f0-41c9-852e-5170cec1d59b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:25.283794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8efc4cbd-85f0-41c9-852e-5170cec1d59b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:25.285444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 947/1887] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:25 2022] DELETE /identity/v3/projects/f23e17290e8441c4b4d493cc56a66266 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:25.286283 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc4cbd-85f0-41c9-852e-5170cec1d59b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:25.287989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8efc4cbd-85f0-41c9-852e-5170cec1d59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:25.327810 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:25.343428 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800408d-a7f4-48fd-b860-92f0c23bc81a admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:25.376249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc4cbd-85f0-41c9-852e-5170cec1d59b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:25.383796 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6aeb73-37b1-426c-9099-1524746bae28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:25.384712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aeb73-37b1-426c-9099-1524746bae28 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:25.385087 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aeb73-37b1-426c-9099-1524746bae28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:25.385395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aeb73-37b1-426c-9099-1524746bae28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:25.386180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6aeb73-37b1-426c-9099-1524746bae28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:25.387882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6aeb73-37b1-426c-9099-1524746bae28 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:25.405029 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 948/1888] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:25.406136 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6aeb73-37b1-426c-9099-1524746bae28 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:25.409854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2e6aeb73-37b1-426c-9099-1524746bae28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:25.426350 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6aeb73-37b1-426c-9099-1524746bae28 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:25.435806 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae6c31-53b9-413b-9ef2-8d96178341ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:25.436503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae6c31-53b9-413b-9ef2-8d96178341ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:25.436790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae6c31-53b9-413b-9ef2-8d96178341ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:25.437068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae6c31-53b9-413b-9ef2-8d96178341ad admin admin] PATH_INFO: `/v3/users/4c5a2a74e13241ab88b43613a8489035` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:25.438759 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae6c31-53b9-413b-9ef2-8d96178341ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c5a2a74e13241ab88b43613a8489035)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:25.439303 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b31ef-5069-4ca4-bd1b-2568bace8cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:25.440318 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b31ef-5069-4ca4-bd1b-2568bace8cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:25.440710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b31ef-5069-4ca4-bd1b-2568bace8cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:25.440815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae6c31-53b9-413b-9ef2-8d96178341ad admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:25.441122 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b31ef-5069-4ca4-bd1b-2568bace8cb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:25.441922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b31ef-5069-4ca4-bd1b-2568bace8cb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:25.442516 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b31ef-5069-4ca4-bd1b-2568bace8cb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:25.444228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b31ef-5069-4ca4-bd1b-2568bace8cb3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:25.458510 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 941/1889] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:25.460213 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db508f1-4d38-4dfe-982b-696bfd78f693 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:25.460692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db508f1-4d38-4dfe-982b-696bfd78f693 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:25.461036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db508f1-4d38-4dfe-982b-696bfd78f693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:25.483832 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8db508f1-4d38-4dfe-982b-696bfd78f693 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:25.485123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8db508f1-4d38-4dfe-982b-696bfd78f693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:25.501607 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 942/1890] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:25.502814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db508f1-4d38-4dfe-982b-696bfd78f693 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:25.517187 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db508f1-4d38-4dfe-982b-696bfd78f693 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:25.524345 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a836703-3e25-4a4b-a552-faf18da11f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:25.526138 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a836703-3e25-4a4b-a552-faf18da11f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:25.526637 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a836703-3e25-4a4b-a552-faf18da11f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:25.527016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a836703-3e25-4a4b-a552-faf18da11f4b admin admin] PATH_INFO: `/v3/projects/598f7e8bfedc4433badc55d03cd12252/users/9f7b5fa33e0e40429b5771b3085955dd/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:25.550648 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a836703-3e25-4a4b-a552-faf18da11f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=598f7e8bfedc4433badc55d03cd12252, user_id=9f7b5fa33e0e40429b5771b3085955dd, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:25.553490 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-27ae6c31-53b9-413b-9ef2-8d96178341ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c5a2a74e13241ab88b43613a8489035'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:25.553947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a836703-3e25-4a4b-a552-faf18da11f4b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:25.557733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:25.568367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-27ae6c31-53b9-413b-9ef2-8d96178341ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c5a2a74e13241ab88b43613a8489035'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:25.570953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-27ae6c31-53b9-413b-9ef2-8d96178341ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c5a2a74e13241ab88b43613a8489035'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:25.571739 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-27ae6c31-53b9-413b-9ef2-8d96178341ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c5a2a74e13241ab88b43613a8489035'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:25.576137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 943/1891] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:25 2022] PUT /identity/v3/projects/598f7e8bfedc4433badc55d03cd12252/users/9f7b5fa33e0e40429b5771b3085955dd/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:25.577526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a836703-3e25-4a4b-a552-faf18da11f4b admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:25.580996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7a836703-3e25-4a4b-a552-faf18da11f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:25.603221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-27ae6c31-53b9-413b-9ef2-8d96178341ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c5a2a74e13241ab88b43613a8489035'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:25.645914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 949/1892] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:25 2022] DELETE /identity/v3/users/4c5a2a74e13241ab88b43613a8489035 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:25.645914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe1adc-efbc-4555-b231-7d7d024e3244 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:25.646917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe1adc-efbc-4555-b231-7d7d024e3244 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:25.648136 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe1adc-efbc-4555-b231-7d7d024e3244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:25.690394 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9bbe1adc-efbc-4555-b231-7d7d024e3244 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:25.692346 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9bbe1adc-efbc-4555-b231-7d7d024e3244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:25.713121 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a836703-3e25-4a4b-a552-faf18da11f4b admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:25.837780 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 950/1893] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:25.841683 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe1adc-efbc-4555-b231-7d7d024e3244 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:25.845503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9bbe1adc-efbc-4555-b231-7d7d024e3244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:25.873595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe1adc-efbc-4555-b231-7d7d024e3244 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:25.881849 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dcf61-81de-4e17-acc4-fb633554db3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:25.882552 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dcf61-81de-4e17-acc4-fb633554db3c admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:25.882852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dcf61-81de-4e17-acc4-fb633554db3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:25.883352 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dcf61-81de-4e17-acc4-fb633554db3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:25.884044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dcf61-81de-4e17-acc4-fb633554db3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:25.885492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c933e-18f5-47f3-80de-1420742f58a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:25.885992 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dcf61-81de-4e17-acc4-fb633554db3c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:25.886429 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c933e-18f5-47f3-80de-1420742f58a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:25.886839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c933e-18f5-47f3-80de-1420742f58a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:25.887214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c933e-18f5-47f3-80de-1420742f58a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:25.888636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c933e-18f5-47f3-80de-1420742f58a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:25.891322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c933e-18f5-47f3-80de-1420742f58a5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:25.898356 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 951/1894] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:25.899309 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dcf61-81de-4e17-acc4-fb633554db3c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:25.919044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dcf61-81de-4e17-acc4-fb633554db3c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:25.926278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f292c-9c3d-4b42-9455-b22b4b20ae4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:25.926995 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f292c-9c3d-4b42-9455-b22b4b20ae4c admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:25.927335 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f292c-9c3d-4b42-9455-b22b4b20ae4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:25.927688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f292c-9c3d-4b42-9455-b22b4b20ae4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:25.929774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f292c-9c3d-4b42-9455-b22b4b20ae4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:25.930117 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f292c-9c3d-4b42-9455-b22b4b20ae4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:25.932549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f292c-9c3d-4b42-9455-b22b4b20ae4c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:25.951389 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 944/1895] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:25 2022] POST /identity/v3/projects => generated 407 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:25.953710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 952/1896] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:25.954284 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c933e-18f5-47f3-80de-1420742f58a5 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:25.954609 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f292c-9c3d-4b42-9455-b22b4b20ae4c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:25.966105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f292c-9c3d-4b42-9455-b22b4b20ae4c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:25.979830 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:26.084532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5305a4b-c350-4de7-9f2b-4fa93203c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:26.085893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5305a4b-c350-4de7-9f2b-4fa93203c4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:26.086285 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5305a4b-c350-4de7-9f2b-4fa93203c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:26.086672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5305a4b-c350-4de7-9f2b-4fa93203c4f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:26.087667 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5305a4b-c350-4de7-9f2b-4fa93203c4f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:26.091663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c933e-18f5-47f3-80de-1420742f58a5 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:26.091890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5305a4b-c350-4de7-9f2b-4fa93203c4f6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:26.102483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aff091-6410-46b7-abe6-3be76a411bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:26.103512 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aff091-6410-46b7-abe6-3be76a411bce admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:26.103799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aff091-6410-46b7-abe6-3be76a411bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:26.104078 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aff091-6410-46b7-abe6-3be76a411bce admin admin] PATH_INFO: `/v3/projects/598f7e8bfedc4433badc55d03cd12252/users/9f7b5fa33e0e40429b5771b3085955dd/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:26.110725 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aff091-6410-46b7-abe6-3be76a411bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=598f7e8bfedc4433badc55d03cd12252, user_id=9f7b5fa33e0e40429b5771b3085955dd, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:26.113406 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aff091-6410-46b7-abe6-3be76a411bce admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:26.143801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 953/1897] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:25 2022] POST /identity/v3/users => generated 304 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:26.144929 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5305a4b-c350-4de7-9f2b-4fa93203c4f6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:26.147144 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 945/1898] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:25 2022] PUT /identity/v3/projects/598f7e8bfedc4433badc55d03cd12252/users/9f7b5fa33e0e40429b5771b3085955dd/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:26.148171 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aff091-6410-46b7-abe6-3be76a411bce admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:26.179707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5305a4b-c350-4de7-9f2b-4fa93203c4f6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:26.202108 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:26.283797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aff091-6410-46b7-abe6-3be76a411bce admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:26.289287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bb463-99b9-4bdb-b842-c3bf3e35958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:26.290163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bb463-99b9-4bdb-b842-c3bf3e35958e admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:26.290780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bb463-99b9-4bdb-b842-c3bf3e35958e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:26.290780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bb463-99b9-4bdb-b842-c3bf3e35958e admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:26.291468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bb463-99b9-4bdb-b842-c3bf3e35958e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:26.293087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bb463-99b9-4bdb-b842-c3bf3e35958e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:26.304659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 946/1899] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:26.306536 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b15981-228f-4bb3-b00b-9d62d5b62937 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:26.306830 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b15981-228f-4bb3-b00b-9d62d5b62937 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:26.307117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b15981-228f-4bb3-b00b-9d62d5b62937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:26.352826 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-09b15981-228f-4bb3-b00b-9d62d5b62937 None None] MFA Rules not processed for user `9f7b5fa33e0e40429b5771b3085955dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:26.356386 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-09b15981-228f-4bb3-b00b-9d62d5b62937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:26.359561 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de25394-e852-429a-8563-dac393ed9f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:26.363733 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de25394-e852-429a-8563-dac393ed9f69 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:26.365289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de25394-e852-429a-8563-dac393ed9f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:26.365766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de25394-e852-429a-8563-dac393ed9f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:26.368178 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de25394-e852-429a-8563-dac393ed9f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:26.372389 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de25394-e852-429a-8563-dac393ed9f69 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:26.437440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 954/1900] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:26 2022] POST /identity/v3/projects => generated 387 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:26.441919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de25394-e852-429a-8563-dac393ed9f69 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:26.467370 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 947/1901] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:26.468574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b15981-228f-4bb3-b00b-9d62d5b62937 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:26.480556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b15981-228f-4bb3-b00b-9d62d5b62937 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:26.533645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de25394-e852-429a-8563-dac393ed9f69 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:26.538526 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabb894-4903-4586-8954-e191daeda378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:26.539206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabb894-4903-4586-8954-e191daeda378 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:26.539534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabb894-4903-4586-8954-e191daeda378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:26.539817 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabb894-4903-4586-8954-e191daeda378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:26.540553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabb894-4903-4586-8954-e191daeda378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:26.542195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabb894-4903-4586-8954-e191daeda378 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:26.545381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53ac1c-7233-4ef5-958c-c709210b36b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:26.546068 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53ac1c-7233-4ef5-958c-c709210b36b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:26.546353 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53ac1c-7233-4ef5-958c-c709210b36b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:26.546633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53ac1c-7233-4ef5-958c-c709210b36b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:26.547353 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53ac1c-7233-4ef5-958c-c709210b36b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:26.549323 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53ac1c-7233-4ef5-958c-c709210b36b2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:26.552094 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 955/1902] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:26.552921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabb894-4903-4586-8954-e191daeda378 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:26.556610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2eabb894-4903-4586-8954-e191daeda378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:26.571445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 948/1903] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:26 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:26.572353 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53ac1c-7233-4ef5-958c-c709210b36b2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:26.573967 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-af53ac1c-7233-4ef5-958c-c709210b36b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:26.584991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:26.585824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53ac1c-7233-4ef5-958c-c709210b36b2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:26.590747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62342b31-4a55-4cb2-b762-f7ae4af8ee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:26.591608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62342b31-4a55-4cb2-b762-f7ae4af8ee79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:26.591890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62342b31-4a55-4cb2-b762-f7ae4af8ee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:26.592162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62342b31-4a55-4cb2-b762-f7ae4af8ee79 admin admin] PATH_INFO: `/v3/projects/98790531130344ec9440ced73ab3d809` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:26.593329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62342b31-4a55-4cb2-b762-f7ae4af8ee79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98790531130344ec9440ced73ab3d809)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:26.595743 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62342b31-4a55-4cb2-b762-f7ae4af8ee79 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:26.617513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabb894-4903-4586-8954-e191daeda378 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:26.621238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd30cd-e49e-41a3-8475-fd74103c7809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:26.621932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd30cd-e49e-41a3-8475-fd74103c7809 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:26.622280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd30cd-e49e-41a3-8475-fd74103c7809 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:26.622542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd30cd-e49e-41a3-8475-fd74103c7809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:26.629411 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:26.647125 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-62342b31-4a55-4cb2-b762-f7ae4af8ee79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98790531130344ec9440ced73ab3d809', 'request_id': 'req-62342b31-4a55-4cb2-b762-f7ae4af8ee79'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:26.652647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-62342b31-4a55-4cb2-b762-f7ae4af8ee79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98790531130344ec9440ced73ab3d809', 'request_id': 'req-62342b31-4a55-4cb2-b762-f7ae4af8ee79'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:26.659401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-62342b31-4a55-4cb2-b762-f7ae4af8ee79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98790531130344ec9440ced73ab3d809', 'request_id': 'req-62342b31-4a55-4cb2-b762-f7ae4af8ee79'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:26.672884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-62342b31-4a55-4cb2-b762-f7ae4af8ee79 admin admin] The token cache is being invalidate because project 98790531130344ec9440ced73ab3d809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:26.673181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-62342b31-4a55-4cb2-b762-f7ae4af8ee79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:26.673886 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-62342b31-4a55-4cb2-b762-f7ae4af8ee79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:26.675663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 949/1904] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:26 2022] DELETE /identity/v3/projects/98790531130344ec9440ced73ab3d809 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:26.680475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62342b31-4a55-4cb2-b762-f7ae4af8ee79 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:26.681854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-62342b31-4a55-4cb2-b762-f7ae4af8ee79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:26.695692 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd30cd-e49e-41a3-8475-fd74103c7809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:26.697948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd30cd-e49e-41a3-8475-fd74103c7809 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:26.709775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 956/1905] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:26.710637 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd30cd-e49e-41a3-8475-fd74103c7809 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:26.723938 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd30cd-e49e-41a3-8475-fd74103c7809 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:26.771473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62342b31-4a55-4cb2-b762-f7ae4af8ee79 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:26.785937 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06774d-7cb3-4f4d-8509-5d2a86d50179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:26.787132 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06774d-7cb3-4f4d-8509-5d2a86d50179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:26.787494 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06774d-7cb3-4f4d-8509-5d2a86d50179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:26.787847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06774d-7cb3-4f4d-8509-5d2a86d50179 admin admin] PATH_INFO: `/v3/projects/63193be98afb461684e7bc4fa61fe130/users/43be35b8aa5f484084437dda14fe0d6a/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:26.799530 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8337e4-d5b6-4cc0-ad02-243e817e176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:26.801178 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8337e4-d5b6-4cc0-ad02-243e817e176d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:26.801582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8337e4-d5b6-4cc0-ad02-243e817e176d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:26.802086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8337e4-d5b6-4cc0-ad02-243e817e176d admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:26.802985 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8337e4-d5b6-4cc0-ad02-243e817e176d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:26.804860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8337e4-d5b6-4cc0-ad02-243e817e176d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:26.806105 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06774d-7cb3-4f4d-8509-5d2a86d50179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63193be98afb461684e7bc4fa61fe130, user_id=43be35b8aa5f484084437dda14fe0d6a, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:26.808866 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06774d-7cb3-4f4d-8509-5d2a86d50179 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:26.817633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 957/1906] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:26.819971 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f083a3-61ad-4073-8cdd-9a58d3040a78 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:26.820403 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f083a3-61ad-4073-8cdd-9a58d3040a78 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:26.820809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f083a3-61ad-4073-8cdd-9a58d3040a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:26.829691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 950/1907] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:26 2022] PUT /identity/v3/projects/63193be98afb461684e7bc4fa61fe130/users/43be35b8aa5f484084437dda14fe0d6a/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:26.830296 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06774d-7cb3-4f4d-8509-5d2a86d50179 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:26.836973 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fd06774d-7cb3-4f4d-8509-5d2a86d50179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:26.842838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-97f083a3-61ad-4073-8cdd-9a58d3040a78 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:26.844109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-97f083a3-61ad-4073-8cdd-9a58d3040a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:26.915337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 958/1908] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:26.916527 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f083a3-61ad-4073-8cdd-9a58d3040a78 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:26.918180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-97f083a3-61ad-4073-8cdd-9a58d3040a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:26.931109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f083a3-61ad-4073-8cdd-9a58d3040a78 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:26.931596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06774d-7cb3-4f4d-8509-5d2a86d50179 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:26.935612 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13430b-85e2-4128-8342-a1a223ab6b9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:26.936319 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13430b-85e2-4128-8342-a1a223ab6b9f service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:26.936588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13430b-85e2-4128-8342-a1a223ab6b9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:26.936863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13430b-85e2-4128-8342-a1a223ab6b9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:26.937476 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481124ee-1c9e-4fab-b7ce-dddfe94f158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:26.938312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481124ee-1c9e-4fab-b7ce-dddfe94f158d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:26.938699 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8e13430b-85e2-4128-8342-a1a223ab6b9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:26.939076 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481124ee-1c9e-4fab-b7ce-dddfe94f158d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:26.939500 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481124ee-1c9e-4fab-b7ce-dddfe94f158d admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:26.940513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481124ee-1c9e-4fab-b7ce-dddfe94f158d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:26.942383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481124ee-1c9e-4fab-b7ce-dddfe94f158d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:26.949319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:26.955513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 959/1909] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:26.957049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e6d49-2cf8-4351-a7a2-bbc7bada3424 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:26.957555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e6d49-2cf8-4351-a7a2-bbc7bada3424 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:26.957948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e6d49-2cf8-4351-a7a2-bbc7bada3424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:26.988978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c22e6d49-2cf8-4351-a7a2-bbc7bada3424 None None] MFA Rules not processed for user `43be35b8aa5f484084437dda14fe0d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:26.990131 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c22e6d49-2cf8-4351-a7a2-bbc7bada3424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:27.005201 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:27.011294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13430b-85e2-4128-8342-a1a223ab6b9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:27.012965 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13430b-85e2-4128-8342-a1a223ab6b9f service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:27.024600 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 951/1910] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:27.026425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176603-886c-4bf7-a30a-b7d540a6225c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:27.027005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176603-886c-4bf7-a30a-b7d540a6225c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:27.027396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29176603-886c-4bf7-a30a-b7d540a6225c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:27.059129 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-29176603-886c-4bf7-a30a-b7d540a6225c None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:27.060624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-29176603-886c-4bf7-a30a-b7d540a6225c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:27.070767 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 952/1911] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:27.071577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29176603-886c-4bf7-a30a-b7d540a6225c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:27.080032 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 960/1912] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:27.080032 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e6d49-2cf8-4351-a7a2-bbc7bada3424 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:27.095921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29176603-886c-4bf7-a30a-b7d540a6225c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:27.101646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2621-93b5-4bb6-8973-88afc1760f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:27.102600 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2621-93b5-4bb6-8973-88afc1760f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:27.102884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2621-93b5-4bb6-8973-88afc1760f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:27.103157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd2621-93b5-4bb6-8973-88afc1760f1f admin admin] PATH_INFO: `/v3/projects/bdc25f5b63064917b8e421ead6315f9c/users/18e9f7d8a47d4dfcb2ada398c45edc4c/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:27.103264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e6d49-2cf8-4351-a7a2-bbc7bada3424 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:27.109370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f862ce-835a-4551-88cc-f4b10d358cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:27.110280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f862ce-835a-4551-88cc-f4b10d358cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:27.110757 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f862ce-835a-4551-88cc-f4b10d358cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:27.111147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f862ce-835a-4551-88cc-f4b10d358cf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:27.112145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f862ce-835a-4551-88cc-f4b10d358cf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:27.112984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f862ce-835a-4551-88cc-f4b10d358cf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:27.116458 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f862ce-835a-4551-88cc-f4b10d358cf1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:27.123739 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd2621-93b5-4bb6-8973-88afc1760f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc25f5b63064917b8e421ead6315f9c, user_id=18e9f7d8a47d4dfcb2ada398c45edc4c, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:27.126498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd2621-93b5-4bb6-8973-88afc1760f1f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:27.153230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 953/1913] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:27 2022] PUT /identity/v3/projects/bdc25f5b63064917b8e421ead6315f9c/users/18e9f7d8a47d4dfcb2ada398c45edc4c/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:27.158009 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2621-93b5-4bb6-8973-88afc1760f1f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:27.163879 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 961/1914] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:27.165889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3010aa-8f1c-4ae3-a0a1-40497de1ae55 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:27.167487 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3010aa-8f1c-4ae3-a0a1-40497de1ae55 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:27.169482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3010aa-8f1c-4ae3-a0a1-40497de1ae55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:27.216758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-eb3010aa-8f1c-4ae3-a0a1-40497de1ae55 None None] MFA Rules not processed for user `18e9f7d8a47d4dfcb2ada398c45edc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:27.223383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-eb3010aa-8f1c-4ae3-a0a1-40497de1ae55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:27.278740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd2621-93b5-4bb6-8973-88afc1760f1f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:27.285615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010043f-9ea5-4277-8eea-78e5a0bcf7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:27.286354 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010043f-9ea5-4277-8eea-78e5a0bcf7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:27.286715 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010043f-9ea5-4277-8eea-78e5a0bcf7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:27.287010 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010043f-9ea5-4277-8eea-78e5a0bcf7c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:27.287710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010043f-9ea5-4277-8eea-78e5a0bcf7c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:27.290594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010043f-9ea5-4277-8eea-78e5a0bcf7c0 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:27.352789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 954/1915] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:27 2022] POST /identity/v3/projects => generated 407 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:27.353722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010043f-9ea5-4277-8eea-78e5a0bcf7c0 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:27.414656 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 962/1916] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:27.416193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3010aa-8f1c-4ae3-a0a1-40497de1ae55 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:27.436021 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3010aa-8f1c-4ae3-a0a1-40497de1ae55 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:27.482479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010043f-9ea5-4277-8eea-78e5a0bcf7c0 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:27.488075 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979cd6d-a8e3-4173-9ff1-6a8e566c74da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:27.489908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979cd6d-a8e3-4173-9ff1-6a8e566c74da admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:27.490260 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979cd6d-a8e3-4173-9ff1-6a8e566c74da admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:27.490637 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979cd6d-a8e3-4173-9ff1-6a8e566c74da admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:27.491497 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979cd6d-a8e3-4173-9ff1-6a8e566c74da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:27.494806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979cd6d-a8e3-4173-9ff1-6a8e566c74da admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:27.556509 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 955/1917] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:27 2022] POST /identity/v3/projects => generated 387 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:27.558020 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979cd6d-a8e3-4173-9ff1-6a8e566c74da admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:27.588412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe046ac8-b1f5-4b2e-8827-11ee44aef146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:27.588412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe046ac8-b1f5-4b2e-8827-11ee44aef146 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:27.588412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe046ac8-b1f5-4b2e-8827-11ee44aef146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:27.588412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe046ac8-b1f5-4b2e-8827-11ee44aef146 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:27.589154 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe046ac8-b1f5-4b2e-8827-11ee44aef146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:27.591412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe046ac8-b1f5-4b2e-8827-11ee44aef146 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:27.605052 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:27.623173 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 963/1918] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:27 2022] POST /identity/v3/users => generated 310 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:27.624049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe046ac8-b1f5-4b2e-8827-11ee44aef146 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:27.635284 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe046ac8-b1f5-4b2e-8827-11ee44aef146 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:27.639710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:27.682759 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979cd6d-a8e3-4173-9ff1-6a8e566c74da admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:27.687695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49cca4c-225a-4095-8217-944e41dd1823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:27.688313 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cca4c-225a-4095-8217-944e41dd1823 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:27.688730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cca4c-225a-4095-8217-944e41dd1823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:27.688982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49cca4c-225a-4095-8217-944e41dd1823 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:27.689796 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cca4c-225a-4095-8217-944e41dd1823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:27.691997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49cca4c-225a-4095-8217-944e41dd1823 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:27.720653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c65a7-cf8c-4a67-8e05-a8a8100d6e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:27.721619 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c65a7-cf8c-4a67-8e05-a8a8100d6e29 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:27.721989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c65a7-cf8c-4a67-8e05-a8a8100d6e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:27.722331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c65a7-cf8c-4a67-8e05-a8a8100d6e29 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:27.723091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c65a7-cf8c-4a67-8e05-a8a8100d6e29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:27.726716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 956/1919] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:27 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:27.726716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49cca4c-225a-4095-8217-944e41dd1823 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:27.726936 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c65a7-cf8c-4a67-8e05-a8a8100d6e29 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:27.749711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 964/1920] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:27 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:27.750522 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c65a7-cf8c-4a67-8e05-a8a8100d6e29 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:27.762010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c65a7-cf8c-4a67-8e05-a8a8100d6e29 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:27.790160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49cca4c-225a-4095-8217-944e41dd1823 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:27.796362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903d083-a07e-4e3e-ad25-a7b2bb8e5055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:27.797042 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903d083-a07e-4e3e-ad25-a7b2bb8e5055 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:27.797544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903d083-a07e-4e3e-ad25-a7b2bb8e5055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:27.797895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903d083-a07e-4e3e-ad25-a7b2bb8e5055 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:27.798642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903d083-a07e-4e3e-ad25-a7b2bb8e5055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:27.800987 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903d083-a07e-4e3e-ad25-a7b2bb8e5055 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:27.811409 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 957/1921] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:27.812220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903d083-a07e-4e3e-ad25-a7b2bb8e5055 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:27.820914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae67bd0-2a0b-4601-84ca-539e6d32d005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:27.821681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae67bd0-2a0b-4601-84ca-539e6d32d005 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:27.821971 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae67bd0-2a0b-4601-84ca-539e6d32d005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:27.822064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903d083-a07e-4e3e-ad25-a7b2bb8e5055 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:27.822252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae67bd0-2a0b-4601-84ca-539e6d32d005 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:27.822950 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae67bd0-2a0b-4601-84ca-539e6d32d005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:27.825050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae67bd0-2a0b-4601-84ca-539e6d32d005 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:27.826821 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fae737-ea24-4c35-a0f4-61719b08cb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:27.827489 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fae737-ea24-4c35-a0f4-61719b08cb88 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:27.827756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fae737-ea24-4c35-a0f4-61719b08cb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:27.828031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fae737-ea24-4c35-a0f4-61719b08cb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:27.828761 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fae737-ea24-4c35-a0f4-61719b08cb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:27.830408 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fae737-ea24-4c35-a0f4-61719b08cb88 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:27.843415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 958/1922] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:27.844220 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fae737-ea24-4c35-a0f4-61719b08cb88 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:27.845211 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 965/1923] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:27 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:27.847331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae67bd0-2a0b-4601-84ca-539e6d32d005 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:27.857467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fae737-ea24-4c35-a0f4-61719b08cb88 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:27.858709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae67bd0-2a0b-4601-84ca-539e6d32d005 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:27.862326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486145a-c7c8-40e5-abed-353a95e72b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:27.863221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486145a-c7c8-40e5-abed-353a95e72b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:27.863410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955d8d0-2e61-4681-9dcc-f1a349b56d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:27.863537 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486145a-c7c8-40e5-abed-353a95e72b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:27.863790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486145a-c7c8-40e5-abed-353a95e72b1e admin admin] PATH_INFO: `/v3/projects/7ad26be0e227445fa83bbe8451353a3b/users/e7b0684ad4a3419bba53ffefbb5ea01f/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:27.864078 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955d8d0-2e61-4681-9dcc-f1a349b56d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:27.864367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955d8d0-2e61-4681-9dcc-f1a349b56d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:27.864667 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955d8d0-2e61-4681-9dcc-f1a349b56d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:27.865435 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955d8d0-2e61-4681-9dcc-f1a349b56d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:27.867044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955d8d0-2e61-4681-9dcc-f1a349b56d24 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:27.878502 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 966/1924] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:27.878502 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955d8d0-2e61-4681-9dcc-f1a349b56d24 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:27.882162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486145a-c7c8-40e5-abed-353a95e72b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad26be0e227445fa83bbe8451353a3b, user_id=e7b0684ad4a3419bba53ffefbb5ea01f, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:27.882664 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486145a-c7c8-40e5-abed-353a95e72b1e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:27.890207 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955d8d0-2e61-4681-9dcc-f1a349b56d24 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:27.900473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 959/1925] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:27 2022] PUT /identity/v3/projects/7ad26be0e227445fa83bbe8451353a3b/users/e7b0684ad4a3419bba53ffefbb5ea01f/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:27.900473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486145a-c7c8-40e5-abed-353a95e72b1e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:27.965678 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe8fcd-ac57-4f96-8e11-eed9cfa9fd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:27.966475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe8fcd-ac57-4f96-8e11-eed9cfa9fd43 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:27.966896 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe8fcd-ac57-4f96-8e11-eed9cfa9fd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:27.967263 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe8fcd-ac57-4f96-8e11-eed9cfa9fd43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:27.968183 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe8fcd-ac57-4f96-8e11-eed9cfa9fd43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:27.970100 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe8fcd-ac57-4f96-8e11-eed9cfa9fd43 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:27.976812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:27.984736 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 967/1926] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:27.987941 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486145a-c7c8-40e5-abed-353a95e72b1e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:27.989243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe8fcd-ac57-4f96-8e11-eed9cfa9fd43 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:27.994452 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77be457-17f3-4b7c-9be9-999338cfb3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:27.996891 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77be457-17f3-4b7c-9be9-999338cfb3af admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:27.997296 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77be457-17f3-4b7c-9be9-999338cfb3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:27.998063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77be457-17f3-4b7c-9be9-999338cfb3af admin admin] PATH_INFO: `/v3/projects/a2342d27f5264e3aac7f52e28ce2f35a/users/9315ee27246f4459844f6a4410842d15/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:28.002402 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe8fcd-ac57-4f96-8e11-eed9cfa9fd43 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:28.008783 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbeffc8-4965-411f-8410-787f26e2db51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:28.009864 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbeffc8-4965-411f-8410-787f26e2db51 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:28.010227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbeffc8-4965-411f-8410-787f26e2db51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:28.010591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbeffc8-4965-411f-8410-787f26e2db51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:28.011396 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbeffc8-4965-411f-8410-787f26e2db51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:28.013097 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbeffc8-4965-411f-8410-787f26e2db51 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:28.017509 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77be457-17f3-4b7c-9be9-999338cfb3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2342d27f5264e3aac7f52e28ce2f35a, user_id=9315ee27246f4459844f6a4410842d15, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:28.020203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77be457-17f3-4b7c-9be9-999338cfb3af admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:28.024626 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 968/1927] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:28.025678 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbeffc8-4965-411f-8410-787f26e2db51 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:28.034675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 960/1928] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:27 2022] PUT /identity/v3/projects/a2342d27f5264e3aac7f52e28ce2f35a/users/9315ee27246f4459844f6a4410842d15/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:28.035240 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77be457-17f3-4b7c-9be9-999338cfb3af admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:28.037330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbeffc8-4965-411f-8410-787f26e2db51 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:28.047763 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:28.128049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6983c5-88d3-4508-a178-9795207ab500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:28.129721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6983c5-88d3-4508-a178-9795207ab500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:28.130170 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6983c5-88d3-4508-a178-9795207ab500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:28.130726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6983c5-88d3-4508-a178-9795207ab500 admin admin] PATH_INFO: `/v3/projects/01221c1c85cb427fb1f652e67b1f8f78/users/30052c495a23457cb30f6bb0bb32c647/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:28.132845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77be457-17f3-4b7c-9be9-999338cfb3af admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:28.137748 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bd44e-9964-4ab9-bc80-b6b8361b7045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:28.138978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bd44e-9964-4ab9-bc80-b6b8361b7045 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:28.139179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bd44e-9964-4ab9-bc80-b6b8361b7045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:28.139557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bd44e-9964-4ab9-bc80-b6b8361b7045 admin admin] PATH_INFO: `/v3/projects/7ad26be0e227445fa83bbe8451353a3b/users/e7b0684ad4a3419bba53ffefbb5ea01f/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:28.142151 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bd44e-9964-4ab9-bc80-b6b8361b7045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad26be0e227445fa83bbe8451353a3b, user_id=e7b0684ad4a3419bba53ffefbb5ea01f, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:28.144929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bd44e-9964-4ab9-bc80-b6b8361b7045 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:28.146268 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6983c5-88d3-4508-a178-9795207ab500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01221c1c85cb427fb1f652e67b1f8f78, user_id=30052c495a23457cb30f6bb0bb32c647, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:28.148974 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6983c5-88d3-4508-a178-9795207ab500 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:28.165369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 961/1929] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:28 2022] PUT /identity/v3/projects/7ad26be0e227445fa83bbe8451353a3b/users/e7b0684ad4a3419bba53ffefbb5ea01f/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:28.165369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9053efe-f3b3-4d23-9a40-bf6a9a9ab545 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:28.165369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9053efe-f3b3-4d23-9a40-bf6a9a9ab545 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:28.165369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9053efe-f3b3-4d23-9a40-bf6a9a9ab545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:28.168700 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 969/1930] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:28 2022] PUT /identity/v3/projects/01221c1c85cb427fb1f652e67b1f8f78/users/30052c495a23457cb30f6bb0bb32c647/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:28.170011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4df201-9aca-4fb1-b96e-c79dc72f78d7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:28.170298 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4df201-9aca-4fb1-b96e-c79dc72f78d7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:28.170576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4df201-9aca-4fb1-b96e-c79dc72f78d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:28.194500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d9053efe-f3b3-4d23-9a40-bf6a9a9ab545 None None] MFA Rules not processed for user `9315ee27246f4459844f6a4410842d15`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:28.195779 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1d4df201-9aca-4fb1-b96e-c79dc72f78d7 None None] MFA Rules not processed for user `e7b0684ad4a3419bba53ffefbb5ea01f`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:28.196564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d9053efe-f3b3-4d23-9a40-bf6a9a9ab545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:28.196967 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1d4df201-9aca-4fb1-b96e-c79dc72f78d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:28.266146 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 962/1931] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:28.267247 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9053efe-f3b3-4d23-9a40-bf6a9a9ab545 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:28.276469 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 970/1932] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:28 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:28.278000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4df201-9aca-4fb1-b96e-c79dc72f78d7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:28.349797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9053efe-f3b3-4d23-9a40-bf6a9a9ab545 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:28.351454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:28.355459 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12c3f2-4d9e-499f-9baf-db48b96cfc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:28.356455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12c3f2-4d9e-499f-9baf-db48b96cfc5c admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:28.356741 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12c3f2-4d9e-499f-9baf-db48b96cfc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:28.357017 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12c3f2-4d9e-499f-9baf-db48b96cfc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:28.357111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4df201-9aca-4fb1-b96e-c79dc72f78d7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:28.357797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12c3f2-4d9e-499f-9baf-db48b96cfc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:28.359638 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12c3f2-4d9e-499f-9baf-db48b96cfc5c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:28.363550 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19621f44-dc03-419b-bd2d-94fd91713148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:28.364228 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19621f44-dc03-419b-bd2d-94fd91713148 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:28.364518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19621f44-dc03-419b-bd2d-94fd91713148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:28.364857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19621f44-dc03-419b-bd2d-94fd91713148 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:28.365610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19621f44-dc03-419b-bd2d-94fd91713148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:28.367539 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19621f44-dc03-419b-bd2d-94fd91713148 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:28.370430 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 963/1933] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:28.371138 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12c3f2-4d9e-499f-9baf-db48b96cfc5c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:28.372726 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5d12c3f2-4d9e-499f-9baf-db48b96cfc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:28.397533 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 971/1934] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:28 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:28.398413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19621f44-dc03-419b-bd2d-94fd91713148 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:28.400777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:28.434629 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12c3f2-4d9e-499f-9baf-db48b96cfc5c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:28.472196 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19621f44-dc03-419b-bd2d-94fd91713148 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:28.477030 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6167f0-7808-45da-bb0c-ed968a4aa861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:28.477966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6167f0-7808-45da-bb0c-ed968a4aa861 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:28.478358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6167f0-7808-45da-bb0c-ed968a4aa861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:28.478644 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6167f0-7808-45da-bb0c-ed968a4aa861 admin admin] PATH_INFO: `/v3/projects/01221c1c85cb427fb1f652e67b1f8f78/users/30052c495a23457cb30f6bb0bb32c647/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:28.480659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6167f0-7808-45da-bb0c-ed968a4aa861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01221c1c85cb427fb1f652e67b1f8f78, user_id=30052c495a23457cb30f6bb0bb32c647, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:28.483711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6167f0-7808-45da-bb0c-ed968a4aa861 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:28.487969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5446f78-7bac-4817-8a19-3780c9147fa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:28.488669 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5446f78-7bac-4817-8a19-3780c9147fa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:28.488956 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5446f78-7bac-4817-8a19-3780c9147fa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:28.489236 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5446f78-7bac-4817-8a19-3780c9147fa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:28.494999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 972/1935] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:28 2022] PUT /identity/v3/projects/01221c1c85cb427fb1f652e67b1f8f78/users/30052c495a23457cb30f6bb0bb32c647/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:28.495807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6167f0-7808-45da-bb0c-ed968a4aa861 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:28.558576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5446f78-7bac-4817-8a19-3780c9147fa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:28.560013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5446f78-7bac-4817-8a19-3780c9147fa5 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:28.574764 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 964/1936] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:28 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:28.576857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff883a8f-46c1-4837-948a-093dd1c0be31 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:28.577274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff883a8f-46c1-4837-948a-093dd1c0be31 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:28.577607 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff883a8f-46c1-4837-948a-093dd1c0be31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:28.585679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6167f0-7808-45da-bb0c-ed968a4aa861 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:28.593523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35181d5-afa7-498c-a6ca-3dc1be9e605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:28.594906 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35181d5-afa7-498c-a6ca-3dc1be9e605b admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:28.595437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35181d5-afa7-498c-a6ca-3dc1be9e605b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:28.595855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35181d5-afa7-498c-a6ca-3dc1be9e605b admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:28.596691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35181d5-afa7-498c-a6ca-3dc1be9e605b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:28.598978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35181d5-afa7-498c-a6ca-3dc1be9e605b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:28.625385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ff883a8f-46c1-4837-948a-093dd1c0be31 None None] MFA Rules not processed for user `30052c495a23457cb30f6bb0bb32c647`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:28.629620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ff883a8f-46c1-4837-948a-093dd1c0be31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:28.632802 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 973/1937] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:28 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:28.635190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35181d5-afa7-498c-a6ca-3dc1be9e605b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:28.658638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35181d5-afa7-498c-a6ca-3dc1be9e605b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:28.675840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51322e0a-0ecf-41f3-8afc-4bdb694d094f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:28.677121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51322e0a-0ecf-41f3-8afc-4bdb694d094f admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:28.677618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51322e0a-0ecf-41f3-8afc-4bdb694d094f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:28.678296 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51322e0a-0ecf-41f3-8afc-4bdb694d094f admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:28.679115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51322e0a-0ecf-41f3-8afc-4bdb694d094f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:28.682165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51322e0a-0ecf-41f3-8afc-4bdb694d094f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:28.708165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 974/1938] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:28.708165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51322e0a-0ecf-41f3-8afc-4bdb694d094f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:28.723064 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51322e0a-0ecf-41f3-8afc-4bdb694d094f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:28.729111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c5caf-db5e-46e4-80e8-cd013002a26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:28.730613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c5caf-db5e-46e4-80e8-cd013002a26b admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:28.730613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c5caf-db5e-46e4-80e8-cd013002a26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:28.731118 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c5caf-db5e-46e4-80e8-cd013002a26b admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:28.732054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c5caf-db5e-46e4-80e8-cd013002a26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:28.734061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c5caf-db5e-46e4-80e8-cd013002a26b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:28.755964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 975/1939] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:28.760559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c5caf-db5e-46e4-80e8-cd013002a26b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:28.761266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 965/1940] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:28.775183 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c5caf-db5e-46e4-80e8-cd013002a26b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:28.781896 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73930d-a3f5-4607-83c2-efef47a84e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:28.782964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73930d-a3f5-4607-83c2-efef47a84e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:28.783463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73930d-a3f5-4607-83c2-efef47a84e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:28.783743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73930d-a3f5-4607-83c2-efef47a84e46 admin admin] PATH_INFO: `/v3/projects/91b248a57a4e4e06a32cda326b08f1f0/users/7c1864cf648f42b7af86a6d43fae19fb/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:28.825778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73930d-a3f5-4607-83c2-efef47a84e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b248a57a4e4e06a32cda326b08f1f0, user_id=7c1864cf648f42b7af86a6d43fae19fb, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:28.828494 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73930d-a3f5-4607-83c2-efef47a84e46 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:28.843609 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 976/1941] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:28 2022] PUT /identity/v3/projects/91b248a57a4e4e06a32cda326b08f1f0/users/7c1864cf648f42b7af86a6d43fae19fb/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:28.850137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff883a8f-46c1-4837-948a-093dd1c0be31 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:28.855703 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1949af-3c62-49ae-baa4-d0b59ad734db None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:28.856788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1949af-3c62-49ae-baa4-d0b59ad734db None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:28.857082 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1949af-3c62-49ae-baa4-d0b59ad734db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:28.864938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:28.889520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5b1949af-3c62-49ae-baa4-d0b59ad734db None None] MFA Rules not processed for user `7c1864cf648f42b7af86a6d43fae19fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:28.891109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5b1949af-3c62-49ae-baa4-d0b59ad734db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:28.900178 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:28.927882 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff883a8f-46c1-4837-948a-093dd1c0be31 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:28.971925 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 977/1942] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:35:28.977310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1949af-3c62-49ae-baa4-d0b59ad734db None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:28.984869 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01799653-0cf8-4c99-a3c1-a72709960497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:28.985816 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01799653-0cf8-4c99-a3c1-a72709960497 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:28.986365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01799653-0cf8-4c99-a3c1-a72709960497 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:28.986785 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01799653-0cf8-4c99-a3c1-a72709960497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:29.048129 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1949af-3c62-49ae-baa4-d0b59ad734db None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:29.053591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960601e6-b7e2-4361-8b4f-98d96e2d85b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:29.054267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960601e6-b7e2-4361-8b4f-98d96e2d85b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:29.054551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960601e6-b7e2-4361-8b4f-98d96e2d85b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:29.054827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960601e6-b7e2-4361-8b4f-98d96e2d85b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:29.055526 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960601e6-b7e2-4361-8b4f-98d96e2d85b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:29.057509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960601e6-b7e2-4361-8b4f-98d96e2d85b0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:29.059973 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01799653-0cf8-4c99-a3c1-a72709960497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:29.061733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01799653-0cf8-4c99-a3c1-a72709960497 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:29.078816 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 966/1943] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:29.079530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01799653-0cf8-4c99-a3c1-a72709960497 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:29.087738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 978/1944] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:28 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:29.090353 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01799653-0cf8-4c99-a3c1-a72709960497 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:29.091898 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960601e6-b7e2-4361-8b4f-98d96e2d85b0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:29.160733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0d0d6-c2ce-40c6-a81f-5ce2ec4d0cad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:29.161700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0d0d6-c2ce-40c6-a81f-5ce2ec4d0cad service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:29.162078 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0d0d6-c2ce-40c6-a81f-5ce2ec4d0cad service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:29.162413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0d0d6-c2ce-40c6-a81f-5ce2ec4d0cad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:29.163763 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960601e6-b7e2-4361-8b4f-98d96e2d85b0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:29.169288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0958f4-40a4-4284-b94e-c8a787da4577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:29.169995 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0958f4-40a4-4284-b94e-c8a787da4577 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:29.170280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0958f4-40a4-4284-b94e-c8a787da4577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:29.170553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0958f4-40a4-4284-b94e-c8a787da4577 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:29.171370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0958f4-40a4-4284-b94e-c8a787da4577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:29.173276 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0958f4-40a4-4284-b94e-c8a787da4577 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:29.198194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:29.199874 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 979/1945] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:29 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:35:29.204026 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0958f4-40a4-4284-b94e-c8a787da4577 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:29.213725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0958f4-40a4-4284-b94e-c8a787da4577 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:29.218352 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141caede-51f9-4d47-8c87-d8de0ffc0fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:29.219020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141caede-51f9-4d47-8c87-d8de0ffc0fcb admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:29.219306 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141caede-51f9-4d47-8c87-d8de0ffc0fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:29.219586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141caede-51f9-4d47-8c87-d8de0ffc0fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:29.220315 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141caede-51f9-4d47-8c87-d8de0ffc0fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:29.221952 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141caede-51f9-4d47-8c87-d8de0ffc0fcb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:29.226527 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0d0d6-c2ce-40c6-a81f-5ce2ec4d0cad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:29.227981 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0d0d6-c2ce-40c6-a81f-5ce2ec4d0cad service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:29.232720 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 980/1946] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:29.236842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141caede-51f9-4d47-8c87-d8de0ffc0fcb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:29.238420 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 967/1947] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:29.247252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141caede-51f9-4d47-8c87-d8de0ffc0fcb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:29.251944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf10e1f-47f6-4454-8159-6707efe1920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:29.252871 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf10e1f-47f6-4454-8159-6707efe1920c admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:29.253157 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf10e1f-47f6-4454-8159-6707efe1920c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:29.253468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf10e1f-47f6-4454-8159-6707efe1920c admin admin] PATH_INFO: `/v3/projects/9efb392e5fb84615bec6a79b6713de02/users/90e978cd40a64d8580e738c9d6c8d8fc/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:29.265333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:29.269236 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf10e1f-47f6-4454-8159-6707efe1920c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efb392e5fb84615bec6a79b6713de02, user_id=90e978cd40a64d8580e738c9d6c8d8fc, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:29.272705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf10e1f-47f6-4454-8159-6707efe1920c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:29.294070 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 981/1948] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:29 2022] PUT /identity/v3/projects/9efb392e5fb84615bec6a79b6713de02/users/90e978cd40a64d8580e738c9d6c8d8fc/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:35:29.298158 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0d0d6-c2ce-40c6-a81f-5ce2ec4d0cad service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:29.309544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0d0d6-c2ce-40c6-a81f-5ce2ec4d0cad service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:29.384645 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c9cfa-b394-4fbe-a8d9-8a6925240dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:29.385372 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c9cfa-b394-4fbe-a8d9-8a6925240dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:29.389966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c9cfa-b394-4fbe-a8d9-8a6925240dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:29.389966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c9cfa-b394-4fbe-a8d9-8a6925240dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:29.389966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c9cfa-b394-4fbe-a8d9-8a6925240dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:29.389966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c9cfa-b394-4fbe-a8d9-8a6925240dd9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:29.399982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 968/1949] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:29.404343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf10e1f-47f6-4454-8159-6707efe1920c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:29.416634 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf10e1f-47f6-4454-8159-6707efe1920c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:29.421890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223e29e-d526-47a4-a87a-dff4af7e31ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:29.422949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223e29e-d526-47a4-a87a-dff4af7e31ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:29.423379 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223e29e-d526-47a4-a87a-dff4af7e31ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:29.423531 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223e29e-d526-47a4-a87a-dff4af7e31ce admin admin] PATH_INFO: `/v3/projects/9efb392e5fb84615bec6a79b6713de02/users/90e978cd40a64d8580e738c9d6c8d8fc/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:29.425770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223e29e-d526-47a4-a87a-dff4af7e31ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9efb392e5fb84615bec6a79b6713de02, user_id=90e978cd40a64d8580e738c9d6c8d8fc, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:29.428554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223e29e-d526-47a4-a87a-dff4af7e31ce admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:29.449989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 982/1950] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:29 2022] PUT /identity/v3/projects/9efb392e5fb84615bec6a79b6713de02/users/90e978cd40a64d8580e738c9d6c8d8fc/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:35:29.460994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814b505-fca7-45f4-a278-7de288c24da2 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:29.461288 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814b505-fca7-45f4-a278-7de288c24da2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:29.461715 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814b505-fca7-45f4-a278-7de288c24da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:29.493840 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b814b505-fca7-45f4-a278-7de288c24da2 None None] MFA Rules not processed for user `90e978cd40a64d8580e738c9d6c8d8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:29.495053 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b814b505-fca7-45f4-a278-7de288c24da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:29.578023 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 969/1951] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:29.755534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223e29e-d526-47a4-a87a-dff4af7e31ce admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:29.823603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223e29e-d526-47a4-a87a-dff4af7e31ce admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:29.827539 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0cb24-a7dc-4b51-b113-dbac4500be4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:29.828194 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0cb24-a7dc-4b51-b113-dbac4500be4d service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:29.828468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0cb24-a7dc-4b51-b113-dbac4500be4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:29.828746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0cb24-a7dc-4b51-b113-dbac4500be4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:29.839765 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0cb24-a7dc-4b51-b113-dbac4500be4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:29.841297 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0cb24-a7dc-4b51-b113-dbac4500be4d service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:29.858603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 983/1952] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:30.034298 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814b505-fca7-45f4-a278-7de288c24da2 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:30.129674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:30.138567 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814b505-fca7-45f4-a278-7de288c24da2 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:30.143259 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb17ff-2e10-4e27-af80-ea47710e2d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:30.144605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb17ff-2e10-4e27-af80-ea47710e2d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:30.145113 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb17ff-2e10-4e27-af80-ea47710e2d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:30.145492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb17ff-2e10-4e27-af80-ea47710e2d1f admin admin] PATH_INFO: `/v3/users/18e9f7d8a47d4dfcb2ada398c45edc4c` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:30.147053 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb17ff-2e10-4e27-af80-ea47710e2d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e9f7d8a47d4dfcb2ada398c45edc4c)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:30.149262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb17ff-2e10-4e27-af80-ea47710e2d1f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:30.217874 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-94bb17ff-2e10-4e27-af80-ea47710e2d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e9f7d8a47d4dfcb2ada398c45edc4c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:30.226366 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-94bb17ff-2e10-4e27-af80-ea47710e2d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e9f7d8a47d4dfcb2ada398c45edc4c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:30.227072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-94bb17ff-2e10-4e27-af80-ea47710e2d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e9f7d8a47d4dfcb2ada398c45edc4c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:30.227771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-94bb17ff-2e10-4e27-af80-ea47710e2d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e9f7d8a47d4dfcb2ada398c45edc4c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:30.250042 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-94bb17ff-2e10-4e27-af80-ea47710e2d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e9f7d8a47d4dfcb2ada398c45edc4c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:30.265570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 970/1953] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:30 2022] DELETE /identity/v3/users/18e9f7d8a47d4dfcb2ada398c45edc4c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:30.270253 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe4144-05d5-4314-a2d1-cb8459796483 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:30.270647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe4144-05d5-4314-a2d1-cb8459796483 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:30.271095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe4144-05d5-4314-a2d1-cb8459796483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:30.291355 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f2fe4144-05d5-4314-a2d1-cb8459796483 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:30.292556 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f2fe4144-05d5-4314-a2d1-cb8459796483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:30.365793 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 984/1954] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:35:30.378984 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb17ff-2e10-4e27-af80-ea47710e2d1f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:30.381151 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-94bb17ff-2e10-4e27-af80-ea47710e2d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:30.460630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb17ff-2e10-4e27-af80-ea47710e2d1f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:30.466180 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5ebe9-e234-4308-b27b-fa6d42b13aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:30.467155 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5ebe9-e234-4308-b27b-fa6d42b13aff service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:30.467446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5ebe9-e234-4308-b27b-fa6d42b13aff service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:30.468162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5ebe9-e234-4308-b27b-fa6d42b13aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:30.481409 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5ebe9-e234-4308-b27b-fa6d42b13aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:30.485611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5ebe9-e234-4308-b27b-fa6d42b13aff service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:30.497231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 971/1955] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:30.698095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe4144-05d5-4314-a2d1-cb8459796483 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:30.699519 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f2fe4144-05d5-4314-a2d1-cb8459796483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:30.757488 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe4144-05d5-4314-a2d1-cb8459796483 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:30.764511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce122ad-1418-4b2f-9b21-cf0ae1efa561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:30.765216 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce122ad-1418-4b2f-9b21-cf0ae1efa561 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:30.765530 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce122ad-1418-4b2f-9b21-cf0ae1efa561 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:30.765852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce122ad-1418-4b2f-9b21-cf0ae1efa561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:30.767816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5ce122ad-1418-4b2f-9b21-cf0ae1efa561 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:30.814418 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5ebe9-e234-4308-b27b-fa6d42b13aff service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:30.816142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b2a5ebe9-e234-4308-b27b-fa6d42b13aff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:30.831581 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:30.841863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5ebe9-e234-4308-b27b-fa6d42b13aff service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:30.850474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801af70-ffbf-469b-bc8d-22b0a323f34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:30.851423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801af70-ffbf-469b-bc8d-22b0a323f34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:30.851712 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801af70-ffbf-469b-bc8d-22b0a323f34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:30.851994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801af70-ffbf-469b-bc8d-22b0a323f34f admin admin] PATH_INFO: `/v3/projects/bdc25f5b63064917b8e421ead6315f9c` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:30.853491 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801af70-ffbf-469b-bc8d-22b0a323f34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc25f5b63064917b8e421ead6315f9c)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:30.855503 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801af70-ffbf-469b-bc8d-22b0a323f34f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:30.870214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce122ad-1418-4b2f-9b21-cf0ae1efa561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:30.871703 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce122ad-1418-4b2f-9b21-cf0ae1efa561 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:30.885887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 985/1956] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:30.918471 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c801af70-ffbf-469b-bc8d-22b0a323f34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc25f5b63064917b8e421ead6315f9c', 'request_id': 'req-c801af70-ffbf-469b-bc8d-22b0a323f34f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:30.926981 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c801af70-ffbf-469b-bc8d-22b0a323f34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc25f5b63064917b8e421ead6315f9c', 'request_id': 'req-c801af70-ffbf-469b-bc8d-22b0a323f34f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:30.934262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c801af70-ffbf-469b-bc8d-22b0a323f34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc25f5b63064917b8e421ead6315f9c', 'request_id': 'req-c801af70-ffbf-469b-bc8d-22b0a323f34f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:30.944398 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:30.951161 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c801af70-ffbf-469b-bc8d-22b0a323f34f admin admin] The token cache is being invalidate because project bdc25f5b63064917b8e421ead6315f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:30.951892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c801af70-ffbf-469b-bc8d-22b0a323f34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:30.952550 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c801af70-ffbf-469b-bc8d-22b0a323f34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:30.954678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 972/1957] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:30 2022] DELETE /identity/v3/projects/bdc25f5b63064917b8e421ead6315f9c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:30.958895 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce122ad-1418-4b2f-9b21-cf0ae1efa561 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:30.969970 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce122ad-1418-4b2f-9b21-cf0ae1efa561 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:31.047570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695623f6-07d8-4851-9754-53bdf9f34400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:31.048396 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695623f6-07d8-4851-9754-53bdf9f34400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:31.048687 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695623f6-07d8-4851-9754-53bdf9f34400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:31.048983 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695623f6-07d8-4851-9754-53bdf9f34400 admin admin] PATH_INFO: `/v3/users/30052c495a23457cb30f6bb0bb32c647` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:31.053458 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695623f6-07d8-4851-9754-53bdf9f34400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30052c495a23457cb30f6bb0bb32c647)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:31.058199 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695623f6-07d8-4851-9754-53bdf9f34400 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:31.150388 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-695623f6-07d8-4851-9754-53bdf9f34400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30052c495a23457cb30f6bb0bb32c647'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:31.161991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-695623f6-07d8-4851-9754-53bdf9f34400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30052c495a23457cb30f6bb0bb32c647'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:31.163590 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-695623f6-07d8-4851-9754-53bdf9f34400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30052c495a23457cb30f6bb0bb32c647'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:31.164464 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-695623f6-07d8-4851-9754-53bdf9f34400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30052c495a23457cb30f6bb0bb32c647'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:31.179162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-695623f6-07d8-4851-9754-53bdf9f34400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30052c495a23457cb30f6bb0bb32c647'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:31.205656 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 986/1958] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:30 2022] DELETE /identity/v3/users/30052c495a23457cb30f6bb0bb32c647 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:31.610978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801af70-ffbf-469b-bc8d-22b0a323f34f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:31.613030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c801af70-ffbf-469b-bc8d-22b0a323f34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:31.641779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801af70-ffbf-469b-bc8d-22b0a323f34f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:31.670124 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695623f6-07d8-4851-9754-53bdf9f34400 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:31.671597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-695623f6-07d8-4851-9754-53bdf9f34400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:31.749269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209a14d-bd59-41a9-9d02-08584087e83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:31.750936 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209a14d-bd59-41a9-9d02-08584087e83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:31.751216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209a14d-bd59-41a9-9d02-08584087e83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:31.751532 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209a14d-bd59-41a9-9d02-08584087e83d admin admin] PATH_INFO: `/v3/users/fbd2037aa5464e4eb3772ce65ce46b5c` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:31.752850 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209a14d-bd59-41a9-9d02-08584087e83d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd2037aa5464e4eb3772ce65ce46b5c)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:31.756175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209a14d-bd59-41a9-9d02-08584087e83d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:31.828200 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8209a14d-bd59-41a9-9d02-08584087e83d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd2037aa5464e4eb3772ce65ce46b5c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:31.842728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:31.844968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8209a14d-bd59-41a9-9d02-08584087e83d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd2037aa5464e4eb3772ce65ce46b5c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:31.845944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8209a14d-bd59-41a9-9d02-08584087e83d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd2037aa5464e4eb3772ce65ce46b5c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:31.846915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8209a14d-bd59-41a9-9d02-08584087e83d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd2037aa5464e4eb3772ce65ce46b5c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:31.866771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695623f6-07d8-4851-9754-53bdf9f34400 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:31.876583 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72142c9-6ef7-42de-9b10-8bfb676f227a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:31.887237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72142c9-6ef7-42de-9b10-8bfb676f227a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:31.888291 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8209a14d-bd59-41a9-9d02-08584087e83d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd2037aa5464e4eb3772ce65ce46b5c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:31.889700 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72142c9-6ef7-42de-9b10-8bfb676f227a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:31.890436 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72142c9-6ef7-42de-9b10-8bfb676f227a admin admin] PATH_INFO: `/v3/projects/01221c1c85cb427fb1f652e67b1f8f78` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:31.893179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72142c9-6ef7-42de-9b10-8bfb676f227a admin admin] RBAC: Authorizing `identity:delete_project(project_id=01221c1c85cb427fb1f652e67b1f8f78)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:31.895683 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72142c9-6ef7-42de-9b10-8bfb676f227a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:31.919418 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 973/1959] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:31 2022] DELETE /identity/v3/users/fbd2037aa5464e4eb3772ce65ce46b5c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:31.923862 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faecc79-b4e3-46d8-aa74-b664f96c58db None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:31.924228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faecc79-b4e3-46d8-aa74-b664f96c58db None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:31.924626 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faecc79-b4e3-46d8-aa74-b664f96c58db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:31.948569 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1faecc79-b4e3-46d8-aa74-b664f96c58db None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:31.949863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1faecc79-b4e3-46d8-aa74-b664f96c58db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:31.969003 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a72142c9-6ef7-42de-9b10-8bfb676f227a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01221c1c85cb427fb1f652e67b1f8f78', 'request_id': 'req-a72142c9-6ef7-42de-9b10-8bfb676f227a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:31.974777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a72142c9-6ef7-42de-9b10-8bfb676f227a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01221c1c85cb427fb1f652e67b1f8f78', 'request_id': 'req-a72142c9-6ef7-42de-9b10-8bfb676f227a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:31.981333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a72142c9-6ef7-42de-9b10-8bfb676f227a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01221c1c85cb427fb1f652e67b1f8f78', 'request_id': 'req-a72142c9-6ef7-42de-9b10-8bfb676f227a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:31.996865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a72142c9-6ef7-42de-9b10-8bfb676f227a admin admin] The token cache is being invalidate because project 01221c1c85cb427fb1f652e67b1f8f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:31.997198 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a72142c9-6ef7-42de-9b10-8bfb676f227a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:31.998166 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a72142c9-6ef7-42de-9b10-8bfb676f227a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:32.000355 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 987/1960] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:31 2022] DELETE /identity/v3/projects/01221c1c85cb427fb1f652e67b1f8f78 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:35:32.005025 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28483d4a-91d3-42ab-be98-6fe6126b20e4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:32.005419 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28483d4a-91d3-42ab-be98-6fe6126b20e4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:32.005709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28483d4a-91d3-42ab-be98-6fe6126b20e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:32.022809 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 974/1961] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:32.028998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faecc79-b4e3-46d8-aa74-b664f96c58db None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:32.030423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1faecc79-b4e3-46d8-aa74-b664f96c58db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:32.032601 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-28483d4a-91d3-42ab-be98-6fe6126b20e4 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:32.034082 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-28483d4a-91d3-42ab-be98-6fe6126b20e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:32.049224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 988/1962] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:35:32.051089 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df1d3b-e22b-46ff-b264-4dc5f598523e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:32.051679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df1d3b-e22b-46ff-b264-4dc5f598523e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:32.052043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df1d3b-e22b-46ff-b264-4dc5f598523e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:32.059317 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:32.073788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-98df1d3b-e22b-46ff-b264-4dc5f598523e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:32.075851 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-98df1d3b-e22b-46ff-b264-4dc5f598523e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:32.090727 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 989/1963] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:32.091337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df1d3b-e22b-46ff-b264-4dc5f598523e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:32.101963 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df1d3b-e22b-46ff-b264-4dc5f598523e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:32.107493 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfb4ff-9ebc-40ef-aa92-8f823617748f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:32.108190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfb4ff-9ebc-40ef-aa92-8f823617748f admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:32.108479 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfb4ff-9ebc-40ef-aa92-8f823617748f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:32.109096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfb4ff-9ebc-40ef-aa92-8f823617748f admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:32.109958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfb4ff-9ebc-40ef-aa92-8f823617748f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:32.110185 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfb4ff-9ebc-40ef-aa92-8f823617748f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:32.112149 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfb4ff-9ebc-40ef-aa92-8f823617748f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:32.125975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faecc79-b4e3-46d8-aa74-b664f96c58db None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:32.129901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 990/1964] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:32.130540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfb4ff-9ebc-40ef-aa92-8f823617748f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:32.131583 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126f111-c5d3-457f-888f-609b30d54a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:32.132257 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126f111-c5d3-457f-888f-609b30d54a49 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:32.132542 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126f111-c5d3-457f-888f-609b30d54a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:32.132906 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126f111-c5d3-457f-888f-609b30d54a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:32.140837 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfb4ff-9ebc-40ef-aa92-8f823617748f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:32.142944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126f111-c5d3-457f-888f-609b30d54a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:32.144424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126f111-c5d3-457f-888f-609b30d54a49 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:32.146671 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abc585-8d2f-4268-9ab3-8e21cbb03ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:32.147426 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abc585-8d2f-4268-9ab3-8e21cbb03ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:32.147721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abc585-8d2f-4268-9ab3-8e21cbb03ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:32.148012 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abc585-8d2f-4268-9ab3-8e21cbb03ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:32.148756 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abc585-8d2f-4268-9ab3-8e21cbb03ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:32.150762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abc585-8d2f-4268-9ab3-8e21cbb03ea5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:32.154883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 975/1965] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:35:32.193942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 991/1966] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:32 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:35:32.198271 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126f111-c5d3-457f-888f-609b30d54a49 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:32.210361 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126f111-c5d3-457f-888f-609b30d54a49 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:32.298903 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef5fa8-3991-4409-81bd-ec00e2d5cde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:32.301451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef5fa8-3991-4409-81bd-ec00e2d5cde7 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:32.302835 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef5fa8-3991-4409-81bd-ec00e2d5cde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:32.303614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef5fa8-3991-4409-81bd-ec00e2d5cde7 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:32.305227 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef5fa8-3991-4409-81bd-ec00e2d5cde7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:32.315214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef5fa8-3991-4409-81bd-ec00e2d5cde7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:32.349413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 976/1967] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:32 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:32.351517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abc585-8d2f-4268-9ab3-8e21cbb03ea5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:32.374867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abc585-8d2f-4268-9ab3-8e21cbb03ea5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:32.382860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2376c-592a-46a7-87e0-238e07cee58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:32.383948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2376c-592a-46a7-87e0-238e07cee58a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:32.384317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2376c-592a-46a7-87e0-238e07cee58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:32.384743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2376c-592a-46a7-87e0-238e07cee58a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:32.386031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2376c-592a-46a7-87e0-238e07cee58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:32.387689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2376c-592a-46a7-87e0-238e07cee58a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:32.406463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 992/1968] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:32.410726 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef5fa8-3991-4409-81bd-ec00e2d5cde7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:32.430775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef5fa8-3991-4409-81bd-ec00e2d5cde7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:32.440210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534969d0-d2c2-49cf-9558-b18068d68b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:32.440958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534969d0-d2c2-49cf-9558-b18068d68b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:32.441644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534969d0-d2c2-49cf-9558-b18068d68b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:32.441924 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534969d0-d2c2-49cf-9558-b18068d68b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:32.443247 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534969d0-d2c2-49cf-9558-b18068d68b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:32.445501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534969d0-d2c2-49cf-9558-b18068d68b7d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:32.466190 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 977/1969] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:32.469794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2376c-592a-46a7-87e0-238e07cee58a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:32.482675 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2376c-592a-46a7-87e0-238e07cee58a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:32.492320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437a2f3-ba99-42ae-9f40-d57060087201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:32.493958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437a2f3-ba99-42ae-9f40-d57060087201 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:32.494403 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437a2f3-ba99-42ae-9f40-d57060087201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:32.496333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437a2f3-ba99-42ae-9f40-d57060087201 admin admin] PATH_INFO: `/v3/projects/25963a2e2fd147a78da7f408c69204eb/users/a8b7328d042c4237ac6c34a691e66c50/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:32.509608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534969d0-d2c2-49cf-9558-b18068d68b7d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:32.511391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-534969d0-d2c2-49cf-9558-b18068d68b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:32.515210 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437a2f3-ba99-42ae-9f40-d57060087201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25963a2e2fd147a78da7f408c69204eb, user_id=a8b7328d042c4237ac6c34a691e66c50, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:32.518212 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437a2f3-ba99-42ae-9f40-d57060087201 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:32.530771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534969d0-d2c2-49cf-9558-b18068d68b7d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:32.538104 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 993/1970] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:32 2022] PUT /identity/v3/projects/25963a2e2fd147a78da7f408c69204eb/users/a8b7328d042c4237ac6c34a691e66c50/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:32.550951 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9666b69-a136-4e6a-89b8-3e4902f14cfe None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:32.551336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9666b69-a136-4e6a-89b8-3e4902f14cfe None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:32.551765 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9666b69-a136-4e6a-89b8-3e4902f14cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:32.583508 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d9666b69-a136-4e6a-89b8-3e4902f14cfe None None] MFA Rules not processed for user `a8b7328d042c4237ac6c34a691e66c50`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:32.584719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d9666b69-a136-4e6a-89b8-3e4902f14cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:32.624125 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:32.625216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:32.625550 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:32.625839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2 admin admin] PATH_INFO: `/v3/projects/9090f8a2682643ac9f700f1079f4e8d5` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:32.627694 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9090f8a2682643ac9f700f1079f4e8d5)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:32.629660 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:32.652035 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:32.678134 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 994/1971] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:32.685153 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:32.687128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9666b69-a136-4e6a-89b8-3e4902f14cfe None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:32.688576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d9666b69-a136-4e6a-89b8-3e4902f14cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:32.690390 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9090f8a2682643ac9f700f1079f4e8d5', 'request_id': 'req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:32.698707 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9090f8a2682643ac9f700f1079f4e8d5', 'request_id': 'req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:32.708346 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9090f8a2682643ac9f700f1079f4e8d5', 'request_id': 'req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:32.724998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2 admin admin] The token cache is being invalidate because project 9090f8a2682643ac9f700f1079f4e8d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:32.725576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:32.726143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:32.727989 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 978/1972] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:32 2022] DELETE /identity/v3/projects/9090f8a2682643ac9f700f1079f4e8d5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:32.732965 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:32.734515 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:32.754683 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9666b69-a136-4e6a-89b8-3e4902f14cfe None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:32.804803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa9d63-9763-4f5e-8db9-a6ff845d14ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:32.805212 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7107fe9-ed4a-4fd8-9a7b-3c69061283a2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:32.806373 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa9d63-9763-4f5e-8db9-a6ff845d14ff service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:32.806373 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa9d63-9763-4f5e-8db9-a6ff845d14ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:32.806373 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa9d63-9763-4f5e-8db9-a6ff845d14ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:32.809004 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9afa9d63-9763-4f5e-8db9-a6ff845d14ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:32.812251 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa577480-02b6-4a43-b116-068094da1000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:32.813289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa577480-02b6-4a43-b116-068094da1000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:32.813609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa577480-02b6-4a43-b116-068094da1000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:32.813891 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa577480-02b6-4a43-b116-068094da1000 admin admin] PATH_INFO: `/v3/users/9f7b5fa33e0e40429b5771b3085955dd` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:32.817146 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa577480-02b6-4a43-b116-068094da1000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7b5fa33e0e40429b5771b3085955dd)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:32.818758 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa577480-02b6-4a43-b116-068094da1000 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:32.884170 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fa577480-02b6-4a43-b116-068094da1000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7b5fa33e0e40429b5771b3085955dd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:32.896859 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fa577480-02b6-4a43-b116-068094da1000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7b5fa33e0e40429b5771b3085955dd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:32.898009 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fa577480-02b6-4a43-b116-068094da1000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7b5fa33e0e40429b5771b3085955dd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:32.898666 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fa577480-02b6-4a43-b116-068094da1000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7b5fa33e0e40429b5771b3085955dd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:32.918029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-fa577480-02b6-4a43-b116-068094da1000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7b5fa33e0e40429b5771b3085955dd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:32.928475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa9d63-9763-4f5e-8db9-a6ff845d14ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:32.931847 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa9d63-9763-4f5e-8db9-a6ff845d14ff service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:32.942725 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 979/1973] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:32 2022] DELETE /identity/v3/users/9f7b5fa33e0e40429b5771b3085955dd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:32.966806 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 995/1974] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:35:32.980483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa577480-02b6-4a43-b116-068094da1000 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:32.982280 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fa577480-02b6-4a43-b116-068094da1000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:33.022540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa9d63-9763-4f5e-8db9-a6ff845d14ff service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:33.024402 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9afa9d63-9763-4f5e-8db9-a6ff845d14ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:33.040127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa9d63-9763-4f5e-8db9-a6ff845d14ff service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:33.078071 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:33.100463 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa577480-02b6-4a43-b116-068094da1000 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:33.107320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c05ee9-5ed0-4acd-ba72-7e14c81ccbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:33.108496 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c05ee9-5ed0-4acd-ba72-7e14c81ccbe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:33.108786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c05ee9-5ed0-4acd-ba72-7e14c81ccbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:33.109065 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c05ee9-5ed0-4acd-ba72-7e14c81ccbe9 admin admin] PATH_INFO: `/v3/users/a8b7328d042c4237ac6c34a691e66c50` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:33.110326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c05ee9-5ed0-4acd-ba72-7e14c81ccbe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b7328d042c4237ac6c34a691e66c50)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:33.112294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c05ee9-5ed0-4acd-ba72-7e14c81ccbe9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:33.138291 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce975bbf-64ce-4fdc-9871-d8a18e3ddb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:33.139367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce975bbf-64ce-4fdc-9871-d8a18e3ddb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:33.141421 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce975bbf-64ce-4fdc-9871-d8a18e3ddb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:33.142050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce975bbf-64ce-4fdc-9871-d8a18e3ddb7e admin admin] PATH_INFO: `/v3/users/cb401093d4e14c66ac3652612ead2d5b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:33.143616 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce975bbf-64ce-4fdc-9871-d8a18e3ddb7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb401093d4e14c66ac3652612ead2d5b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:33.145779 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce975bbf-64ce-4fdc-9871-d8a18e3ddb7e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:33.147920 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:33.195147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-12c05ee9-5ed0-4acd-ba72-7e14c81ccbe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b7328d042c4237ac6c34a691e66c50'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.207758 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-12c05ee9-5ed0-4acd-ba72-7e14c81ccbe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b7328d042c4237ac6c34a691e66c50'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.208675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-12c05ee9-5ed0-4acd-ba72-7e14c81ccbe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b7328d042c4237ac6c34a691e66c50'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.209141 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-12c05ee9-5ed0-4acd-ba72-7e14c81ccbe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b7328d042c4237ac6c34a691e66c50'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.228215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ce975bbf-64ce-4fdc-9871-d8a18e3ddb7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb401093d4e14c66ac3652612ead2d5b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.233766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-12c05ee9-5ed0-4acd-ba72-7e14c81ccbe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b7328d042c4237ac6c34a691e66c50'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.239959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ce975bbf-64ce-4fdc-9871-d8a18e3ddb7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb401093d4e14c66ac3652612ead2d5b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.241592 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ce975bbf-64ce-4fdc-9871-d8a18e3ddb7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb401093d4e14c66ac3652612ead2d5b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.242633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ce975bbf-64ce-4fdc-9871-d8a18e3ddb7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb401093d4e14c66ac3652612ead2d5b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.252682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 980/1975] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:32 2022] DELETE /identity/v3/users/a8b7328d042c4237ac6c34a691e66c50 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:33.257256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8c7dc-a1b8-4021-8af9-4a080a156553 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:33.258131 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8c7dc-a1b8-4021-8af9-4a080a156553 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:33.258804 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8c7dc-a1b8-4021-8af9-4a080a156553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:33.261200 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ce975bbf-64ce-4fdc-9871-d8a18e3ddb7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb401093d4e14c66ac3652612ead2d5b'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.280537 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 996/1976] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:33 2022] DELETE /identity/v3/users/cb401093d4e14c66ac3652612ead2d5b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:33.284952 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa181e-08af-43df-9487-b05f444b3780 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:33.285249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa181e-08af-43df-9487-b05f444b3780 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:33.285553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa181e-08af-43df-9487-b05f444b3780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:33.288794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-cea8c7dc-a1b8-4021-8af9-4a080a156553 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:33.290809 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-cea8c7dc-a1b8-4021-8af9-4a080a156553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:33.316392 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3afa181e-08af-43df-9487-b05f444b3780 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:33.318076 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3afa181e-08af-43df-9487-b05f444b3780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:33.392757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 981/1977] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:33.392757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8c7dc-a1b8-4021-8af9-4a080a156553 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:33.392757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-cea8c7dc-a1b8-4021-8af9-4a080a156553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:33.404648 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8c7dc-a1b8-4021-8af9-4a080a156553 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:33.405638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 997/1978] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:33.409493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daf5a8-6c35-4e4b-af7c-62843f1d7e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:33.410387 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daf5a8-6c35-4e4b-af7c-62843f1d7e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:33.410496 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa181e-08af-43df-9487-b05f444b3780 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:33.410733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daf5a8-6c35-4e4b-af7c-62843f1d7e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:33.411022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daf5a8-6c35-4e4b-af7c-62843f1d7e80 admin admin] PATH_INFO: `/v3/users/383d493bf686460185e8040c82a23e97` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:33.412001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3afa181e-08af-43df-9487-b05f444b3780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:33.412317 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1daf5a8-6c35-4e4b-af7c-62843f1d7e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=383d493bf686460185e8040c82a23e97)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:33.414942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1daf5a8-6c35-4e4b-af7c-62843f1d7e80 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:33.482607 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d1daf5a8-6c35-4e4b-af7c-62843f1d7e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '383d493bf686460185e8040c82a23e97'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.501740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d1daf5a8-6c35-4e4b-af7c-62843f1d7e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '383d493bf686460185e8040c82a23e97'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.502997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d1daf5a8-6c35-4e4b-af7c-62843f1d7e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '383d493bf686460185e8040c82a23e97'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.503767 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa181e-08af-43df-9487-b05f444b3780 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:33.504743 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d1daf5a8-6c35-4e4b-af7c-62843f1d7e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '383d493bf686460185e8040c82a23e97'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.510017 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afbe62-ea0d-4490-be85-5c63047da139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:33.511526 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afbe62-ea0d-4490-be85-5c63047da139 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:33.512881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afbe62-ea0d-4490-be85-5c63047da139 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:33.513971 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afbe62-ea0d-4490-be85-5c63047da139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:33.514807 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:33.517530 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-01afbe62-ea0d-4490-be85-5c63047da139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:33.524544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d1daf5a8-6c35-4e4b-af7c-62843f1d7e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '383d493bf686460185e8040c82a23e97'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.535927 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afbe62-ea0d-4490-be85-5c63047da139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:33.537440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afbe62-ea0d-4490-be85-5c63047da139 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:33.549030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 982/1979] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:33 2022] DELETE /identity/v3/users/383d493bf686460185e8040c82a23e97 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:33.550410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daf5a8-6c35-4e4b-af7c-62843f1d7e80 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:33.552085 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d1daf5a8-6c35-4e4b-af7c-62843f1d7e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:33.556164 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 998/1980] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:33.557615 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f12077-a984-41dd-a45c-1579f6df04bb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:33.557736 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f12077-a984-41dd-a45c-1579f6df04bb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:33.557945 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f12077-a984-41dd-a45c-1579f6df04bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:33.576633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e2f12077-a984-41dd-a45c-1579f6df04bb None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:33.577989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e2f12077-a984-41dd-a45c-1579f6df04bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:33.599657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:33.621991 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daf5a8-6c35-4e4b-af7c-62843f1d7e80 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:33.626868 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdaeaaa-c369-40ca-9f92-787af87d0f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:33.628560 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaeaaa-c369-40ca-9f92-787af87d0f09 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:33.628719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaeaaa-c369-40ca-9f92-787af87d0f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:33.628987 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaeaaa-c369-40ca-9f92-787af87d0f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:33.631663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8bdaeaaa-c369-40ca-9f92-787af87d0f09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:33.707845 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 999/1981] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:33.707845 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f12077-a984-41dd-a45c-1579f6df04bb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:33.713246 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e2f12077-a984-41dd-a45c-1579f6df04bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:33.729692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdaeaaa-c369-40ca-9f92-787af87d0f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:33.731972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdaeaaa-c369-40ca-9f92-787af87d0f09 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:33.745157 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f12077-a984-41dd-a45c-1579f6df04bb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:33.746627 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 983/1982] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:33.747593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdaeaaa-c369-40ca-9f92-787af87d0f09 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:33.759138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd13f09-d7cb-41af-a340-b7bbb4848582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:33.760081 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd13f09-d7cb-41af-a340-b7bbb4848582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:33.760332 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd13f09-d7cb-41af-a340-b7bbb4848582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:33.760611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd13f09-d7cb-41af-a340-b7bbb4848582 admin admin] PATH_INFO: `/v3/projects/598f7e8bfedc4433badc55d03cd12252` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:33.762069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd13f09-d7cb-41af-a340-b7bbb4848582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=598f7e8bfedc4433badc55d03cd12252)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:33.782672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdaeaaa-c369-40ca-9f92-787af87d0f09 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:33.785664 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd13f09-d7cb-41af-a340-b7bbb4848582 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:33.786606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110d329-49c2-4532-af45-7e009dd993d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:33.787269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110d329-49c2-4532-af45-7e009dd993d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:33.787550 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110d329-49c2-4532-af45-7e009dd993d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:33.787827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110d329-49c2-4532-af45-7e009dd993d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:33.798961 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110d329-49c2-4532-af45-7e009dd993d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:33.800439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110d329-49c2-4532-af45-7e009dd993d3 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:33.812817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 984/1983] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:33.892729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3bd13f09-d7cb-41af-a340-b7bbb4848582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '598f7e8bfedc4433badc55d03cd12252', 'request_id': 'req-3bd13f09-d7cb-41af-a340-b7bbb4848582'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.900209 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3bd13f09-d7cb-41af-a340-b7bbb4848582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '598f7e8bfedc4433badc55d03cd12252', 'request_id': 'req-3bd13f09-d7cb-41af-a340-b7bbb4848582'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.924025 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3bd13f09-d7cb-41af-a340-b7bbb4848582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '598f7e8bfedc4433badc55d03cd12252', 'request_id': 'req-3bd13f09-d7cb-41af-a340-b7bbb4848582'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.954657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3bd13f09-d7cb-41af-a340-b7bbb4848582 admin admin] The token cache is being invalidate because project 598f7e8bfedc4433badc55d03cd12252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:33.954657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3bd13f09-d7cb-41af-a340-b7bbb4848582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.954657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3bd13f09-d7cb-41af-a340-b7bbb4848582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:33.957687 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1000/1984] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:33 2022] DELETE /identity/v3/projects/598f7e8bfedc4433badc55d03cd12252 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:33.962974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecdde8-8b28-4214-b297-ea35d425f16e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:33.963369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecdde8-8b28-4214-b297-ea35d425f16e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:33.963440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecdde8-8b28-4214-b297-ea35d425f16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:33.987803 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-23ecdde8-8b28-4214-b297-ea35d425f16e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:33.989586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-23ecdde8-8b28-4214-b297-ea35d425f16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:34.081663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 985/1985] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:34.084437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc28ca3-463e-473d-8cdb-fbc3709e415e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:34.084781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc28ca3-463e-473d-8cdb-fbc3709e415e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:34.085115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc28ca3-463e-473d-8cdb-fbc3709e415e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:34.113503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7bc28ca3-463e-473d-8cdb-fbc3709e415e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:34.115523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7bc28ca3-463e-473d-8cdb-fbc3709e415e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:34.125391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1001/1986] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:35:34.130423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecdde8-8b28-4214-b297-ea35d425f16e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:34.142851 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecdde8-8b28-4214-b297-ea35d425f16e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:34.148239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd407ce-869d-4bdb-9335-bb333488fcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:34.149156 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd407ce-869d-4bdb-9335-bb333488fcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:34.149544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd407ce-869d-4bdb-9335-bb333488fcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:34.149892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd407ce-869d-4bdb-9335-bb333488fcf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:34.151013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd407ce-869d-4bdb-9335-bb333488fcf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:34.151395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd407ce-869d-4bdb-9335-bb333488fcf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:34.153161 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd407ce-869d-4bdb-9335-bb333488fcf9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:34.180022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 986/1987] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:34.185042 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc28ca3-463e-473d-8cdb-fbc3709e415e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:34.201251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc28ca3-463e-473d-8cdb-fbc3709e415e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:34.213820 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e3a25-6a28-4e26-8a51-1c2d79d6509e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:34.214697 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e3a25-6a28-4e26-8a51-1c2d79d6509e admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:34.215002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e3a25-6a28-4e26-8a51-1c2d79d6509e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:34.215284 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e3a25-6a28-4e26-8a51-1c2d79d6509e admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:34.216052 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e3a25-6a28-4e26-8a51-1c2d79d6509e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:34.218226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e3a25-6a28-4e26-8a51-1c2d79d6509e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:34.254189 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd407ce-869d-4bdb-9335-bb333488fcf9 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:34.257763 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0fd407ce-869d-4bdb-9335-bb333488fcf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:34.266482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1002/1988] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:34 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:35:34.268236 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e3a25-6a28-4e26-8a51-1c2d79d6509e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:34.277626 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd407ce-869d-4bdb-9335-bb333488fcf9 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:34.283101 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:34.360117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e2942-3af8-409f-b621-3f2d4ed41783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:34.361012 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e2942-3af8-409f-b621-3f2d4ed41783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:34.361302 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e2942-3af8-409f-b621-3f2d4ed41783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:34.361619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e2942-3af8-409f-b621-3f2d4ed41783 admin admin] PATH_INFO: `/v3/projects/25963a2e2fd147a78da7f408c69204eb` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:34.362974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e2942-3af8-409f-b621-3f2d4ed41783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25963a2e2fd147a78da7f408c69204eb)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:34.364966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e2942-3af8-409f-b621-3f2d4ed41783 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:34.378143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e3a25-6a28-4e26-8a51-1c2d79d6509e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:34.383505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c3452-d57d-40e9-9fd8-d0685eb927a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:34.384314 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c3452-d57d-40e9-9fd8-d0685eb927a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:34.384706 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c3452-d57d-40e9-9fd8-d0685eb927a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:34.385093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c3452-d57d-40e9-9fd8-d0685eb927a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:34.385959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c3452-d57d-40e9-9fd8-d0685eb927a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:34.388247 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c3452-d57d-40e9-9fd8-d0685eb927a8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:34.437232 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1003/1989] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:34 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:34.438013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-443e2942-3af8-409f-b621-3f2d4ed41783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25963a2e2fd147a78da7f408c69204eb', 'request_id': 'req-443e2942-3af8-409f-b621-3f2d4ed41783'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:34.438490 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c3452-d57d-40e9-9fd8-d0685eb927a8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:34.447276 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-443e2942-3af8-409f-b621-3f2d4ed41783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25963a2e2fd147a78da7f408c69204eb', 'request_id': 'req-443e2942-3af8-409f-b621-3f2d4ed41783'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:34.453277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c3452-d57d-40e9-9fd8-d0685eb927a8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:34.458498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:34.458637 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-443e2942-3af8-409f-b621-3f2d4ed41783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25963a2e2fd147a78da7f408c69204eb', 'request_id': 'req-443e2942-3af8-409f-b621-3f2d4ed41783'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:34.485676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-443e2942-3af8-409f-b621-3f2d4ed41783 admin admin] The token cache is being invalidate because project 25963a2e2fd147a78da7f408c69204eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:34.485676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-443e2942-3af8-409f-b621-3f2d4ed41783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:34.486808 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-443e2942-3af8-409f-b621-3f2d4ed41783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:34.493882 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 987/1990] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:34 2022] DELETE /identity/v3/projects/25963a2e2fd147a78da7f408c69204eb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:34.497489 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8aace-0df6-424c-bdad-7453452e8904 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:34.497784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8aace-0df6-424c-bdad-7453452e8904 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:34.498069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8aace-0df6-424c-bdad-7453452e8904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:34.528597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9ac8aace-0df6-424c-bdad-7453452e8904 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:34.530315 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9ac8aace-0df6-424c-bdad-7453452e8904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:34.569001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212d3c4-60bc-4fab-932e-63750e0cb0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:34.569775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212d3c4-60bc-4fab-932e-63750e0cb0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:34.570168 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212d3c4-60bc-4fab-932e-63750e0cb0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:34.574236 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212d3c4-60bc-4fab-932e-63750e0cb0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:34.575143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212d3c4-60bc-4fab-932e-63750e0cb0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:34.576948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212d3c4-60bc-4fab-932e-63750e0cb0a6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:34.592045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1004/1991] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:34.593152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212d3c4-60bc-4fab-932e-63750e0cb0a6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:34.595024 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8212d3c4-60bc-4fab-932e-63750e0cb0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:34.613962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212d3c4-60bc-4fab-932e-63750e0cb0a6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:34.631748 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 988/1992] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:34.639617 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dae043-6245-4e9c-9059-6be5a351de0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:34.640953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dae043-6245-4e9c-9059-6be5a351de0c admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:34.641698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dae043-6245-4e9c-9059-6be5a351de0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:34.643058 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e61e74-d5ba-4355-85d2-622d4449e140 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:34.643432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dae043-6245-4e9c-9059-6be5a351de0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:34.644307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dae043-6245-4e9c-9059-6be5a351de0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:34.644695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e61e74-d5ba-4355-85d2-622d4449e140 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:34.645760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e61e74-d5ba-4355-85d2-622d4449e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:34.647301 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dae043-6245-4e9c-9059-6be5a351de0c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:34.663396 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1005/1993] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:34.667145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dae043-6245-4e9c-9059-6be5a351de0c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:34.670488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-45e61e74-d5ba-4355-85d2-622d4449e140 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:34.671855 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-45e61e74-d5ba-4355-85d2-622d4449e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:34.677779 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dae043-6245-4e9c-9059-6be5a351de0c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:34.684015 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc44f4-9602-45f8-a86f-cc321f2b6fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:34.684948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc44f4-9602-45f8-a86f-cc321f2b6fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:34.685237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc44f4-9602-45f8-a86f-cc321f2b6fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:34.688594 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc44f4-9602-45f8-a86f-cc321f2b6fe9 admin admin] PATH_INFO: `/v3/projects/800bcffb5ffb4b52bff2538420409081/users/8439941ec202409d9e260c6e9c8851dd/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:34.691625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 989/1994] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:34.693577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e61e74-d5ba-4355-85d2-622d4449e140 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:34.716835 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e61e74-d5ba-4355-85d2-622d4449e140 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:34.723885 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dec945-b1ff-496e-9340-925f7fb92c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:34.724688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dec945-b1ff-496e-9340-925f7fb92c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:34.724845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dec945-b1ff-496e-9340-925f7fb92c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:34.725106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dec945-b1ff-496e-9340-925f7fb92c21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:34.726313 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc44f4-9602-45f8-a86f-cc321f2b6fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=800bcffb5ffb4b52bff2538420409081, user_id=8439941ec202409d9e260c6e9c8851dd, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:34.737208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dec945-b1ff-496e-9340-925f7fb92c21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:34.737208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dec945-b1ff-496e-9340-925f7fb92c21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:34.737208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dec945-b1ff-496e-9340-925f7fb92c21 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:34.737640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc44f4-9602-45f8-a86f-cc321f2b6fe9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:34.747815 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 990/1995] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:34.750506 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dec945-b1ff-496e-9340-925f7fb92c21 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:34.755999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-38dec945-b1ff-496e-9340-925f7fb92c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:34.760237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1006/1996] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:34 2022] PUT /identity/v3/projects/800bcffb5ffb4b52bff2538420409081/users/8439941ec202409d9e260c6e9c8851dd/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:35:34.768825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc44f4-9602-45f8-a86f-cc321f2b6fe9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:34.789577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dec945-b1ff-496e-9340-925f7fb92c21 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:34.808277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:34.828689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc44f4-9602-45f8-a86f-cc321f2b6fe9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:34.834510 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda66da-68e1-4f7a-b5c4-29ab997ced46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:34.835855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda66da-68e1-4f7a-b5c4-29ab997ced46 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:34.836218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda66da-68e1-4f7a-b5c4-29ab997ced46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:34.836575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda66da-68e1-4f7a-b5c4-29ab997ced46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:34.837427 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda66da-68e1-4f7a-b5c4-29ab997ced46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:34.839916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda66da-68e1-4f7a-b5c4-29ab997ced46 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:34.862630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84c383-be6a-439d-a981-663b567d7a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:34.863642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84c383-be6a-439d-a981-663b567d7a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:34.863927 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84c383-be6a-439d-a981-663b567d7a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:34.864201 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84c383-be6a-439d-a981-663b567d7a72 admin admin] PATH_INFO: `/v3/projects/9295192420054671b7d447de153a1775` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:34.865453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84c383-be6a-439d-a981-663b567d7a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9295192420054671b7d447de153a1775)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:34.867365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84c383-be6a-439d-a981-663b567d7a72 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:34.873479 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1007/1997] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:34 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:34.873479 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc4057-8b67-4bdd-a4a5-3729f8db26c4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:34.873479 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc4057-8b67-4bdd-a4a5-3729f8db26c4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:34.873479 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc4057-8b67-4bdd-a4a5-3729f8db26c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:34.911435 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-42cc4057-8b67-4bdd-a4a5-3729f8db26c4 None None] MFA Rules not processed for user `8439941ec202409d9e260c6e9c8851dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:34.912956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-42cc4057-8b67-4bdd-a4a5-3729f8db26c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:34.955192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0e84c383-be6a-439d-a981-663b567d7a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9295192420054671b7d447de153a1775', 'request_id': 'req-0e84c383-be6a-439d-a981-663b567d7a72'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:34.964964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0e84c383-be6a-439d-a981-663b567d7a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9295192420054671b7d447de153a1775', 'request_id': 'req-0e84c383-be6a-439d-a981-663b567d7a72'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:34.983799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:34.999798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0e84c383-be6a-439d-a981-663b567d7a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9295192420054671b7d447de153a1775', 'request_id': 'req-0e84c383-be6a-439d-a981-663b567d7a72'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.027559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1008/1998] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:35.027559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc4057-8b67-4bdd-a4a5-3729f8db26c4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:35.041960 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0e84c383-be6a-439d-a981-663b567d7a72 admin admin] The token cache is being invalidate because project 9295192420054671b7d447de153a1775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:35.042348 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0e84c383-be6a-439d-a981-663b567d7a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.043645 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0e84c383-be6a-439d-a981-663b567d7a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.045639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 991/1999] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:34 2022] DELETE /identity/v3/projects/9295192420054671b7d447de153a1775 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:35.046787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84c383-be6a-439d-a981-663b567d7a72 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:35.048773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0e84c383-be6a-439d-a981-663b567d7a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:35.145502 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc4057-8b67-4bdd-a4a5-3729f8db26c4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:35.152598 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f90954-41ca-430e-b013-b4f62979394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:35.153291 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f90954-41ca-430e-b013-b4f62979394f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:35.153637 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f90954-41ca-430e-b013-b4f62979394f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:35.154165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f90954-41ca-430e-b013-b4f62979394f admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:35.154999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f90954-41ca-430e-b013-b4f62979394f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:35.157030 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f90954-41ca-430e-b013-b4f62979394f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:35.164372 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84c383-be6a-439d-a981-663b567d7a72 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:35.172756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241299b7-bd0f-4a4c-8aea-e481c4bf283e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:35.173700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241299b7-bd0f-4a4c-8aea-e481c4bf283e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:35.174045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241299b7-bd0f-4a4c-8aea-e481c4bf283e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:35.174330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241299b7-bd0f-4a4c-8aea-e481c4bf283e admin admin] PATH_INFO: `/v3/projects/d297a8b7f5be401d9c405e6b349ccf9d` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:35.175894 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241299b7-bd0f-4a4c-8aea-e481c4bf283e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d297a8b7f5be401d9c405e6b349ccf9d)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:35.179823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241299b7-bd0f-4a4c-8aea-e481c4bf283e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:35.185104 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1009/2000] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:35 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:35.186097 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f90954-41ca-430e-b013-b4f62979394f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:35.188591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d4f90954-41ca-430e-b013-b4f62979394f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:35.205331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f90954-41ca-430e-b013-b4f62979394f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:35.212112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f82b7-9390-46bf-a9f4-1c52415b1d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:35.212906 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f82b7-9390-46bf-a9f4-1c52415b1d59 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:35.213397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f82b7-9390-46bf-a9f4-1c52415b1d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:35.213775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f82b7-9390-46bf-a9f4-1c52415b1d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:35.214531 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f82b7-9390-46bf-a9f4-1c52415b1d59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:35.224478 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f82b7-9390-46bf-a9f4-1c52415b1d59 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:35.251246 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-241299b7-bd0f-4a4c-8aea-e481c4bf283e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd297a8b7f5be401d9c405e6b349ccf9d', 'request_id': 'req-241299b7-bd0f-4a4c-8aea-e481c4bf283e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.252188 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1010/2001] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:35 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:35.253096 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:35.254415 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f82b7-9390-46bf-a9f4-1c52415b1d59 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:35.257930 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f91f82b7-9390-46bf-a9f4-1c52415b1d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:35.260190 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-241299b7-bd0f-4a4c-8aea-e481c4bf283e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd297a8b7f5be401d9c405e6b349ccf9d', 'request_id': 'req-241299b7-bd0f-4a4c-8aea-e481c4bf283e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.268448 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-241299b7-bd0f-4a4c-8aea-e481c4bf283e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd297a8b7f5be401d9c405e6b349ccf9d', 'request_id': 'req-241299b7-bd0f-4a4c-8aea-e481c4bf283e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.284337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-241299b7-bd0f-4a4c-8aea-e481c4bf283e admin admin] The token cache is being invalidate because project d297a8b7f5be401d9c405e6b349ccf9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:35.284645 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-241299b7-bd0f-4a4c-8aea-e481c4bf283e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.285570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-241299b7-bd0f-4a4c-8aea-e481c4bf283e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.290477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 992/2002] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:35 2022] DELETE /identity/v3/projects/d297a8b7f5be401d9c405e6b349ccf9d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:35.290477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241299b7-bd0f-4a4c-8aea-e481c4bf283e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:35.291212 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-241299b7-bd0f-4a4c-8aea-e481c4bf283e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:35.348343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f82b7-9390-46bf-a9f4-1c52415b1d59 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:35.353627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf702ff-ac40-494c-afbd-73597496e6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:35.354550 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf702ff-ac40-494c-afbd-73597496e6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:35.354838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf702ff-ac40-494c-afbd-73597496e6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:35.355115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf702ff-ac40-494c-afbd-73597496e6e2 admin admin] PATH_INFO: `/v3/users/e4482cadec43483da3c8d2397adb475a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:35.356743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf702ff-ac40-494c-afbd-73597496e6e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4482cadec43483da3c8d2397adb475a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:35.359055 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf702ff-ac40-494c-afbd-73597496e6e2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:35.371769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241299b7-bd0f-4a4c-8aea-e481c4bf283e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:35.376597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299db71b-8ba3-4a36-b9c0-3f58c10e8c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:35.377361 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299db71b-8ba3-4a36-b9c0-3f58c10e8c14 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:35.377823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299db71b-8ba3-4a36-b9c0-3f58c10e8c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:35.378118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299db71b-8ba3-4a36-b9c0-3f58c10e8c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:35.378931 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299db71b-8ba3-4a36-b9c0-3f58c10e8c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:35.380748 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299db71b-8ba3-4a36-b9c0-3f58c10e8c14 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:35.391825 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 993/2003] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:35.392708 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299db71b-8ba3-4a36-b9c0-3f58c10e8c14 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:35.394377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-299db71b-8ba3-4a36-b9c0-3f58c10e8c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:35.408753 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299db71b-8ba3-4a36-b9c0-3f58c10e8c14 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:35.414178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215b021-ca76-4b99-8b26-d31862ade55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:35.415048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215b021-ca76-4b99-8b26-d31862ade55d admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:35.415346 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9cf702ff-ac40-494c-afbd-73597496e6e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4482cadec43483da3c8d2397adb475a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.415510 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215b021-ca76-4b99-8b26-d31862ade55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:35.415883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215b021-ca76-4b99-8b26-d31862ade55d admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:35.416756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215b021-ca76-4b99-8b26-d31862ade55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:35.419492 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:35.420396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215b021-ca76-4b99-8b26-d31862ade55d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:35.425042 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9cf702ff-ac40-494c-afbd-73597496e6e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4482cadec43483da3c8d2397adb475a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.426598 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9cf702ff-ac40-494c-afbd-73597496e6e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4482cadec43483da3c8d2397adb475a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.427588 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9cf702ff-ac40-494c-afbd-73597496e6e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4482cadec43483da3c8d2397adb475a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.443123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 994/2004] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:35 2022] POST /identity/v3/users => generated 300 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:35.443851 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215b021-ca76-4b99-8b26-d31862ade55d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:35.445618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0215b021-ca76-4b99-8b26-d31862ade55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:35.446763 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9cf702ff-ac40-494c-afbd-73597496e6e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4482cadec43483da3c8d2397adb475a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.458431 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215b021-ca76-4b99-8b26-d31862ade55d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:35.460516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1011/2005] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:35 2022] DELETE /identity/v3/users/e4482cadec43483da3c8d2397adb475a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:35.461428 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf702ff-ac40-494c-afbd-73597496e6e2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:35.462767 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9cf702ff-ac40-494c-afbd-73597496e6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:35.553159 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf702ff-ac40-494c-afbd-73597496e6e2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:35.557208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373c541-4324-4953-bef8-b428b6327251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:35.558300 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373c541-4324-4953-bef8-b428b6327251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:35.559475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7202bbe-3d30-4618-b257-0ab8647beb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:35.559843 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373c541-4324-4953-bef8-b428b6327251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:35.560403 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373c541-4324-4953-bef8-b428b6327251 admin admin] PATH_INFO: `/v3/users/43be35b8aa5f484084437dda14fe0d6a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:35.560693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7202bbe-3d30-4618-b257-0ab8647beb64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:35.561119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7202bbe-3d30-4618-b257-0ab8647beb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:35.561494 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7202bbe-3d30-4618-b257-0ab8647beb64 admin admin] PATH_INFO: `/v3/users/83faded479ce4dddbbd63de27647613d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:35.563075 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373c541-4324-4953-bef8-b428b6327251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43be35b8aa5f484084437dda14fe0d6a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:35.563338 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7202bbe-3d30-4618-b257-0ab8647beb64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83faded479ce4dddbbd63de27647613d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:35.565504 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7202bbe-3d30-4618-b257-0ab8647beb64 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:35.566541 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373c541-4324-4953-bef8-b428b6327251 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:35.642900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c7202bbe-3d30-4618-b257-0ab8647beb64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83faded479ce4dddbbd63de27647613d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.643158 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9373c541-4324-4953-bef8-b428b6327251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43be35b8aa5f484084437dda14fe0d6a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.651973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c7202bbe-3d30-4618-b257-0ab8647beb64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83faded479ce4dddbbd63de27647613d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.652803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c7202bbe-3d30-4618-b257-0ab8647beb64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83faded479ce4dddbbd63de27647613d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.653579 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c7202bbe-3d30-4618-b257-0ab8647beb64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83faded479ce4dddbbd63de27647613d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.656836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9373c541-4324-4953-bef8-b428b6327251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43be35b8aa5f484084437dda14fe0d6a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.657644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9373c541-4324-4953-bef8-b428b6327251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43be35b8aa5f484084437dda14fe0d6a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.658621 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9373c541-4324-4953-bef8-b428b6327251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43be35b8aa5f484084437dda14fe0d6a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.666651 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=11,keystone:SELECT=84,keystone:INSERT=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:35.668476 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c7202bbe-3d30-4618-b257-0ab8647beb64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83faded479ce4dddbbd63de27647613d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.678882 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9373c541-4324-4953-bef8-b428b6327251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43be35b8aa5f484084437dda14fe0d6a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:35.687675 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1012/2006] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:35 2022] DELETE /identity/v3/users/83faded479ce4dddbbd63de27647613d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:35.687675 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7202bbe-3d30-4618-b257-0ab8647beb64 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:35.687675 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c7202bbe-3d30-4618-b257-0ab8647beb64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:35.700688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 995/2007] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:35 2022] DELETE /identity/v3/users/43be35b8aa5f484084437dda14fe0d6a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:35.702119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373c541-4324-4953-bef8-b428b6327251 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:35.704800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9373c541-4324-4953-bef8-b428b6327251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:35.756364 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:35.767682 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7202bbe-3d30-4618-b257-0ab8647beb64 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:35.816733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373c541-4324-4953-bef8-b428b6327251 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:35.822959 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de5163-5cc2-4a12-b2ca-cc5693d88b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:35.823875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de5163-5cc2-4a12-b2ca-cc5693d88b75 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:35.824259 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de5163-5cc2-4a12-b2ca-cc5693d88b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:35.824704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de5163-5cc2-4a12-b2ca-cc5693d88b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:35.835920 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea7dc4-4023-4b4c-ab65-43137d1fe2c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:35.836653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea7dc4-4023-4b4c-ab65-43137d1fe2c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:35.837119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea7dc4-4023-4b4c-ab65-43137d1fe2c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:35.837503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea7dc4-4023-4b4c-ab65-43137d1fe2c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:35.842161 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-59ea7dc4-4023-4b4c-ab65-43137d1fe2c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:35.854994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de5163-5cc2-4a12-b2ca-cc5693d88b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:35.858402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de5163-5cc2-4a12-b2ca-cc5693d88b75 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:35.889852 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 996/2008] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:35.891878 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de5163-5cc2-4a12-b2ca-cc5693d88b75 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:35.895637 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e8de5163-5cc2-4a12-b2ca-cc5693d88b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:35.919204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de5163-5cc2-4a12-b2ca-cc5693d88b75 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:35.926109 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7d1d7-1d14-4350-80eb-1039a81555b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:35.926766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7d1d7-1d14-4350-80eb-1039a81555b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:35.927120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7d1d7-1d14-4350-80eb-1039a81555b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:35.927400 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7d1d7-1d14-4350-80eb-1039a81555b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:35.928140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7d1d7-1d14-4350-80eb-1039a81555b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:35.930460 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7d1d7-1d14-4350-80eb-1039a81555b2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:35.932718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea7dc4-4023-4b4c-ab65-43137d1fe2c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:35.934614 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea7dc4-4023-4b4c-ab65-43137d1fe2c8 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:35.945598 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 997/2009] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:35.945598 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4410815-4ddd-4b40-ac37-a200ceb1477e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:35.945598 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4410815-4ddd-4b40-ac37-a200ceb1477e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:35.945598 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4410815-4ddd-4b40-ac37-a200ceb1477e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:35.950526 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1013/2010] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:35.951561 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea7dc4-4023-4b4c-ab65-43137d1fe2c8 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:35.953942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-59ea7dc4-4023-4b4c-ab65-43137d1fe2c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:35.965757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b4410815-4ddd-4b40-ac37-a200ceb1477e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:35.966963 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b4410815-4ddd-4b40-ac37-a200ceb1477e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:35.980289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 998/2011] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:35.980289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4410815-4ddd-4b40-ac37-a200ceb1477e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:35.986575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea7dc4-4023-4b4c-ab65-43137d1fe2c8 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:35.998765 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c448a-98ab-46a1-9108-b6faa225ae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:35.999667 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c448a-98ab-46a1-9108-b6faa225ae4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:35.999949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c448a-98ab-46a1-9108-b6faa225ae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:36.000228 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c448a-98ab-46a1-9108-b6faa225ae4a admin admin] PATH_INFO: `/v3/projects/63abd07df84745799a9282525661532b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:36.001693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c448a-98ab-46a1-9108-b6faa225ae4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=63abd07df84745799a9282525661532b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:36.003604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c448a-98ab-46a1-9108-b6faa225ae4a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:36.009089 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4410815-4ddd-4b40-ac37-a200ceb1477e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:36.021176 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fdcdc-1cb6-4085-88d0-98efbbca068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:36.022931 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fdcdc-1cb6-4085-88d0-98efbbca068d admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:36.023309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fdcdc-1cb6-4085-88d0-98efbbca068d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:36.023767 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fdcdc-1cb6-4085-88d0-98efbbca068d admin admin] PATH_INFO: `/v3/projects/5c3e5d2c5ca5409f8060ffb0c04f568b/users/13911c17df364b38a051cb223d400e6f/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:36.058700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fdcdc-1cb6-4085-88d0-98efbbca068d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3e5d2c5ca5409f8060ffb0c04f568b, user_id=13911c17df364b38a051cb223d400e6f, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:36.063553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fdcdc-1cb6-4085-88d0-98efbbca068d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:36.090970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 999/2012] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:35 2022] PUT /identity/v3/projects/5c3e5d2c5ca5409f8060ffb0c04f568b/users/13911c17df364b38a051cb223d400e6f/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:36.101737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fdcdc-1cb6-4085-88d0-98efbbca068d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:36.124986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-674c448a-98ab-46a1-9108-b6faa225ae4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63abd07df84745799a9282525661532b', 'request_id': 'req-674c448a-98ab-46a1-9108-b6faa225ae4a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:36.132572 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-674c448a-98ab-46a1-9108-b6faa225ae4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63abd07df84745799a9282525661532b', 'request_id': 'req-674c448a-98ab-46a1-9108-b6faa225ae4a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:36.141667 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-674c448a-98ab-46a1-9108-b6faa225ae4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63abd07df84745799a9282525661532b', 'request_id': 'req-674c448a-98ab-46a1-9108-b6faa225ae4a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:36.168808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-674c448a-98ab-46a1-9108-b6faa225ae4a admin admin] The token cache is being invalidate because project 63abd07df84745799a9282525661532b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:36.169111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-674c448a-98ab-46a1-9108-b6faa225ae4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:36.169819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-674c448a-98ab-46a1-9108-b6faa225ae4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:36.174705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1014/2013] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:35 2022] DELETE /identity/v3/projects/63abd07df84745799a9282525661532b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:36.174705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c448a-98ab-46a1-9108-b6faa225ae4a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:36.174946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-674c448a-98ab-46a1-9108-b6faa225ae4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:36.200093 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fdcdc-1cb6-4085-88d0-98efbbca068d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:36.225592 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:36.237065 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:36.248741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c448a-98ab-46a1-9108-b6faa225ae4a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:36.253910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e60ad5-cdcb-4fc4-944f-8cc28389205a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:36.254626 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e60ad5-cdcb-4fc4-944f-8cc28389205a service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:36.255341 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e60ad5-cdcb-4fc4-944f-8cc28389205a service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:36.255622 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e60ad5-cdcb-4fc4-944f-8cc28389205a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:36.258090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-10e60ad5-cdcb-4fc4-944f-8cc28389205a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:36.270210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8811417-45bb-4081-900c-ed171ad1c439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:36.271469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8811417-45bb-4081-900c-ed171ad1c439 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:36.271658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8811417-45bb-4081-900c-ed171ad1c439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:36.271931 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8811417-45bb-4081-900c-ed171ad1c439 admin admin] PATH_INFO: `/v3/projects/d0b4caad322d48e1802bcfd2981c8342/users/3d192f847e874b65af9dbf354c42e55a/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:36.288927 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8811417-45bb-4081-900c-ed171ad1c439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b4caad322d48e1802bcfd2981c8342, user_id=3d192f847e874b65af9dbf354c42e55a, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:36.291749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8811417-45bb-4081-900c-ed171ad1c439 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:36.306642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1000/2014] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:36 2022] PUT /identity/v3/projects/d0b4caad322d48e1802bcfd2981c8342/users/3d192f847e874b65af9dbf354c42e55a/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:36.307341 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bb542-0d0f-40cf-b9a8-5bad9a5c70b9 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:36.307693 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bb542-0d0f-40cf-b9a8-5bad9a5c70b9 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:36.308035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bb542-0d0f-40cf-b9a8-5bad9a5c70b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:36.337201 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a41bb542-0d0f-40cf-b9a8-5bad9a5c70b9 None None] MFA Rules not processed for user `13911c17df364b38a051cb223d400e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:36.338563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a41bb542-0d0f-40cf-b9a8-5bad9a5c70b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:36.341076 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e60ad5-cdcb-4fc4-944f-8cc28389205a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:36.343048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e60ad5-cdcb-4fc4-944f-8cc28389205a service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:36.353888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1015/2015] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:36.362395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e60ad5-cdcb-4fc4-944f-8cc28389205a service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:36.364036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-10e60ad5-cdcb-4fc4-944f-8cc28389205a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:36.378295 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e60ad5-cdcb-4fc4-944f-8cc28389205a service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:36.411570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1001/2016] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:36.413259 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85e10b-76f5-4dd4-b87e-1e64dc249aea None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:36.413669 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85e10b-76f5-4dd4-b87e-1e64dc249aea None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:36.414048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85e10b-76f5-4dd4-b87e-1e64dc249aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:36.440912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ad85e10b-76f5-4dd4-b87e-1e64dc249aea None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:36.443156 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ad85e10b-76f5-4dd4-b87e-1e64dc249aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:36.456943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2e29b-ba68-4c96-b47d-38b29a240e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:36.457910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2e29b-ba68-4c96-b47d-38b29a240e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:36.458246 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2e29b-ba68-4c96-b47d-38b29a240e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:36.458693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2e29b-ba68-4c96-b47d-38b29a240e24 admin admin] PATH_INFO: `/v3/projects/7d2259d4597b47b5942fc767a11ab70b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:36.460126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2e29b-ba68-4c96-b47d-38b29a240e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d2259d4597b47b5942fc767a11ab70b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:36.462290 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2e29b-ba68-4c96-b47d-38b29a240e24 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:36.532932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-46f2e29b-ba68-4c96-b47d-38b29a240e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d2259d4597b47b5942fc767a11ab70b', 'request_id': 'req-46f2e29b-ba68-4c96-b47d-38b29a240e24'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:36.540402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1002/2017] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:36.541398 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85e10b-76f5-4dd4-b87e-1e64dc249aea None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:36.543118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ad85e10b-76f5-4dd4-b87e-1e64dc249aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:36.544198 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-46f2e29b-ba68-4c96-b47d-38b29a240e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d2259d4597b47b5942fc767a11ab70b', 'request_id': 'req-46f2e29b-ba68-4c96-b47d-38b29a240e24'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:36.557973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-46f2e29b-ba68-4c96-b47d-38b29a240e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d2259d4597b47b5942fc767a11ab70b', 'request_id': 'req-46f2e29b-ba68-4c96-b47d-38b29a240e24'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:36.559208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85e10b-76f5-4dd4-b87e-1e64dc249aea None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:36.578697 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-46f2e29b-ba68-4c96-b47d-38b29a240e24 admin admin] The token cache is being invalidate because project 7d2259d4597b47b5942fc767a11ab70b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:36.581506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-46f2e29b-ba68-4c96-b47d-38b29a240e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:36.582944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-46f2e29b-ba68-4c96-b47d-38b29a240e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:36.585042 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1016/2018] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:36 2022] DELETE /identity/v3/projects/7d2259d4597b47b5942fc767a11ab70b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:36.586721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2e29b-ba68-4c96-b47d-38b29a240e24 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:36.589232 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-46f2e29b-ba68-4c96-b47d-38b29a240e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:36.620328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:36.627243 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:36.659019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8fa15-2043-415c-b6cd-13ab6e248b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:36.660142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8fa15-2043-415c-b6cd-13ab6e248b84 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:36.660834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8fa15-2043-415c-b6cd-13ab6e248b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:36.661212 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8fa15-2043-415c-b6cd-13ab6e248b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:36.662175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8fa15-2043-415c-b6cd-13ab6e248b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:36.664000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8fa15-2043-415c-b6cd-13ab6e248b84 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:36.677332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1003/2019] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:36.683214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf1ec9-774b-48d7-a269-1a8b0d31e0c9 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:36.683529 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf1ec9-774b-48d7-a269-1a8b0d31e0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:36.685205 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf1ec9-774b-48d7-a269-1a8b0d31e0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:36.707231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-dbaf1ec9-774b-48d7-a269-1a8b0d31e0c9 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:36.709086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-dbaf1ec9-774b-48d7-a269-1a8b0d31e0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:36.710813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2e29b-ba68-4c96-b47d-38b29a240e24 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:36.717982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1004/2020] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:36.719128 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a288f-3510-456f-8e77-f9ef0a3ac899 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:36.719414 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a288f-3510-456f-8e77-f9ef0a3ac899 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:36.719689 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a288f-3510-456f-8e77-f9ef0a3ac899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:36.726346 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91253ed-e2e1-4259-ad59-c4258168a6f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:36.727277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91253ed-e2e1-4259-ad59-c4258168a6f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:36.727582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91253ed-e2e1-4259-ad59-c4258168a6f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:36.727870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91253ed-e2e1-4259-ad59-c4258168a6f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:36.738438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f91253ed-e2e1-4259-ad59-c4258168a6f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:36.752316 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-665a288f-3510-456f-8e77-f9ef0a3ac899 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:36.753760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-665a288f-3510-456f-8e77-f9ef0a3ac899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:36.761880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1005/2021] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:36.762728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a288f-3510-456f-8e77-f9ef0a3ac899 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:36.763967 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-665a288f-3510-456f-8e77-f9ef0a3ac899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:36.776170 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a288f-3510-456f-8e77-f9ef0a3ac899 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:36.780842 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea784a71-29ed-4aec-8d3f-2d9816d5ccab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:36.781771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea784a71-29ed-4aec-8d3f-2d9816d5ccab admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:36.782060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea784a71-29ed-4aec-8d3f-2d9816d5ccab admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:36.782405 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea784a71-29ed-4aec-8d3f-2d9816d5ccab admin admin] PATH_INFO: `/v3/projects/d0b4caad322d48e1802bcfd2981c8342/users/3d192f847e874b65af9dbf354c42e55a/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:36.787168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea784a71-29ed-4aec-8d3f-2d9816d5ccab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b4caad322d48e1802bcfd2981c8342, user_id=3d192f847e874b65af9dbf354c42e55a, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:36.796015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea784a71-29ed-4aec-8d3f-2d9816d5ccab admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:36.803279 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91253ed-e2e1-4259-ad59-c4258168a6f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:36.804812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91253ed-e2e1-4259-ad59-c4258168a6f5 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:36.808098 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1006/2022] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:36 2022] PUT /identity/v3/projects/d0b4caad322d48e1802bcfd2981c8342/users/3d192f847e874b65af9dbf354c42e55a/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:36.814281 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1017/2023] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:36.814955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91253ed-e2e1-4259-ad59-c4258168a6f5 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:36.817570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea784a71-29ed-4aec-8d3f-2d9816d5ccab admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:36.819669 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ea784a71-29ed-4aec-8d3f-2d9816d5ccab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:36.825272 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91253ed-e2e1-4259-ad59-c4258168a6f5 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:36.908244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea784a71-29ed-4aec-8d3f-2d9816d5ccab admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:36.916816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073d35f-6ffd-4afb-925b-43fbaf4160c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:36.917524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482aac1-af50-4fd6-b9d4-e4abe154230c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:36.918343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073d35f-6ffd-4afb-925b-43fbaf4160c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:36.918450 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482aac1-af50-4fd6-b9d4-e4abe154230c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:36.918803 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482aac1-af50-4fd6-b9d4-e4abe154230c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:36.919088 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482aac1-af50-4fd6-b9d4-e4abe154230c admin admin] PATH_INFO: `/v3/projects/63193be98afb461684e7bc4fa61fe130` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:36.919360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073d35f-6ffd-4afb-925b-43fbaf4160c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:36.919818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073d35f-6ffd-4afb-925b-43fbaf4160c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:36.920431 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482aac1-af50-4fd6-b9d4-e4abe154230c admin admin] RBAC: Authorizing `identity:delete_project(project_id=63193be98afb461684e7bc4fa61fe130)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:36.921093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073d35f-6ffd-4afb-925b-43fbaf4160c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:36.922358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073d35f-6ffd-4afb-925b-43fbaf4160c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:36.922464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482aac1-af50-4fd6-b9d4-e4abe154230c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:36.924784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073d35f-6ffd-4afb-925b-43fbaf4160c2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:36.943201 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1018/2024] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:36.945586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ab661-35f7-47ec-bbb4-04e177309a3a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:36.946105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ab661-35f7-47ec-bbb4-04e177309a3a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:36.946726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ab661-35f7-47ec-bbb4-04e177309a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:36.978345 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d482aac1-af50-4fd6-b9d4-e4abe154230c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63193be98afb461684e7bc4fa61fe130', 'request_id': 'req-d482aac1-af50-4fd6-b9d4-e4abe154230c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:36.985898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d482aac1-af50-4fd6-b9d4-e4abe154230c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63193be98afb461684e7bc4fa61fe130', 'request_id': 'req-d482aac1-af50-4fd6-b9d4-e4abe154230c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:36.991568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-614ab661-35f7-47ec-bbb4-04e177309a3a None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:36.993507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-614ab661-35f7-47ec-bbb4-04e177309a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:36.996350 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d482aac1-af50-4fd6-b9d4-e4abe154230c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63193be98afb461684e7bc4fa61fe130', 'request_id': 'req-d482aac1-af50-4fd6-b9d4-e4abe154230c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:37.020180 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d482aac1-af50-4fd6-b9d4-e4abe154230c admin admin] The token cache is being invalidate because project 63193be98afb461684e7bc4fa61fe130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:37.021246 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d482aac1-af50-4fd6-b9d4-e4abe154230c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:37.021598 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d482aac1-af50-4fd6-b9d4-e4abe154230c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:37.024974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1007/2025] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:36 2022] DELETE /identity/v3/projects/63193be98afb461684e7bc4fa61fe130 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:37.026731 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f9aaf-83e7-4e14-91e2-14157166d6c2 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:37.027022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f9aaf-83e7-4e14-91e2-14157166d6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:37.027296 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f9aaf-83e7-4e14-91e2-14157166d6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:37.076128 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5c8f9aaf-83e7-4e14-91e2-14157166d6c2 None None] MFA Rules not processed for user `3d192f847e874b65af9dbf354c42e55a`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:37.077406 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5c8f9aaf-83e7-4e14-91e2-14157166d6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:37.143875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:37.157751 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1019/2026] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:37.159614 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ab661-35f7-47ec-bbb4-04e177309a3a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:37.166597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-614ab661-35f7-47ec-bbb4-04e177309a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:37.182330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ab661-35f7-47ec-bbb4-04e177309a3a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:37.187966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310158f1-9581-4440-938b-65485c6a2144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:37.188948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310158f1-9581-4440-938b-65485c6a2144 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:37.189501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310158f1-9581-4440-938b-65485c6a2144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:37.189886 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310158f1-9581-4440-938b-65485c6a2144 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:37.190750 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310158f1-9581-4440-938b-65485c6a2144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:37.193024 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310158f1-9581-4440-938b-65485c6a2144 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:37.203910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:37.214672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1008/2027] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:37.215879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f9aaf-83e7-4e14-91e2-14157166d6c2 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:37.216809 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5c8f9aaf-83e7-4e14-91e2-14157166d6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:37.238134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f9aaf-83e7-4e14-91e2-14157166d6c2 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:37.244719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220aefe-ce42-4248-bb31-9a17301e373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:37.245824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220aefe-ce42-4248-bb31-9a17301e373e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:37.246280 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220aefe-ce42-4248-bb31-9a17301e373e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:37.246724 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220aefe-ce42-4248-bb31-9a17301e373e admin admin] PATH_INFO: `/v3/users/e7b0684ad4a3419bba53ffefbb5ea01f` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:37.248337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220aefe-ce42-4248-bb31-9a17301e373e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7b0684ad4a3419bba53ffefbb5ea01f)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:37.250594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220aefe-ce42-4248-bb31-9a17301e373e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:37.252429 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1020/2028] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:37 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:37.258632 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310158f1-9581-4440-938b-65485c6a2144 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:37.334989 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4220aefe-ce42-4248-bb31-9a17301e373e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7b0684ad4a3419bba53ffefbb5ea01f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:37.347207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4220aefe-ce42-4248-bb31-9a17301e373e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7b0684ad4a3419bba53ffefbb5ea01f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:37.348481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4220aefe-ce42-4248-bb31-9a17301e373e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7b0684ad4a3419bba53ffefbb5ea01f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:37.350611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4220aefe-ce42-4248-bb31-9a17301e373e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7b0684ad4a3419bba53ffefbb5ea01f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:37.360663 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310158f1-9581-4440-938b-65485c6a2144 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:37.365911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4220aefe-ce42-4248-bb31-9a17301e373e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7b0684ad4a3419bba53ffefbb5ea01f'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:37.366371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea359e4-ceac-4138-87fe-ecf1bb8ee6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:37.367065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea359e4-ceac-4138-87fe-ecf1bb8ee6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:37.367366 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea359e4-ceac-4138-87fe-ecf1bb8ee6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:37.367651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea359e4-ceac-4138-87fe-ecf1bb8ee6c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:37.368449 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea359e4-ceac-4138-87fe-ecf1bb8ee6c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:37.368759 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea359e4-ceac-4138-87fe-ecf1bb8ee6c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:37.370867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea359e4-ceac-4138-87fe-ecf1bb8ee6c8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:37.383757 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1021/2029] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:37.386614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1009/2030] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:37 2022] DELETE /identity/v3/users/e7b0684ad4a3419bba53ffefbb5ea01f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:37.387959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea359e4-ceac-4138-87fe-ecf1bb8ee6c8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:37.388085 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220aefe-ce42-4248-bb31-9a17301e373e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:37.390649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-eea359e4-ceac-4138-87fe-ecf1bb8ee6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:37.393518 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4220aefe-ce42-4248-bb31-9a17301e373e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:37.403600 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea359e4-ceac-4138-87fe-ecf1bb8ee6c8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:37.464041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220aefe-ce42-4248-bb31-9a17301e373e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:37.468110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfbef3-61df-4d2e-8065-70e07f592c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:37.468879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfbef3-61df-4d2e-8065-70e07f592c8d service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:37.469244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfbef3-61df-4d2e-8065-70e07f592c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:37.469680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfbef3-61df-4d2e-8065-70e07f592c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:37.471598 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-61bfbef3-61df-4d2e-8065-70e07f592c8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:37.472509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697217a7-6c94-4436-8731-6fccfa9796f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:37.473648 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697217a7-6c94-4436-8731-6fccfa9796f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:37.473648 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697217a7-6c94-4436-8731-6fccfa9796f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:37.473840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697217a7-6c94-4436-8731-6fccfa9796f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:37.475053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697217a7-6c94-4436-8731-6fccfa9796f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:37.476973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697217a7-6c94-4436-8731-6fccfa9796f6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:37.501266 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1022/2031] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:37 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:37.502334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697217a7-6c94-4436-8731-6fccfa9796f6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:37.505803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-697217a7-6c94-4436-8731-6fccfa9796f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:37.518569 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697217a7-6c94-4436-8731-6fccfa9796f6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:37.523663 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093c494-5780-4f60-a062-0db1cc746e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:37.524543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093c494-5780-4f60-a062-0db1cc746e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:37.525017 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093c494-5780-4f60-a062-0db1cc746e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:37.525613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093c494-5780-4f60-a062-0db1cc746e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:37.526528 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093c494-5780-4f60-a062-0db1cc746e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:37.529182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093c494-5780-4f60-a062-0db1cc746e44 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:37.568986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1023/2032] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:37 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:37.570018 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093c494-5780-4f60-a062-0db1cc746e44 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:37.576649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfbef3-61df-4d2e-8065-70e07f592c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:37.578429 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfbef3-61df-4d2e-8065-70e07f592c8d service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:37.582934 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:37.594525 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1010/2033] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:37.596983 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfbef3-61df-4d2e-8065-70e07f592c8d service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:37.616651 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfbef3-61df-4d2e-8065-70e07f592c8d service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:37.639965 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:37.653164 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093c494-5780-4f60-a062-0db1cc746e44 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:37.658737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4161f-4e44-48b3-9486-b34d12fb9528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:37.659451 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4161f-4e44-48b3-9486-b34d12fb9528 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:37.659719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4161f-4e44-48b3-9486-b34d12fb9528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:37.659988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4161f-4e44-48b3-9486-b34d12fb9528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:37.660852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4161f-4e44-48b3-9486-b34d12fb9528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:37.663450 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4161f-4e44-48b3-9486-b34d12fb9528 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:37.674756 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1024/2034] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:37.678869 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4161f-4e44-48b3-9486-b34d12fb9528 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:37.692352 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4161f-4e44-48b3-9486-b34d12fb9528 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:37.699207 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ab95a-ffef-44c3-87d8-d5cdf5122046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:37.699901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ab95a-ffef-44c3-87d8-d5cdf5122046 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:37.700189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ab95a-ffef-44c3-87d8-d5cdf5122046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:37.700467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ab95a-ffef-44c3-87d8-d5cdf5122046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:37.701205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ab95a-ffef-44c3-87d8-d5cdf5122046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:37.702865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ab95a-ffef-44c3-87d8-d5cdf5122046 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:37.718313 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1025/2035] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:35:37.718313 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ab95a-ffef-44c3-87d8-d5cdf5122046 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:37.718313 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-867ab95a-ffef-44c3-87d8-d5cdf5122046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:37.734358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ab95a-ffef-44c3-87d8-d5cdf5122046 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:37.738384 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99910455-451d-446c-9171-bb7cb2167bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:37.739064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99910455-451d-446c-9171-bb7cb2167bfb admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:37.739376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99910455-451d-446c-9171-bb7cb2167bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:37.739657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99910455-451d-446c-9171-bb7cb2167bfb admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:37.740368 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99910455-451d-446c-9171-bb7cb2167bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:37.742034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:37.742570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99910455-451d-446c-9171-bb7cb2167bfb admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:37.742912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:37.743199 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:37.743480 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace admin admin] PATH_INFO: `/v3/projects/7ad26be0e227445fa83bbe8451353a3b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:37.744671 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad26be0e227445fa83bbe8451353a3b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:37.746653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:37.769036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1011/2036] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:37 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:37.769790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99910455-451d-446c-9171-bb7cb2167bfb admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:37.789481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99910455-451d-446c-9171-bb7cb2167bfb admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:37.813415 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad26be0e227445fa83bbe8451353a3b', 'request_id': 'req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:37.821006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad26be0e227445fa83bbe8451353a3b', 'request_id': 'req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:37.829681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad26be0e227445fa83bbe8451353a3b', 'request_id': 'req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:37.847129 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace admin admin] The token cache is being invalidate because project 7ad26be0e227445fa83bbe8451353a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:37.847473 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:37.848807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:37.850917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1026/2037] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:37 2022] DELETE /identity/v3/projects/7ad26be0e227445fa83bbe8451353a3b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:37.852297 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:37.853853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:37.858213 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32c9b-9cd2-411c-a4da-f96f9a551f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:37.859255 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32c9b-9cd2-411c-a4da-f96f9a551f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:37.859546 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32c9b-9cd2-411c-a4da-f96f9a551f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:37.860227 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32c9b-9cd2-411c-a4da-f96f9a551f93 admin admin] PATH_INFO: `/v3/projects/11b2dd4b7fe941f083b3da861c87210c/users/d3f0571a305f48a6b223cc800255ced6/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:37.870942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351bbc7-86c4-47e8-bb81-1c728fdf5ace admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:37.876687 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c450fa-44c9-42fe-ac2b-b12dcd6a7bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:37.877513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c450fa-44c9-42fe-ac2b-b12dcd6a7bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:37.877757 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c450fa-44c9-42fe-ac2b-b12dcd6a7bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:37.878034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c450fa-44c9-42fe-ac2b-b12dcd6a7bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:37.878863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c450fa-44c9-42fe-ac2b-b12dcd6a7bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:37.879467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc32c9b-9cd2-411c-a4da-f96f9a551f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b2dd4b7fe941f083b3da861c87210c, user_id=d3f0571a305f48a6b223cc800255ced6, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:37.880483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c450fa-44c9-42fe-ac2b-b12dcd6a7bc0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:37.882856 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc32c9b-9cd2-411c-a4da-f96f9a551f93 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:37.892449 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1027/2038] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:37.893955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fa308-9f68-4109-82c1-c25e92edfdec None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:37.894065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fa308-9f68-4109-82c1-c25e92edfdec None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:37.894268 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fa308-9f68-4109-82c1-c25e92edfdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:37.901484 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1012/2039] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:37 2022] PUT /identity/v3/projects/11b2dd4b7fe941f083b3da861c87210c/users/d3f0571a305f48a6b223cc800255ced6/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:37.901484 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32c9b-9cd2-411c-a4da-f96f9a551f93 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:37.919856 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-932fa308-9f68-4109-82c1-c25e92edfdec None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:37.921101 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-932fa308-9f68-4109-82c1-c25e92edfdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:37.981687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32c9b-9cd2-411c-a4da-f96f9a551f93 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:37.986724 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1970066-99ef-4da7-85d7-66b9edcd3ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:37.987569 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970066-99ef-4da7-85d7-66b9edcd3ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:37.987934 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970066-99ef-4da7-85d7-66b9edcd3ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:37.988287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970066-99ef-4da7-85d7-66b9edcd3ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:37.989102 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1970066-99ef-4da7-85d7-66b9edcd3ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:37.990881 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1970066-99ef-4da7-85d7-66b9edcd3ed4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:37.993033 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1028/2040] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:37.994260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e449f-0150-47a9-bd9c-e7d48a7f3616 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:37.994622 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e449f-0150-47a9-bd9c-e7d48a7f3616 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:37.995115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e449f-0150-47a9-bd9c-e7d48a7f3616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:38.007083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1013/2041] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:38.007083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984f0c9-cab6-4047-9b16-44ec98becef6 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:38.007083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984f0c9-cab6-4047-9b16-44ec98becef6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:38.007083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984f0c9-cab6-4047-9b16-44ec98becef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:38.020899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:38.027738 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4984f0c9-cab6-4047-9b16-44ec98becef6 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:38.029946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c58e449f-0150-47a9-bd9c-e7d48a7f3616 None None] MFA Rules not processed for user `d3f0571a305f48a6b223cc800255ced6`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:38.030693 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4984f0c9-cab6-4047-9b16-44ec98becef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:38.030968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c58e449f-0150-47a9-bd9c-e7d48a7f3616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:38.049259 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1014/2042] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:38.050173 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984f0c9-cab6-4047-9b16-44ec98becef6 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:38.060072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984f0c9-cab6-4047-9b16-44ec98becef6 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:38.067740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d051f-2fdb-4c77-b348-d1db1c87190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:38.067740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d051f-2fdb-4c77-b348-d1db1c87190c admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:38.067740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d051f-2fdb-4c77-b348-d1db1c87190c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:38.067740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d051f-2fdb-4c77-b348-d1db1c87190c admin admin] PATH_INFO: `/v3/projects/b6159667417f409f930a537de1867b01/users/bcec12c9da8c4c01bfb2a4f8c27c8c20/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:38.083802 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d051f-2fdb-4c77-b348-d1db1c87190c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6159667417f409f930a537de1867b01, user_id=bcec12c9da8c4c01bfb2a4f8c27c8c20, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:38.087615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d051f-2fdb-4c77-b348-d1db1c87190c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:38.093822 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:38.110068 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1015/2043] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:38 2022] PUT /identity/v3/projects/b6159667417f409f930a537de1867b01/users/bcec12c9da8c4c01bfb2a4f8c27c8c20/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:38.111185 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d051f-2fdb-4c77-b348-d1db1c87190c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:38.147761 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1029/2044] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:38.149316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11081ba9-b50b-4e44-9920-4905b5d12023 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:38.149667 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11081ba9-b50b-4e44-9920-4905b5d12023 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:38.149957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11081ba9-b50b-4e44-9920-4905b5d12023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:38.179833 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-11081ba9-b50b-4e44-9920-4905b5d12023 None None] MFA Rules not processed for user `bcec12c9da8c4c01bfb2a4f8c27c8c20`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:38.181765 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-11081ba9-b50b-4e44-9920-4905b5d12023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:38.189599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d051f-2fdb-4c77-b348-d1db1c87190c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:38.194992 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfdb88-0d32-4606-a66c-d98fe583163c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:38.195855 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfdb88-0d32-4606-a66c-d98fe583163c admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:38.196142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfdb88-0d32-4606-a66c-d98fe583163c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:38.196560 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfdb88-0d32-4606-a66c-d98fe583163c admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:38.197308 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfdb88-0d32-4606-a66c-d98fe583163c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:38.197800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfdb88-0d32-4606-a66c-d98fe583163c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:38.199537 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfdb88-0d32-4606-a66c-d98fe583163c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:38.213973 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1016/2045] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:38.218433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfdb88-0d32-4606-a66c-d98fe583163c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:38.220033 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2fdfdb88-0d32-4606-a66c-d98fe583163c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:38.234348 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfdb88-0d32-4606-a66c-d98fe583163c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:38.239132 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6049d5c-78a5-448b-92df-780f2c182113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:38.239872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6049d5c-78a5-448b-92df-780f2c182113 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:38.240159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6049d5c-78a5-448b-92df-780f2c182113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:38.240964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6049d5c-78a5-448b-92df-780f2c182113 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:38.241718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6049d5c-78a5-448b-92df-780f2c182113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:38.243717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6049d5c-78a5-448b-92df-780f2c182113 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:38.273316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1030/2046] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:38.274549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11081ba9-b50b-4e44-9920-4905b5d12023 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:38.291759 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11081ba9-b50b-4e44-9920-4905b5d12023 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:38.294534 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1017/2047] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:38 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:38.298433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6049d5c-78a5-448b-92df-780f2c182113 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:38.300300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a827ac-3880-46d3-832f-9ba941884a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:38.300981 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a827ac-3880-46d3-832f-9ba941884a4b admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:38.301264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a827ac-3880-46d3-832f-9ba941884a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:38.301613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a827ac-3880-46d3-832f-9ba941884a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:38.302319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a827ac-3880-46d3-832f-9ba941884a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:38.304219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a827ac-3880-46d3-832f-9ba941884a4b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:38.341407 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1031/2048] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:38 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:38.343803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a827ac-3880-46d3-832f-9ba941884a4b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:38.437662 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a827ac-3880-46d3-832f-9ba941884a4b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:38.444831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87b755-dd03-4cf4-963c-63035cd83dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:38.444831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87b755-dd03-4cf4-963c-63035cd83dfe admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:38.444831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87b755-dd03-4cf4-963c-63035cd83dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:38.450909 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87b755-dd03-4cf4-963c-63035cd83dfe admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:38.450909 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87b755-dd03-4cf4-963c-63035cd83dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:38.453390 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87b755-dd03-4cf4-963c-63035cd83dfe admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:38.459419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6049d5c-78a5-448b-92df-780f2c182113 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:38.464688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe9c05-f163-4807-b272-9026913a0024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:38.465303 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe9c05-f163-4807-b272-9026913a0024 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:38.466058 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe9c05-f163-4807-b272-9026913a0024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:38.466058 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe9c05-f163-4807-b272-9026913a0024 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:38.466669 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe9c05-f163-4807-b272-9026913a0024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:38.468576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe9c05-f163-4807-b272-9026913a0024 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:38.496775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1032/2049] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:38 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:38.498411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87b755-dd03-4cf4-963c-63035cd83dfe admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:38.510576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87b755-dd03-4cf4-963c-63035cd83dfe admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:38.516341 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32028b-fc3f-4485-98e1-b597a744fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:38.517040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32028b-fc3f-4485-98e1-b597a744fc55 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:38.517428 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32028b-fc3f-4485-98e1-b597a744fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:38.517661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32028b-fc3f-4485-98e1-b597a744fc55 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:38.518430 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32028b-fc3f-4485-98e1-b597a744fc55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:38.520348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32028b-fc3f-4485-98e1-b597a744fc55 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:38.526815 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1018/2050] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:38 2022] POST /identity/v3/projects => generated 379 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:38.527716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe9c05-f163-4807-b272-9026913a0024 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:38.532014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7dbe9c05-f163-4807-b272-9026913a0024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:38.551004 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1033/2051] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:38 2022] POST /identity/v3/users => generated 287 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:38.552408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32028b-fc3f-4485-98e1-b597a744fc55 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:38.573517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32028b-fc3f-4485-98e1-b597a744fc55 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:38.601986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:38.623550 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:38.677013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe9c05-f163-4807-b272-9026913a0024 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:38.682691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89c6ab-3303-4a25-a892-39678cd32309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:38.684002 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89c6ab-3303-4a25-a892-39678cd32309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:38.684369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89c6ab-3303-4a25-a892-39678cd32309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:38.684766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89c6ab-3303-4a25-a892-39678cd32309 admin admin] PATH_INFO: `/v3/users/8439941ec202409d9e260c6e9c8851dd` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:38.686298 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89c6ab-3303-4a25-a892-39678cd32309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8439941ec202409d9e260c6e9c8851dd)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:38.688591 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89c6ab-3303-4a25-a892-39678cd32309 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:38.695780 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e518102-07ba-4254-a9b2-8138ae20d3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:38.697245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e518102-07ba-4254-a9b2-8138ae20d3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:38.697589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e518102-07ba-4254-a9b2-8138ae20d3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:38.697880 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e518102-07ba-4254-a9b2-8138ae20d3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:38.698797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e518102-07ba-4254-a9b2-8138ae20d3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:38.701043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e518102-07ba-4254-a9b2-8138ae20d3d8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:38.715220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1034/2052] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:38.719231 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e518102-07ba-4254-a9b2-8138ae20d3d8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:38.739884 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e518102-07ba-4254-a9b2-8138ae20d3d8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:38.748464 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe4624-675c-411c-ade5-a4ebe24e826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:38.749186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe4624-675c-411c-ade5-a4ebe24e826c admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:38.749464 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe4624-675c-411c-ade5-a4ebe24e826c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:38.750000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe4624-675c-411c-ade5-a4ebe24e826c admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:38.750834 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe4624-675c-411c-ade5-a4ebe24e826c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:38.754504 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe4624-675c-411c-ade5-a4ebe24e826c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:38.764474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2b89c6ab-3303-4a25-a892-39678cd32309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8439941ec202409d9e260c6e9c8851dd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:38.773537 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2b89c6ab-3303-4a25-a892-39678cd32309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8439941ec202409d9e260c6e9c8851dd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:38.774455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2b89c6ab-3303-4a25-a892-39678cd32309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8439941ec202409d9e260c6e9c8851dd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:38.775181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2b89c6ab-3303-4a25-a892-39678cd32309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8439941ec202409d9e260c6e9c8851dd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:38.792065 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2b89c6ab-3303-4a25-a892-39678cd32309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8439941ec202409d9e260c6e9c8851dd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:38.793385 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1035/2053] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:38 2022] POST /identity/v3/users => generated 290 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:38.794386 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe4624-675c-411c-ade5-a4ebe24e826c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:38.796126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bfbe4624-675c-411c-ade5-a4ebe24e826c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:38.806974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1019/2054] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:38 2022] DELETE /identity/v3/users/8439941ec202409d9e260c6e9c8851dd => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:38.808362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89c6ab-3303-4a25-a892-39678cd32309 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:38.810562 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2b89c6ab-3303-4a25-a892-39678cd32309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:38.812800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe4624-675c-411c-ade5-a4ebe24e826c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:38.898651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9d2bc-dfec-49b7-bac8-6a016b7a9da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:38.899386 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9d2bc-dfec-49b7-bac8-6a016b7a9da2 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:38.899669 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9d2bc-dfec-49b7-bac8-6a016b7a9da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:38.899945 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9d2bc-dfec-49b7-bac8-6a016b7a9da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:38.900768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9d2bc-dfec-49b7-bac8-6a016b7a9da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:38.903084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9d2bc-dfec-49b7-bac8-6a016b7a9da2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:38.906520 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89c6ab-3303-4a25-a892-39678cd32309 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:38.911625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579e800-81e0-4952-8fbc-e835f4179c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:38.912522 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579e800-81e0-4952-8fbc-e835f4179c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:38.912810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579e800-81e0-4952-8fbc-e835f4179c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:38.913221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579e800-81e0-4952-8fbc-e835f4179c8a admin admin] PATH_INFO: `/v3/users/9315ee27246f4459844f6a4410842d15` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:38.914362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579e800-81e0-4952-8fbc-e835f4179c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9315ee27246f4459844f6a4410842d15)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:38.916286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579e800-81e0-4952-8fbc-e835f4179c8a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:38.917376 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1036/2055] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:38.918194 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9d2bc-dfec-49b7-bac8-6a016b7a9da2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:38.919818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9ec9d2bc-dfec-49b7-bac8-6a016b7a9da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:38.933988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9d2bc-dfec-49b7-bac8-6a016b7a9da2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:38.939878 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44b7a8-84dc-4d01-8915-b601222fe748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:38.940897 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44b7a8-84dc-4d01-8915-b601222fe748 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:38.941181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44b7a8-84dc-4d01-8915-b601222fe748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:38.941481 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44b7a8-84dc-4d01-8915-b601222fe748 admin admin] PATH_INFO: `/v3/projects/8c9ee3236322444e915b7447bc853f82/users/62a514ae61794341a6d317cda430448e/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:38.959900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44b7a8-84dc-4d01-8915-b601222fe748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9ee3236322444e915b7447bc853f82, user_id=62a514ae61794341a6d317cda430448e, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:38.964476 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44b7a8-84dc-4d01-8915-b601222fe748 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:38.971805 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7579e800-81e0-4952-8fbc-e835f4179c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9315ee27246f4459844f6a4410842d15'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:38.981334 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7579e800-81e0-4952-8fbc-e835f4179c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9315ee27246f4459844f6a4410842d15'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:38.982055 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7579e800-81e0-4952-8fbc-e835f4179c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9315ee27246f4459844f6a4410842d15'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:38.983139 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7579e800-81e0-4952-8fbc-e835f4179c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9315ee27246f4459844f6a4410842d15'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:38.986608 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1037/2056] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:38 2022] PUT /identity/v3/projects/8c9ee3236322444e915b7447bc853f82/users/62a514ae61794341a6d317cda430448e/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:38.986608 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44b7a8-84dc-4d01-8915-b601222fe748 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:38.986889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:38.988398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ed44b7a8-84dc-4d01-8915-b601222fe748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:39.004136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7579e800-81e0-4952-8fbc-e835f4179c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9315ee27246f4459844f6a4410842d15'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:39.018377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1020/2057] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:38 2022] DELETE /identity/v3/users/9315ee27246f4459844f6a4410842d15 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:39.022816 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdf65f-0072-4303-bbe6-327e06ad053f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.023129 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdf65f-0072-4303-bbe6-327e06ad053f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.023467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdf65f-0072-4303-bbe6-327e06ad053f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.043187 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-23fdf65f-0072-4303-bbe6-327e06ad053f None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:39.044526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-23fdf65f-0072-4303-bbe6-327e06ad053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:39.060270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44b7a8-84dc-4d01-8915-b601222fe748 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:39.084291 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:39.116442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1021/2058] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:39.117324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdf65f-0072-4303-bbe6-327e06ad053f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:39.126066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-23fdf65f-0072-4303-bbe6-327e06ad053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:39.138435 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdf65f-0072-4303-bbe6-327e06ad053f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:39.139636 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8181c4-a881-481e-aa47-67180c03ad5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:39.140317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8181c4-a881-481e-aa47-67180c03ad5a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.140606 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8181c4-a881-481e-aa47-67180c03ad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.140881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8181c4-a881-481e-aa47-67180c03ad5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.141662 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8181c4-a881-481e-aa47-67180c03ad5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:39.143415 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8181c4-a881-481e-aa47-67180c03ad5a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:39.144646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135dc8d-4039-43c9-a1bd-c5bf070ec5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:39.145324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135dc8d-4039-43c9-a1bd-c5bf070ec5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.145900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135dc8d-4039-43c9-a1bd-c5bf070ec5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.146025 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135dc8d-4039-43c9-a1bd-c5bf070ec5e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.146803 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135dc8d-4039-43c9-a1bd-c5bf070ec5e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:39.148343 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135dc8d-4039-43c9-a1bd-c5bf070ec5e7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:39.155813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1038/2059] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:39.156535 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8181c4-a881-481e-aa47-67180c03ad5a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:39.158283 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ae8181c4-a881-481e-aa47-67180c03ad5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:39.162362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1022/2060] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:39.163775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fff6ad-2fec-4e32-a5bf-f5fd965928ec None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.164067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fff6ad-2fec-4e32-a5bf-f5fd965928ec None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.164351 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fff6ad-2fec-4e32-a5bf-f5fd965928ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.182215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8181c4-a881-481e-aa47-67180c03ad5a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:39.187210 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67291737-36ea-47e7-843e-d5ce7f8ee3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:39.187348 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a2fff6ad-2fec-4e32-a5bf-f5fd965928ec None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:39.188021 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67291737-36ea-47e7-843e-d5ce7f8ee3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.188371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67291737-36ea-47e7-843e-d5ce7f8ee3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.188721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67291737-36ea-47e7-843e-d5ce7f8ee3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.189394 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a2fff6ad-2fec-4e32-a5bf-f5fd965928ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:39.189618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67291737-36ea-47e7-843e-d5ce7f8ee3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:39.191284 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67291737-36ea-47e7-843e-d5ce7f8ee3c7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:39.199654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1023/2061] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:39.200710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fff6ad-2fec-4e32-a5bf-f5fd965928ec None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:39.204642 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1039/2062] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:39.205597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67291737-36ea-47e7-843e-d5ce7f8ee3c7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:39.209910 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a2fff6ad-2fec-4e32-a5bf-f5fd965928ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:39.220053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67291737-36ea-47e7-843e-d5ce7f8ee3c7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:39.225562 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6c191-9ba3-466e-ba3f-6369621266ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:39.226243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6c191-9ba3-466e-ba3f-6369621266ea admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.226664 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6c191-9ba3-466e-ba3f-6369621266ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.226951 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6c191-9ba3-466e-ba3f-6369621266ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.227687 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6c191-9ba3-466e-ba3f-6369621266ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:39.229293 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6c191-9ba3-466e-ba3f-6369621266ea admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:39.244594 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1040/2063] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:39.244594 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6c191-9ba3-466e-ba3f-6369621266ea admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:39.258340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6c191-9ba3-466e-ba3f-6369621266ea admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:39.267646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992934f8-424f-4ef9-bd19-eec64a9614bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:39.268645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992934f8-424f-4ef9-bd19-eec64a9614bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.269162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992934f8-424f-4ef9-bd19-eec64a9614bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.269621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992934f8-424f-4ef9-bd19-eec64a9614bd admin admin] PATH_INFO: `/v3/projects/f9114adee8b34094b529823e23aa8b6b/users/d8dbe8818517441d937d58904037e99d/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.279755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fff6ad-2fec-4e32-a5bf-f5fd965928ec None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:39.283446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469c190-e8ec-4e76-8ab3-29732852e314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:39.284109 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469c190-e8ec-4e76-8ab3-29732852e314 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.284492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469c190-e8ec-4e76-8ab3-29732852e314 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.284662 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469c190-e8ec-4e76-8ab3-29732852e314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.288582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992934f8-424f-4ef9-bd19-eec64a9614bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9114adee8b34094b529823e23aa8b6b, user_id=d8dbe8818517441d937d58904037e99d, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:39.291377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992934f8-424f-4ef9-bd19-eec64a9614bd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:39.295972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469c190-e8ec-4e76-8ab3-29732852e314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:39.297634 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469c190-e8ec-4e76-8ab3-29732852e314 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:39.308701 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1024/2064] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:39.309522 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469c190-e8ec-4e76-8ab3-29732852e314 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:39.309938 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1041/2065] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:39 2022] PUT /identity/v3/projects/f9114adee8b34094b529823e23aa8b6b/users/d8dbe8818517441d937d58904037e99d/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:39.313778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992934f8-424f-4ef9-bd19-eec64a9614bd admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:39.319117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469c190-e8ec-4e76-8ab3-29732852e314 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:39.377108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992934f8-424f-4ef9-bd19-eec64a9614bd admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:39.381151 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:39.381300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95120465-1345-4954-82a7-1f7f5ffa3eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:39.382047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95120465-1345-4954-82a7-1f7f5ffa3eea service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.382334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95120465-1345-4954-82a7-1f7f5ffa3eea service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.382608 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95120465-1345-4954-82a7-1f7f5ffa3eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.389089 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5f166-065e-4915-b0d0-0908cf95f7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:39.393797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5f166-065e-4915-b0d0-0908cf95f7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.394115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5f166-065e-4915-b0d0-0908cf95f7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.394249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95120465-1345-4954-82a7-1f7f5ffa3eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:39.394458 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5f166-065e-4915-b0d0-0908cf95f7fe admin admin] PATH_INFO: `/v3/projects/8c9ee3236322444e915b7447bc853f82/users/62a514ae61794341a6d317cda430448e/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.395598 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95120465-1345-4954-82a7-1f7f5ffa3eea service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:39.396767 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5f166-065e-4915-b0d0-0908cf95f7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9ee3236322444e915b7447bc853f82, user_id=62a514ae61794341a6d317cda430448e, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:39.400162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5f166-065e-4915-b0d0-0908cf95f7fe admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:39.406137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1042/2066] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:39.407013 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95120465-1345-4954-82a7-1f7f5ffa3eea service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:39.423076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1025/2067] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:39 2022] PUT /identity/v3/projects/8c9ee3236322444e915b7447bc853f82/users/62a514ae61794341a6d317cda430448e/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:39.423076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5f166-065e-4915-b0d0-0908cf95f7fe admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:39.423076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-63d5f166-065e-4915-b0d0-0908cf95f7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:39.423559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95120465-1345-4954-82a7-1f7f5ffa3eea service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:39.493846 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214394be-e97d-40dc-96aa-a01d1a96eb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:39.494914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214394be-e97d-40dc-96aa-a01d1a96eb49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.497982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214394be-e97d-40dc-96aa-a01d1a96eb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.497982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214394be-e97d-40dc-96aa-a01d1a96eb49 admin admin] PATH_INFO: `/v3/projects/ceb2e683ddc34ceda951a40c716459dd/users/8593240e36fc40dcac15838d49925665/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.506333 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5f166-065e-4915-b0d0-0908cf95f7fe admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:39.514016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30061cef-106e-4774-a326-993ffa34a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:39.514587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:39.516422 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30061cef-106e-4774-a326-993ffa34a2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.516774 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30061cef-106e-4774-a326-993ffa34a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.517058 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30061cef-106e-4774-a326-993ffa34a2f7 admin admin] PATH_INFO: `/v3/users/772b9a5e43034b37ae878024830ddd1b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.519384 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30061cef-106e-4774-a326-993ffa34a2f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=772b9a5e43034b37ae878024830ddd1b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:39.519768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214394be-e97d-40dc-96aa-a01d1a96eb49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb2e683ddc34ceda951a40c716459dd, user_id=8593240e36fc40dcac15838d49925665, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:39.522784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30061cef-106e-4774-a326-993ffa34a2f7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:39.523550 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214394be-e97d-40dc-96aa-a01d1a96eb49 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:39.550398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1043/2068] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:39 2022] PUT /identity/v3/projects/ceb2e683ddc34ceda951a40c716459dd/users/8593240e36fc40dcac15838d49925665/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:39.550398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865e200-7e74-473c-a7e0-63e901c7f164 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.550398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865e200-7e74-473c-a7e0-63e901c7f164 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.550398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865e200-7e74-473c-a7e0-63e901c7f164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.568112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-6865e200-7e74-473c-a7e0-63e901c7f164 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:39.569682 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6865e200-7e74-473c-a7e0-63e901c7f164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:39.588348 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-30061cef-106e-4774-a326-993ffa34a2f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '772b9a5e43034b37ae878024830ddd1b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:39.598742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-30061cef-106e-4774-a326-993ffa34a2f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '772b9a5e43034b37ae878024830ddd1b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:39.599832 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-30061cef-106e-4774-a326-993ffa34a2f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '772b9a5e43034b37ae878024830ddd1b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:39.601087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-30061cef-106e-4774-a326-993ffa34a2f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '772b9a5e43034b37ae878024830ddd1b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:39.625108 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-30061cef-106e-4774-a326-993ffa34a2f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '772b9a5e43034b37ae878024830ddd1b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:39.645002 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1026/2069] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:39 2022] DELETE /identity/v3/users/772b9a5e43034b37ae878024830ddd1b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:39.645002 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dabba-b537-4aa7-9511-a4b9466a20f0 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.645002 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dabba-b537-4aa7-9511-a4b9466a20f0 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.645002 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dabba-b537-4aa7-9511-a4b9466a20f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.667210 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1044/2070] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:39.668305 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c648f95-d865-4864-82b2-57c50aa11909 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.668803 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c648f95-d865-4864-82b2-57c50aa11909 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.669118 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c648f95-d865-4864-82b2-57c50aa11909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.706433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2c648f95-d865-4864-82b2-57c50aa11909 None None] MFA Rules not processed for user `8593240e36fc40dcac15838d49925665`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:39.707737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2c648f95-d865-4864-82b2-57c50aa11909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:39.719513 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-fc0dabba-b537-4aa7-9511-a4b9466a20f0 None None] MFA Rules not processed for user `62a514ae61794341a6d317cda430448e`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:39.721056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fc0dabba-b537-4aa7-9511-a4b9466a20f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:39.810583 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1045/2071] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:39.815491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c648f95-d865-4864-82b2-57c50aa11909 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:39.815639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:39.826228 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2c648f95-d865-4864-82b2-57c50aa11909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:39.828400 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1027/2072] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:39.829448 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dabba-b537-4aa7-9511-a4b9466a20f0 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:39.831570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fc0dabba-b537-4aa7-9511-a4b9466a20f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:39.899739 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c648f95-d865-4864-82b2-57c50aa11909 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:39.905300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82fbcc-ac4a-453f-a57c-cdfc858957ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:39.905838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82fbcc-ac4a-453f-a57c-cdfc858957ef service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.906123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82fbcc-ac4a-453f-a57c-cdfc858957ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.906410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82fbcc-ac4a-453f-a57c-cdfc858957ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.922718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dabba-b537-4aa7-9511-a4b9466a20f0 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:39.932913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:39.933987 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:39.934368 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:39.934931 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1 admin admin] PATH_INFO: `/v3/projects/800bcffb5ffb4b52bff2538420409081` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:39.936217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=800bcffb5ffb4b52bff2538420409081)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:39.938376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:39.979734 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:40.031063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '800bcffb5ffb4b52bff2538420409081', 'request_id': 'req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.037596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '800bcffb5ffb4b52bff2538420409081', 'request_id': 'req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.051309 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82fbcc-ac4a-453f-a57c-cdfc858957ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:40.054731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82fbcc-ac4a-453f-a57c-cdfc858957ef service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:40.057480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '800bcffb5ffb4b52bff2538420409081', 'request_id': 'req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.078742 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1046/2073] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:40.080044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82fbcc-ac4a-453f-a57c-cdfc858957ef service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:40.081920 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2c82fbcc-ac4a-453f-a57c-cdfc858957ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:40.095367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1 admin admin] The token cache is being invalidate because project 800bcffb5ffb4b52bff2538420409081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:40.095766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.096638 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.099376 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82fbcc-ac4a-453f-a57c-cdfc858957ef service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:40.107303 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1028/2074] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:39 2022] DELETE /identity/v3/projects/800bcffb5ffb4b52bff2538420409081 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:40.108301 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:40.114633 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:40.178743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ad876-a2e2-4e67-8148-782bcc5dd421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:40.179563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ad876-a2e2-4e67-8148-782bcc5dd421 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:40.179952 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ad876-a2e2-4e67-8148-782bcc5dd421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:40.180330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ad876-a2e2-4e67-8148-782bcc5dd421 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:40.181123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ad876-a2e2-4e67-8148-782bcc5dd421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:40.184083 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ad876-a2e2-4e67-8148-782bcc5dd421 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:40.218696 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1016deb-4e22-4351-8c7b-fdeba2c0aea1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:40.225881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1047/2075] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:40 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:40.226349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921df766-e591-4a36-81eb-459d515f0327 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:40.226627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ad876-a2e2-4e67-8148-782bcc5dd421 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:40.227227 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921df766-e591-4a36-81eb-459d515f0327 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:40.227615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921df766-e591-4a36-81eb-459d515f0327 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:40.228146 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921df766-e591-4a36-81eb-459d515f0327 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:40.229653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e19ad876-a2e2-4e67-8148-782bcc5dd421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:40.231487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-921df766-e591-4a36-81eb-459d515f0327 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:40.305207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:40.324945 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ad876-a2e2-4e67-8148-782bcc5dd421 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:40.331271 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf18e3-4662-469d-bc79-3eca0d16343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:40.332422 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf18e3-4662-469d-bc79-3eca0d16343e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:40.332710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf18e3-4662-469d-bc79-3eca0d16343e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:40.333008 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf18e3-4662-469d-bc79-3eca0d16343e admin admin] PATH_INFO: `/v3/projects/a2342d27f5264e3aac7f52e28ce2f35a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:40.334541 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf18e3-4662-469d-bc79-3eca0d16343e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2342d27f5264e3aac7f52e28ce2f35a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:40.337050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf18e3-4662-469d-bc79-3eca0d16343e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:40.355498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921df766-e591-4a36-81eb-459d515f0327 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:40.359641 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921df766-e591-4a36-81eb-459d515f0327 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:40.375519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1029/2076] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:40 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:40.377552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921df766-e591-4a36-81eb-459d515f0327 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:40.379179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-921df766-e591-4a36-81eb-459d515f0327 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:40.400920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921df766-e591-4a36-81eb-459d515f0327 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:40.416755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5baf18e3-4662-469d-bc79-3eca0d16343e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2342d27f5264e3aac7f52e28ce2f35a', 'request_id': 'req-5baf18e3-4662-469d-bc79-3eca0d16343e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.434490 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5baf18e3-4662-469d-bc79-3eca0d16343e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2342d27f5264e3aac7f52e28ce2f35a', 'request_id': 'req-5baf18e3-4662-469d-bc79-3eca0d16343e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.436067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:40.446670 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5baf18e3-4662-469d-bc79-3eca0d16343e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2342d27f5264e3aac7f52e28ce2f35a', 'request_id': 'req-5baf18e3-4662-469d-bc79-3eca0d16343e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.463957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5baf18e3-4662-469d-bc79-3eca0d16343e admin admin] The token cache is being invalidate because project a2342d27f5264e3aac7f52e28ce2f35a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:40.464253 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5baf18e3-4662-469d-bc79-3eca0d16343e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.464907 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5baf18e3-4662-469d-bc79-3eca0d16343e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.469631 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1048/2077] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:40 2022] DELETE /identity/v3/projects/a2342d27f5264e3aac7f52e28ce2f35a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:40.470668 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf18e3-4662-469d-bc79-3eca0d16343e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:40.471979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5baf18e3-4662-469d-bc79-3eca0d16343e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:40.488047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2f492-e17a-401e-b299-48eadb20081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:40.489237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2f492-e17a-401e-b299-48eadb20081d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:40.489630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2f492-e17a-401e-b299-48eadb20081d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:40.489885 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2f492-e17a-401e-b299-48eadb20081d admin admin] PATH_INFO: `/v3/projects/3736c3d43fa04279aa88c72681f3c95c` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:40.491203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2f492-e17a-401e-b299-48eadb20081d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3736c3d43fa04279aa88c72681f3c95c)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:40.493645 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2f492-e17a-401e-b299-48eadb20081d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:40.556856 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1cc2f492-e17a-401e-b299-48eadb20081d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3736c3d43fa04279aa88c72681f3c95c', 'request_id': 'req-1cc2f492-e17a-401e-b299-48eadb20081d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.564291 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1cc2f492-e17a-401e-b299-48eadb20081d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3736c3d43fa04279aa88c72681f3c95c', 'request_id': 'req-1cc2f492-e17a-401e-b299-48eadb20081d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.565439 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf18e3-4662-469d-bc79-3eca0d16343e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:40.576909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1cc2f492-e17a-401e-b299-48eadb20081d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3736c3d43fa04279aa88c72681f3c95c', 'request_id': 'req-1cc2f492-e17a-401e-b299-48eadb20081d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.594866 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1cc2f492-e17a-401e-b299-48eadb20081d admin admin] The token cache is being invalidate because project 3736c3d43fa04279aa88c72681f3c95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:40.595154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1cc2f492-e17a-401e-b299-48eadb20081d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.595828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1cc2f492-e17a-401e-b299-48eadb20081d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.598188 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1030/2078] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:40 2022] DELETE /identity/v3/projects/3736c3d43fa04279aa88c72681f3c95c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:40.603380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2f492-e17a-401e-b299-48eadb20081d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:40.605120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1cc2f492-e17a-401e-b299-48eadb20081d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:40.647954 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb6b10-bbb2-4813-bfc1-f97e59bef382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:40.648980 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb6b10-bbb2-4813-bfc1-f97e59bef382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:40.649265 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb6b10-bbb2-4813-bfc1-f97e59bef382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:40.649590 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb6b10-bbb2-4813-bfc1-f97e59bef382 admin admin] PATH_INFO: `/v3/users/3d192f847e874b65af9dbf354c42e55a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:40.650924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb6b10-bbb2-4813-bfc1-f97e59bef382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d192f847e874b65af9dbf354c42e55a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:40.653950 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb6b10-bbb2-4813-bfc1-f97e59bef382 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:40.699672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2f492-e17a-401e-b299-48eadb20081d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:40.705912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320e9b1-64d4-49c0-9a8e-0229f3e75c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:40.706854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320e9b1-64d4-49c0-9a8e-0229f3e75c98 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:40.706854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320e9b1-64d4-49c0-9a8e-0229f3e75c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:40.707157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320e9b1-64d4-49c0-9a8e-0229f3e75c98 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:40.707848 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320e9b1-64d4-49c0-9a8e-0229f3e75c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:40.709840 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320e9b1-64d4-49c0-9a8e-0229f3e75c98 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:40.722697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:40.727623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cabb6b10-bbb2-4813-bfc1-f97e59bef382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d192f847e874b65af9dbf354c42e55a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.739780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1031/2079] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:40 2022] POST /identity/v3/users => generated 295 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:40.740320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cabb6b10-bbb2-4813-bfc1-f97e59bef382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d192f847e874b65af9dbf354c42e55a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.740632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320e9b1-64d4-49c0-9a8e-0229f3e75c98 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:40.741883 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cabb6b10-bbb2-4813-bfc1-f97e59bef382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d192f847e874b65af9dbf354c42e55a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.742289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5320e9b1-64d4-49c0-9a8e-0229f3e75c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:40.743069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cabb6b10-bbb2-4813-bfc1-f97e59bef382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d192f847e874b65af9dbf354c42e55a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.760249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-cabb6b10-bbb2-4813-bfc1-f97e59bef382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d192f847e874b65af9dbf354c42e55a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.775981 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1049/2080] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:40 2022] DELETE /identity/v3/users/3d192f847e874b65af9dbf354c42e55a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:40.777129 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb6b10-bbb2-4813-bfc1-f97e59bef382 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:40.778618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cabb6b10-bbb2-4813-bfc1-f97e59bef382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:40.795535 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:40.819994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320e9b1-64d4-49c0-9a8e-0229f3e75c98 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:40.854901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb6b10-bbb2-4813-bfc1-f97e59bef382 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:40.860589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bda80-8d96-4344-9d63-a6a8de638f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:40.861616 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bda80-8d96-4344-9d63-a6a8de638f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:40.861977 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bda80-8d96-4344-9d63-a6a8de638f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:40.862328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bda80-8d96-4344-9d63-a6a8de638f88 admin admin] PATH_INFO: `/v3/users/7c1864cf648f42b7af86a6d43fae19fb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:40.863935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bda80-8d96-4344-9d63-a6a8de638f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1864cf648f42b7af86a6d43fae19fb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:40.866588 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bda80-8d96-4344-9d63-a6a8de638f88 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:40.912000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0f2a0-851c-4454-bf4f-e971be74a06f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:40.912773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0f2a0-851c-4454-bf4f-e971be74a06f service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:40.913325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0f2a0-851c-4454-bf4f-e971be74a06f service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:40.913739 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0f2a0-851c-4454-bf4f-e971be74a06f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:40.916055 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b8e0f2a0-851c-4454-bf4f-e971be74a06f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:40.946924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a44bda80-8d96-4344-9d63-a6a8de638f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1864cf648f42b7af86a6d43fae19fb'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.960787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a44bda80-8d96-4344-9d63-a6a8de638f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1864cf648f42b7af86a6d43fae19fb'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.961618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a44bda80-8d96-4344-9d63-a6a8de638f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1864cf648f42b7af86a6d43fae19fb'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.962534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a44bda80-8d96-4344-9d63-a6a8de638f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1864cf648f42b7af86a6d43fae19fb'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:40.978896 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a44bda80-8d96-4344-9d63-a6a8de638f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1864cf648f42b7af86a6d43fae19fb'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:41.011749 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1050/2081] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:40 2022] DELETE /identity/v3/users/7c1864cf648f42b7af86a6d43fae19fb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:41.013708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daee09a-4c7c-49b0-be32-ab60cf084b98 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:41.014183 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daee09a-4c7c-49b0-be32-ab60cf084b98 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:41.015201 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daee09a-4c7c-49b0-be32-ab60cf084b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:41.037875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0f2a0-851c-4454-bf4f-e971be74a06f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:41.044549 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0f2a0-851c-4454-bf4f-e971be74a06f service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:41.048863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2daee09a-4c7c-49b0-be32-ab60cf084b98 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:41.050276 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2daee09a-4c7c-49b0-be32-ab60cf084b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:41.074245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1032/2082] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:41.075752 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0f2a0-851c-4454-bf4f-e971be74a06f service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:41.077208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b8e0f2a0-851c-4454-bf4f-e971be74a06f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:41.114339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0f2a0-851c-4454-bf4f-e971be74a06f service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:41.204988 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9817059-3f11-4b26-b835-4f7780bcb638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:41.205947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9817059-3f11-4b26-b835-4f7780bcb638 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:41.206449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9817059-3f11-4b26-b835-4f7780bcb638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:41.206822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9817059-3f11-4b26-b835-4f7780bcb638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:41.207761 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9817059-3f11-4b26-b835-4f7780bcb638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:41.209899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9817059-3f11-4b26-b835-4f7780bcb638 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:41.225584 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1033/2083] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:41.227180 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87363b9a-d940-4772-9ad8-3c5340a7092b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:41.227536 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87363b9a-d940-4772-9ad8-3c5340a7092b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:41.228013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87363b9a-d940-4772-9ad8-3c5340a7092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:41.232572 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1051/2084] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:41.238048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:41.243002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daee09a-4c7c-49b0-be32-ab60cf084b98 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:41.250303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2daee09a-4c7c-49b0-be32-ab60cf084b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:41.275114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daee09a-4c7c-49b0-be32-ab60cf084b98 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:41.283982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a3891-76e4-4e27-9b2d-f75ed3536398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:41.285627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a3891-76e4-4e27-9b2d-f75ed3536398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:41.285974 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a3891-76e4-4e27-9b2d-f75ed3536398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:41.286383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a3891-76e4-4e27-9b2d-f75ed3536398 admin admin] PATH_INFO: `/v3/projects/d0b4caad322d48e1802bcfd2981c8342` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:41.287916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a3891-76e4-4e27-9b2d-f75ed3536398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0b4caad322d48e1802bcfd2981c8342)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:41.291307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a3891-76e4-4e27-9b2d-f75ed3536398 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:41.301495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-87363b9a-d940-4772-9ad8-3c5340a7092b None None] MFA Rules not processed for user `d8dbe8818517441d937d58904037e99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:41.302666 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-87363b9a-d940-4772-9ad8-3c5340a7092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:41.347574 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:41.409676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a09a3891-76e4-4e27-9b2d-f75ed3536398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0b4caad322d48e1802bcfd2981c8342', 'request_id': 'req-a09a3891-76e4-4e27-9b2d-f75ed3536398'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:41.417267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a09a3891-76e4-4e27-9b2d-f75ed3536398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0b4caad322d48e1802bcfd2981c8342', 'request_id': 'req-a09a3891-76e4-4e27-9b2d-f75ed3536398'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:41.428327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a09a3891-76e4-4e27-9b2d-f75ed3536398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0b4caad322d48e1802bcfd2981c8342', 'request_id': 'req-a09a3891-76e4-4e27-9b2d-f75ed3536398'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:41.440708 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1034/2085] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:41.441890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87363b9a-d940-4772-9ad8-3c5340a7092b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:41.443853 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-87363b9a-d940-4772-9ad8-3c5340a7092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:41.452861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a09a3891-76e4-4e27-9b2d-f75ed3536398 admin admin] The token cache is being invalidate because project d0b4caad322d48e1802bcfd2981c8342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:41.453418 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a09a3891-76e4-4e27-9b2d-f75ed3536398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:41.455363 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a09a3891-76e4-4e27-9b2d-f75ed3536398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:41.461574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87363b9a-d940-4772-9ad8-3c5340a7092b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:41.465166 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1052/2086] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:41 2022] DELETE /identity/v3/projects/d0b4caad322d48e1802bcfd2981c8342 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:41.475942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad183898-7ef3-466c-aef3-8b970fd81edb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:41.475942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad183898-7ef3-466c-aef3-8b970fd81edb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:41.475942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad183898-7ef3-466c-aef3-8b970fd81edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:41.495134 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ad183898-7ef3-466c-aef3-8b970fd81edb None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:41.496732 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ad183898-7ef3-466c-aef3-8b970fd81edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:41.543347 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5e072-f4db-40df-a05d-6b2ab0e5f55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:41.545249 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e072-f4db-40df-a05d-6b2ab0e5f55e admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:41.546116 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e072-f4db-40df-a05d-6b2ab0e5f55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:41.546663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e072-f4db-40df-a05d-6b2ab0e5f55e admin admin] PATH_INFO: `/v3/projects/6ca01e537da9460988200208a98cde3e/users/39b43dff97fe4b8c871c647f2d798f6e/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:41.568841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5e072-f4db-40df-a05d-6b2ab0e5f55e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca01e537da9460988200208a98cde3e, user_id=39b43dff97fe4b8c871c647f2d798f6e, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:41.572427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5e072-f4db-40df-a05d-6b2ab0e5f55e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:41.588744 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1035/2087] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:41 2022] PUT /identity/v3/projects/6ca01e537da9460988200208a98cde3e/users/39b43dff97fe4b8c871c647f2d798f6e/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:41.589617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5e072-f4db-40df-a05d-6b2ab0e5f55e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:41.591310 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6fe5e072-f4db-40df-a05d-6b2ab0e5f55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:41.592706 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1053/2088] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:41.594554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abfe67-25d3-41d4-982a-52d57f7c627c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:41.594985 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abfe67-25d3-41d4-982a-52d57f7c627c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:41.595440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abfe67-25d3-41d4-982a-52d57f7c627c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:41.617215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-25abfe67-25d3-41d4-982a-52d57f7c627c None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:41.618523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-25abfe67-25d3-41d4-982a-52d57f7c627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:41.663115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5e072-f4db-40df-a05d-6b2ab0e5f55e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:41.668606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee94d12-1766-4eb8-9fc8-785a43fc3dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:41.669394 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee94d12-1766-4eb8-9fc8-785a43fc3dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:41.669757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee94d12-1766-4eb8-9fc8-785a43fc3dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:41.670096 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee94d12-1766-4eb8-9fc8-785a43fc3dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:41.670874 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee94d12-1766-4eb8-9fc8-785a43fc3dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:41.672871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee94d12-1766-4eb8-9fc8-785a43fc3dd2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:41.678632 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1054/2089] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:41.679617 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abfe67-25d3-41d4-982a-52d57f7c627c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:41.681051 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-25abfe67-25d3-41d4-982a-52d57f7c627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:41.695176 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abfe67-25d3-41d4-982a-52d57f7c627c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:41.701255 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be142630-f15e-4f41-86b0-e2dcf99c7e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:41.702526 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be142630-f15e-4f41-86b0-e2dcf99c7e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:41.702793 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be142630-f15e-4f41-86b0-e2dcf99c7e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:41.703073 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be142630-f15e-4f41-86b0-e2dcf99c7e22 admin admin] PATH_INFO: `/v3/projects/91b248a57a4e4e06a32cda326b08f1f0` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:41.704409 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be142630-f15e-4f41-86b0-e2dcf99c7e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b248a57a4e4e06a32cda326b08f1f0)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:41.706238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:41.706610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be142630-f15e-4f41-86b0-e2dcf99c7e22 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:41.715131 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1036/2090] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:41 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:41.716315 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee94d12-1766-4eb8-9fc8-785a43fc3dd2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:41.720572 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-bee94d12-1766-4eb8-9fc8-785a43fc3dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:41.777822 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-be142630-f15e-4f41-86b0-e2dcf99c7e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b248a57a4e4e06a32cda326b08f1f0', 'request_id': 'req-be142630-f15e-4f41-86b0-e2dcf99c7e22'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:41.780815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:41.786555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-be142630-f15e-4f41-86b0-e2dcf99c7e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b248a57a4e4e06a32cda326b08f1f0', 'request_id': 'req-be142630-f15e-4f41-86b0-e2dcf99c7e22'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:41.794733 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-be142630-f15e-4f41-86b0-e2dcf99c7e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b248a57a4e4e06a32cda326b08f1f0', 'request_id': 'req-be142630-f15e-4f41-86b0-e2dcf99c7e22'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:41.812406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-be142630-f15e-4f41-86b0-e2dcf99c7e22 admin admin] The token cache is being invalidate because project 91b248a57a4e4e06a32cda326b08f1f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:41.812744 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-be142630-f15e-4f41-86b0-e2dcf99c7e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:41.813857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee94d12-1766-4eb8-9fc8-785a43fc3dd2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:41.815240 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-be142630-f15e-4f41-86b0-e2dcf99c7e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:41.817459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1055/2091] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:41 2022] DELETE /identity/v3/projects/91b248a57a4e4e06a32cda326b08f1f0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:41.818958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be142630-f15e-4f41-86b0-e2dcf99c7e22 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:41.820997 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-be142630-f15e-4f41-86b0-e2dcf99c7e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:41.890686 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b440c-9066-459e-84cd-eccb873568ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:41.891429 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b440c-9066-459e-84cd-eccb873568ed admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:41.891717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b440c-9066-459e-84cd-eccb873568ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:41.892042 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b440c-9066-459e-84cd-eccb873568ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:41.892794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b440c-9066-459e-84cd-eccb873568ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:41.894646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b440c-9066-459e-84cd-eccb873568ed admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:41.905233 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1037/2092] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:41.906517 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0acab-7918-45aa-b1d5-e778f45931f2 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:41.906805 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0acab-7918-45aa-b1d5-e778f45931f2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:41.907085 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0acab-7918-45aa-b1d5-e778f45931f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:41.909789 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be142630-f15e-4f41-86b0-e2dcf99c7e22 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:41.914560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30912020-40c1-480f-ae58-86a8286ed570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:41.915225 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30912020-40c1-480f-ae58-86a8286ed570 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:41.915505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30912020-40c1-480f-ae58-86a8286ed570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:41.915781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30912020-40c1-480f-ae58-86a8286ed570 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:41.916514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30912020-40c1-480f-ae58-86a8286ed570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:41.916820 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30912020-40c1-480f-ae58-86a8286ed570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:41.918458 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30912020-40c1-480f-ae58-86a8286ed570 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:41.924639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-cad0acab-7918-45aa-b1d5-e778f45931f2 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:41.925872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-cad0acab-7918-45aa-b1d5-e778f45931f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:41.933991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1056/2093] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:41.933991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30912020-40c1-480f-ae58-86a8286ed570 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:41.933991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-30912020-40c1-480f-ae58-86a8286ed570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:41.937317 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1038/2094] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:41.938196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0acab-7918-45aa-b1d5-e778f45931f2 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:41.939481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-cad0acab-7918-45aa-b1d5-e778f45931f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:41.947318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30912020-40c1-480f-ae58-86a8286ed570 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:41.952456 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7d801-ca97-4790-8bcd-2a0e21573990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:41.953250 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7d801-ca97-4790-8bcd-2a0e21573990 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:41.953562 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7d801-ca97-4790-8bcd-2a0e21573990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:41.953658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0acab-7918-45aa-b1d5-e778f45931f2 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:41.953847 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7d801-ca97-4790-8bcd-2a0e21573990 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:41.954548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7d801-ca97-4790-8bcd-2a0e21573990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:41.956995 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7d801-ca97-4790-8bcd-2a0e21573990 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:41.959509 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca4f85-5c82-48a2-9cd9-1fac3c89b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:41.961040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca4f85-5c82-48a2-9cd9-1fac3c89b57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:41.961502 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca4f85-5c82-48a2-9cd9-1fac3c89b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:41.961922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca4f85-5c82-48a2-9cd9-1fac3c89b57a admin admin] PATH_INFO: `/v3/users/90e978cd40a64d8580e738c9d6c8d8fc` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:41.963821 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca4f85-5c82-48a2-9cd9-1fac3c89b57a admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e978cd40a64d8580e738c9d6c8d8fc)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:41.967266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca4f85-5c82-48a2-9cd9-1fac3c89b57a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:41.979396 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1057/2095] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:41 2022] POST /identity/v3/users => generated 292 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:41.980382 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7d801-ca97-4790-8bcd-2a0e21573990 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:41.983613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bbf7d801-ca97-4790-8bcd-2a0e21573990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:41.996781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7d801-ca97-4790-8bcd-2a0e21573990 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:42.002569 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3d2bb-8f48-4873-901b-cd7fec74eb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:42.003746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3d2bb-8f48-4873-901b-cd7fec74eb7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.004367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3d2bb-8f48-4873-901b-cd7fec74eb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.004664 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3d2bb-8f48-4873-901b-cd7fec74eb7d admin admin] PATH_INFO: `/v3/projects/6ca01e537da9460988200208a98cde3e/users/39b43dff97fe4b8c871c647f2d798f6e/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.007339 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3d2bb-8f48-4873-901b-cd7fec74eb7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca01e537da9460988200208a98cde3e, user_id=39b43dff97fe4b8c871c647f2d798f6e, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:42.010152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3d2bb-8f48-4873-901b-cd7fec74eb7d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:42.024692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-31ca4f85-5c82-48a2-9cd9-1fac3c89b57a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e978cd40a64d8580e738c9d6c8d8fc'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:42.024881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1058/2096] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:41 2022] PUT /identity/v3/projects/6ca01e537da9460988200208a98cde3e/users/39b43dff97fe4b8c871c647f2d798f6e/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:42.025649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3d2bb-8f48-4873-901b-cd7fec74eb7d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:42.041171 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-31ca4f85-5c82-48a2-9cd9-1fac3c89b57a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e978cd40a64d8580e738c9d6c8d8fc'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:42.041843 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-31ca4f85-5c82-48a2-9cd9-1fac3c89b57a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e978cd40a64d8580e738c9d6c8d8fc'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:42.042481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-31ca4f85-5c82-48a2-9cd9-1fac3c89b57a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e978cd40a64d8580e738c9d6c8d8fc'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:42.057939 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-31ca4f85-5c82-48a2-9cd9-1fac3c89b57a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e978cd40a64d8580e738c9d6c8d8fc'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:42.078546 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1039/2097] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:41 2022] DELETE /identity/v3/users/90e978cd40a64d8580e738c9d6c8d8fc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:42.082569 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca4f85-5c82-48a2-9cd9-1fac3c89b57a admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:42.083636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-31ca4f85-5c82-48a2-9cd9-1fac3c89b57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:42.093510 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3d2bb-8f48-4873-901b-cd7fec74eb7d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:42.095024 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:42.149173 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:42.162570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305a8c2-61dc-4fa3-82e7-82fa5750f659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:42.163066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305a8c2-61dc-4fa3-82e7-82fa5750f659 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.166020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305a8c2-61dc-4fa3-82e7-82fa5750f659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.166324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305a8c2-61dc-4fa3-82e7-82fa5750f659 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.167101 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305a8c2-61dc-4fa3-82e7-82fa5750f659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:42.167526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca4f85-5c82-48a2-9cd9-1fac3c89b57a admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:42.169474 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305a8c2-61dc-4fa3-82e7-82fa5750f659 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:42.172977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039c995-dc49-4b70-bd2b-44be7e740ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:42.173542 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039c995-dc49-4b70-bd2b-44be7e740ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.173828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039c995-dc49-4b70-bd2b-44be7e740ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.174399 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039c995-dc49-4b70-bd2b-44be7e740ea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.175140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039c995-dc49-4b70-bd2b-44be7e740ea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:42.175451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039c995-dc49-4b70-bd2b-44be7e740ea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:42.177104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039c995-dc49-4b70-bd2b-44be7e740ea6 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:42.191388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1040/2098] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:42.192973 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039c995-dc49-4b70-bd2b-44be7e740ea6 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:42.197135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5039c995-dc49-4b70-bd2b-44be7e740ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:42.203010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1059/2099] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:42 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:42.204394 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195a434-3360-48f9-8178-c990b89636a0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.204687 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195a434-3360-48f9-8178-c990b89636a0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.204966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195a434-3360-48f9-8178-c990b89636a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.213630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039c995-dc49-4b70-bd2b-44be7e740ea6 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:42.242404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3195a434-3360-48f9-8178-c990b89636a0 None None] MFA Rules not processed for user `39b43dff97fe4b8c871c647f2d798f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:42.243319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3195a434-3360-48f9-8178-c990b89636a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:42.287971 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a5c79-42cc-43d9-b62d-3afa31f35ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:42.288564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a5c79-42cc-43d9-b62d-3afa31f35ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.288843 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a5c79-42cc-43d9-b62d-3afa31f35ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.289122 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a5c79-42cc-43d9-b62d-3afa31f35ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.289894 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a5c79-42cc-43d9-b62d-3afa31f35ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:42.291602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a5c79-42cc-43d9-b62d-3afa31f35ba8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:42.306103 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1041/2100] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:42.306103 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a5c79-42cc-43d9-b62d-3afa31f35ba8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:42.314385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a5c79-42cc-43d9-b62d-3afa31f35ba8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:42.323101 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b423b3-6d98-433c-8c32-bc76db4cccff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:42.323909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b423b3-6d98-433c-8c32-bc76db4cccff admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.324057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b423b3-6d98-433c-8c32-bc76db4cccff admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.324336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b423b3-6d98-433c-8c32-bc76db4cccff admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.325047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b423b3-6d98-433c-8c32-bc76db4cccff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:42.326140 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1060/2101] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:42.327098 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b423b3-6d98-433c-8c32-bc76db4cccff admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:42.327206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195a434-3360-48f9-8178-c990b89636a0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:42.328998 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3195a434-3360-48f9-8178-c990b89636a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:42.344074 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195a434-3360-48f9-8178-c990b89636a0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:42.349554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53661da2-7a55-4014-9e59-6c5a2d976d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:42.351311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53661da2-7a55-4014-9e59-6c5a2d976d9b admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.351715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53661da2-7a55-4014-9e59-6c5a2d976d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.351989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53661da2-7a55-4014-9e59-6c5a2d976d9b admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.353045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53661da2-7a55-4014-9e59-6c5a2d976d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:42.354883 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53661da2-7a55-4014-9e59-6c5a2d976d9b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:42.370827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1042/2102] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:42 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:42.370827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b423b3-6d98-433c-8c32-bc76db4cccff admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:42.390790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1061/2103] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:42 2022] POST /identity/v3/users => generated 288 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:42.392105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53661da2-7a55-4014-9e59-6c5a2d976d9b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:42.394678 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-53661da2-7a55-4014-9e59-6c5a2d976d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:42.455361 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b423b3-6d98-433c-8c32-bc76db4cccff admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:42.461139 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ac198-c916-425c-8979-83bcdae1b506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:42.462250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ac198-c916-425c-8979-83bcdae1b506 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.462611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ac198-c916-425c-8979-83bcdae1b506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.463009 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ac198-c916-425c-8979-83bcdae1b506 admin admin] PATH_INFO: `/v3/projects/f4a4aa85d40d48de9dda8258716a0f69/users/98a9e6fe4aa84bf5a7c80ad13d44f1c1/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.473978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53661da2-7a55-4014-9e59-6c5a2d976d9b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:42.489847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ac198-c916-425c-8979-83bcdae1b506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a4aa85d40d48de9dda8258716a0f69, user_id=98a9e6fe4aa84bf5a7c80ad13d44f1c1, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:42.492756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ac198-c916-425c-8979-83bcdae1b506 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:42.506157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:42.518298 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1043/2104] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:42 2022] PUT /identity/v3/projects/f4a4aa85d40d48de9dda8258716a0f69/users/98a9e6fe4aa84bf5a7c80ad13d44f1c1/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:42.519115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ac198-c916-425c-8979-83bcdae1b506 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:42.541127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27a80d-b632-484d-bb2e-ed2b25dd653f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:42.541946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27a80d-b632-484d-bb2e-ed2b25dd653f service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.542380 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27a80d-b632-484d-bb2e-ed2b25dd653f service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.542666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27a80d-b632-484d-bb2e-ed2b25dd653f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.561364 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:42.628765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ac198-c916-425c-8979-83bcdae1b506 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:42.634010 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738a576-7fb0-4bd0-8b94-5b35f1ce1578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:42.634799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27a80d-b632-484d-bb2e-ed2b25dd653f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:42.634950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738a576-7fb0-4bd0-8b94-5b35f1ce1578 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.636256 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27a80d-b632-484d-bb2e-ed2b25dd653f service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:42.639484 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738a576-7fb0-4bd0-8b94-5b35f1ce1578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.639802 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738a576-7fb0-4bd0-8b94-5b35f1ce1578 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.640617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738a576-7fb0-4bd0-8b94-5b35f1ce1578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:42.642579 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738a576-7fb0-4bd0-8b94-5b35f1ce1578 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:42.646916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1062/2105] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:42.647577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27a80d-b632-484d-bb2e-ed2b25dd653f service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:42.662179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27a80d-b632-484d-bb2e-ed2b25dd653f service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:42.669413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1044/2106] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:42 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:42.670496 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738a576-7fb0-4bd0-8b94-5b35f1ce1578 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:42.671612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68dbce-69ac-496e-9873-95cfd6aea0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:42.672616 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f738a576-7fb0-4bd0-8b94-5b35f1ce1578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:42.675333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68dbce-69ac-496e-9873-95cfd6aea0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.675799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68dbce-69ac-496e-9873-95cfd6aea0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.676207 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68dbce-69ac-496e-9873-95cfd6aea0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.677169 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68dbce-69ac-496e-9873-95cfd6aea0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:42.679256 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68dbce-69ac-496e-9873-95cfd6aea0f7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:42.691867 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738a576-7fb0-4bd0-8b94-5b35f1ce1578 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:42.694597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1063/2107] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:42.695375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68dbce-69ac-496e-9873-95cfd6aea0f7 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:42.701172 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9ca49-2c7e-471e-852a-1953f51ce945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:42.702948 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9ca49-2c7e-471e-852a-1953f51ce945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.703250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9ca49-2c7e-471e-852a-1953f51ce945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.703544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9ca49-2c7e-471e-852a-1953f51ce945 admin admin] PATH_INFO: `/v3/projects/9efb392e5fb84615bec6a79b6713de02` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.705036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9ca49-2c7e-471e-852a-1953f51ce945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9efb392e5fb84615bec6a79b6713de02)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:42.706750 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68dbce-69ac-496e-9873-95cfd6aea0f7 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:42.707015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9ca49-2c7e-471e-852a-1953f51ce945 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:42.712259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94d3a8-e87d-4b15-a360-d8738c2b3413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:42.712931 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94d3a8-e87d-4b15-a360-d8738c2b3413 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.713210 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94d3a8-e87d-4b15-a360-d8738c2b3413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.713523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94d3a8-e87d-4b15-a360-d8738c2b3413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.714695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94d3a8-e87d-4b15-a360-d8738c2b3413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:42.716688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94d3a8-e87d-4b15-a360-d8738c2b3413 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:42.732713 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1064/2108] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:42.732713 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94d3a8-e87d-4b15-a360-d8738c2b3413 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:42.742841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94d3a8-e87d-4b15-a360-d8738c2b3413 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:42.748363 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c50d7f-2b59-4208-94c9-e06198f3990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:42.749140 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c50d7f-2b59-4208-94c9-e06198f3990b admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.749480 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c50d7f-2b59-4208-94c9-e06198f3990b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.749861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c50d7f-2b59-4208-94c9-e06198f3990b admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.750484 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c50d7f-2b59-4208-94c9-e06198f3990b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:42.752237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c50d7f-2b59-4208-94c9-e06198f3990b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:42.761740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f8d9ca49-2c7e-471e-852a-1953f51ce945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9efb392e5fb84615bec6a79b6713de02', 'request_id': 'req-f8d9ca49-2c7e-471e-852a-1953f51ce945'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:42.763791 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1065/2109] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:42.764510 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c50d7f-2b59-4208-94c9-e06198f3990b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:42.773188 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f8d9ca49-2c7e-471e-852a-1953f51ce945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9efb392e5fb84615bec6a79b6713de02', 'request_id': 'req-f8d9ca49-2c7e-471e-852a-1953f51ce945'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:42.774952 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c50d7f-2b59-4208-94c9-e06198f3990b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:42.780004 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f8d9ca49-2c7e-471e-852a-1953f51ce945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9efb392e5fb84615bec6a79b6713de02', 'request_id': 'req-f8d9ca49-2c7e-471e-852a-1953f51ce945'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:42.794890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f8d9ca49-2c7e-471e-852a-1953f51ce945 admin admin] The token cache is being invalidate because project 9efb392e5fb84615bec6a79b6713de02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:42.795191 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f8d9ca49-2c7e-471e-852a-1953f51ce945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:42.795910 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f8d9ca49-2c7e-471e-852a-1953f51ce945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:42.801948 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1045/2110] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:42 2022] DELETE /identity/v3/projects/9efb392e5fb84615bec6a79b6713de02 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:42.801948 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9ca49-2c7e-471e-852a-1953f51ce945 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:42.801948 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f8d9ca49-2c7e-471e-852a-1953f51ce945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:42.841270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7ef06-a8ff-4f27-89d8-446130747ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:42.842179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7ef06-a8ff-4f27-89d8-446130747ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.842584 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7ef06-a8ff-4f27-89d8-446130747ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.842926 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7ef06-a8ff-4f27-89d8-446130747ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.843810 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7ef06-a8ff-4f27-89d8-446130747ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:42.845632 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7ef06-a8ff-4f27-89d8-446130747ac5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:42.860338 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1066/2111] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:42.860338 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7ef06-a8ff-4f27-89d8-446130747ac5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:42.862113 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-93d7ef06-a8ff-4f27-89d8-446130747ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:42.866886 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9ca49-2c7e-471e-852a-1953f51ce945 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:42.870748 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13188058-f620-4293-b9a4-2f3dbb84c3c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:42.871393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13188058-f620-4293-b9a4-2f3dbb84c3c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.871701 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13188058-f620-4293-b9a4-2f3dbb84c3c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.871944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13188058-f620-4293-b9a4-2f3dbb84c3c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.874339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-13188058-f620-4293-b9a4-2f3dbb84c3c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:42.875572 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7ef06-a8ff-4f27-89d8-446130747ac5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:42.881139 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff3bca-8a9d-49af-8073-f5bdb8bc1caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:42.882158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff3bca-8a9d-49af-8073-f5bdb8bc1caf admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:42.882495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff3bca-8a9d-49af-8073-f5bdb8bc1caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:42.882878 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff3bca-8a9d-49af-8073-f5bdb8bc1caf admin admin] PATH_INFO: `/v3/projects/f4a4aa85d40d48de9dda8258716a0f69/users/98a9e6fe4aa84bf5a7c80ad13d44f1c1/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:42.885309 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff3bca-8a9d-49af-8073-f5bdb8bc1caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a4aa85d40d48de9dda8258716a0f69, user_id=98a9e6fe4aa84bf5a7c80ad13d44f1c1, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:42.888173 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff3bca-8a9d-49af-8073-f5bdb8bc1caf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:42.901132 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1067/2112] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:42 2022] PUT /identity/v3/projects/f4a4aa85d40d48de9dda8258716a0f69/users/98a9e6fe4aa84bf5a7c80ad13d44f1c1/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:42.905140 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff3bca-8a9d-49af-8073-f5bdb8bc1caf admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:42.905140 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6aff3bca-8a9d-49af-8073-f5bdb8bc1caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:42.915000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:42.975476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13188058-f620-4293-b9a4-2f3dbb84c3c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:42.978445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13188058-f620-4293-b9a4-2f3dbb84c3c0 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:43.002126 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1046/2113] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:43.004087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a562029-ea06-4901-8bf9-d24ca2088365 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.004473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a562029-ea06-4901-8bf9-d24ca2088365 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.004962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a562029-ea06-4901-8bf9-d24ca2088365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.016489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff3bca-8a9d-49af-8073-f5bdb8bc1caf admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:43.026431 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-3a562029-ea06-4901-8bf9-d24ca2088365 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:43.028013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3a562029-ea06-4901-8bf9-d24ca2088365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:43.031770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafafb3f-4986-4f68-ac68-6e656628e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:43.033096 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafafb3f-4986-4f68-ac68-6e656628e3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.033579 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafafb3f-4986-4f68-ac68-6e656628e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.033717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafafb3f-4986-4f68-ac68-6e656628e3e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.034446 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafafb3f-4986-4f68-ac68-6e656628e3e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:43.046695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafafb3f-4986-4f68-ac68-6e656628e3e1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:43.048412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:43.060362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1047/2114] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:43.062788 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a562029-ea06-4901-8bf9-d24ca2088365 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:43.065767 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3a562029-ea06-4901-8bf9-d24ca2088365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:43.073737 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1068/2115] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:43.075940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafafb3f-4986-4f68-ac68-6e656628e3e1 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:43.080239 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cafafb3f-4986-4f68-ac68-6e656628e3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:43.100512 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a562029-ea06-4901-8bf9-d24ca2088365 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:43.109240 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafafb3f-4986-4f68-ac68-6e656628e3e1 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:43.115196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b525f-b471-4e5c-b128-dac3a860a7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:43.116111 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b525f-b471-4e5c-b128-dac3a860a7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.116480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b525f-b471-4e5c-b128-dac3a860a7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.116663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b525f-b471-4e5c-b128-dac3a860a7e5 admin admin] PATH_INFO: `/v3/projects/ef23c93ed3e3457eab50e12c4260feaf/users/33d4efb515524324a8442438b3a9c7aa/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.118061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3baa9-15ab-4807-9d66-ee6c8666fbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:43.119033 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3baa9-15ab-4807-9d66-ee6c8666fbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.119284 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3baa9-15ab-4807-9d66-ee6c8666fbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.119553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3baa9-15ab-4807-9d66-ee6c8666fbba admin admin] PATH_INFO: `/v3/users/13911c17df364b38a051cb223d400e6f` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.121212 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3baa9-15ab-4807-9d66-ee6c8666fbba admin admin] RBAC: Authorizing `identity:delete_user(user_id=13911c17df364b38a051cb223d400e6f)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:43.123169 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3baa9-15ab-4807-9d66-ee6c8666fbba admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:43.143223 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b525f-b471-4e5c-b128-dac3a860a7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef23c93ed3e3457eab50e12c4260feaf, user_id=33d4efb515524324a8442438b3a9c7aa, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:43.148970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b525f-b471-4e5c-b128-dac3a860a7e5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:43.186783 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-36a3baa9-15ab-4807-9d66-ee6c8666fbba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13911c17df364b38a051cb223d400e6f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:43.198001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1048/2116] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:43 2022] PUT /identity/v3/projects/ef23c93ed3e3457eab50e12c4260feaf/users/33d4efb515524324a8442438b3a9c7aa/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:43.198001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f5e7c-6514-49b0-9973-199c85388e6e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.198001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f5e7c-6514-49b0-9973-199c85388e6e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.198001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f5e7c-6514-49b0-9973-199c85388e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.203721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-36a3baa9-15ab-4807-9d66-ee6c8666fbba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13911c17df364b38a051cb223d400e6f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:43.204750 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-36a3baa9-15ab-4807-9d66-ee6c8666fbba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13911c17df364b38a051cb223d400e6f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:43.205648 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-36a3baa9-15ab-4807-9d66-ee6c8666fbba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13911c17df364b38a051cb223d400e6f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:43.221479 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-36a3baa9-15ab-4807-9d66-ee6c8666fbba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13911c17df364b38a051cb223d400e6f'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:43.224997 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-426f5e7c-6514-49b0-9973-199c85388e6e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:43.226367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-426f5e7c-6514-49b0-9973-199c85388e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:43.236313 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1069/2117] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:43 2022] DELETE /identity/v3/users/13911c17df364b38a051cb223d400e6f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:43.239822 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3baa9-15ab-4807-9d66-ee6c8666fbba admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:43.241397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-36a3baa9-15ab-4807-9d66-ee6c8666fbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:43.318342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1049/2118] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:43.320332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f1bd5-f6c5-4d75-be67-73613179421c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.320332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f1bd5-f6c5-4d75-be67-73613179421c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.320332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f1bd5-f6c5-4d75-be67-73613179421c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.342028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3baa9-15ab-4807-9d66-ee6c8666fbba admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:43.345860 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-682f1bd5-f6c5-4d75-be67-73613179421c None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:43.347181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-682f1bd5-f6c5-4d75-be67-73613179421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:43.348310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e648a-a922-4b98-81c9-9cc0d5c61c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:43.349380 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e648a-a922-4b98-81c9-9cc0d5c61c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.349861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e648a-a922-4b98-81c9-9cc0d5c61c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.350230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e648a-a922-4b98-81c9-9cc0d5c61c23 admin admin] PATH_INFO: `/v3/projects/90d74e330c8a417493b38d5ae2f0238a/users/6b3ffed5d6784828b5a3383994e49122/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.360624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1050/2119] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:43.362412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe858abe-cf2d-46cb-8b0f-ae2ca1ff2169 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.363234 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe858abe-cf2d-46cb-8b0f-ae2ca1ff2169 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.363234 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe858abe-cf2d-46cb-8b0f-ae2ca1ff2169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.378558 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e648a-a922-4b98-81c9-9cc0d5c61c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d74e330c8a417493b38d5ae2f0238a, user_id=6b3ffed5d6784828b5a3383994e49122, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:43.381650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e648a-a922-4b98-81c9-9cc0d5c61c23 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:43.388205 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-fe858abe-cf2d-46cb-8b0f-ae2ca1ff2169 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:43.390563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fe858abe-cf2d-46cb-8b0f-ae2ca1ff2169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:43.403253 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1070/2120] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:43 2022] PUT /identity/v3/projects/90d74e330c8a417493b38d5ae2f0238a/users/6b3ffed5d6784828b5a3383994e49122/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:43.404086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e648a-a922-4b98-81c9-9cc0d5c61c23 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:43.491044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:43.499296 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1051/2121] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:43.500239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe858abe-cf2d-46cb-8b0f-ae2ca1ff2169 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:43.501768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fe858abe-cf2d-46cb-8b0f-ae2ca1ff2169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:43.515434 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e648a-a922-4b98-81c9-9cc0d5c61c23 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:43.523459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268992b-1425-481f-817e-c556a532f291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:43.524171 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268992b-1425-481f-817e-c556a532f291 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.524584 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268992b-1425-481f-817e-c556a532f291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.524928 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268992b-1425-481f-817e-c556a532f291 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.525706 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268992b-1425-481f-817e-c556a532f291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:43.526621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268992b-1425-481f-817e-c556a532f291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:43.529154 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268992b-1425-481f-817e-c556a532f291 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:43.552808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1071/2122] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:43.555267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7338a-7dcc-4948-a048-76d6de8e2a70 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.555796 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7338a-7dcc-4948-a048-76d6de8e2a70 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.556221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7338a-7dcc-4948-a048-76d6de8e2a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.565331 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:43.604121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f6f7338a-7dcc-4948-a048-76d6de8e2a70 None None] MFA Rules not processed for user `6b3ffed5d6784828b5a3383994e49122`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:43.606095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f6f7338a-7dcc-4948-a048-76d6de8e2a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:43.622108 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe858abe-cf2d-46cb-8b0f-ae2ca1ff2169 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:43.627552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5876f-bd20-4d72-be58-bcc99195a1d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:43.628625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5876f-bd20-4d72-be58-bcc99195a1d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.629145 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5876f-bd20-4d72-be58-bcc99195a1d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.629818 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5876f-bd20-4d72-be58-bcc99195a1d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.640593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5876f-bd20-4d72-be58-bcc99195a1d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:43.642756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5876f-bd20-4d72-be58-bcc99195a1d5 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:43.655313 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1052/2123] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:43.656456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5876f-bd20-4d72-be58-bcc99195a1d5 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:43.666222 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5876f-bd20-4d72-be58-bcc99195a1d5 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:43.671118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1c4c1-b2a2-4441-9146-8bf04fed112d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:43.672532 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c4c1-b2a2-4441-9146-8bf04fed112d service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.672999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c4c1-b2a2-4441-9146-8bf04fed112d service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.673495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c4c1-b2a2-4441-9146-8bf04fed112d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.692576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1c4c1-b2a2-4441-9146-8bf04fed112d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:43.694077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1c4c1-b2a2-4441-9146-8bf04fed112d service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:43.707580 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1072/2124] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:43.709481 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7338a-7dcc-4948-a048-76d6de8e2a70 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:43.713250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1053/2125] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:43.714249 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1c4c1-b2a2-4441-9146-8bf04fed112d service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:43.727578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7338a-7dcc-4948-a048-76d6de8e2a70 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:43.728099 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1c4c1-b2a2-4441-9146-8bf04fed112d service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:43.734762 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782221d-523f-4747-8930-49f60804cd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:43.734946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1545d-0d4e-4037-9c76-692fd67d2f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:43.735432 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782221d-523f-4747-8930-49f60804cd05 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.735614 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1545d-0d4e-4037-9c76-692fd67d2f04 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.735725 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782221d-523f-4747-8930-49f60804cd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.735926 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1545d-0d4e-4037-9c76-692fd67d2f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.736203 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1545d-0d4e-4037-9c76-692fd67d2f04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.737271 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1545d-0d4e-4037-9c76-692fd67d2f04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:43.739527 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1545d-0d4e-4037-9c76-692fd67d2f04 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:43.741773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782221d-523f-4747-8930-49f60804cd05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.743123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782221d-523f-4747-8930-49f60804cd05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:43.748092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782221d-523f-4747-8930-49f60804cd05 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:43.784910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1073/2126] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:43 2022] POST /identity/v3/projects => generated 397 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:43.785581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1054/2127] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:43 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:43.790909 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1545d-0d4e-4037-9c76-692fd67d2f04 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:43.794468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782221d-523f-4747-8930-49f60804cd05 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:43.919637 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782221d-523f-4747-8930-49f60804cd05 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:43.921188 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1545d-0d4e-4037-9c76-692fd67d2f04 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:43.927195 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c741f0a-fcba-49db-ae2b-06a63235d210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:43.928565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c741f0a-fcba-49db-ae2b-06a63235d210 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.929012 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c741f0a-fcba-49db-ae2b-06a63235d210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.929335 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd236506-83ae-4149-a4f5-90b8784aa4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:43.929647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c741f0a-fcba-49db-ae2b-06a63235d210 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.930963 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c741f0a-fcba-49db-ae2b-06a63235d210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:43.931224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd236506-83ae-4149-a4f5-90b8784aa4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.931611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd236506-83ae-4149-a4f5-90b8784aa4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.932151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd236506-83ae-4149-a4f5-90b8784aa4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.933516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd236506-83ae-4149-a4f5-90b8784aa4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:43.935238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c741f0a-fcba-49db-ae2b-06a63235d210 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:43.936548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd236506-83ae-4149-a4f5-90b8784aa4c2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:43.971991 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1055/2128] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:43 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:43.978054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5430b-0080-43fa-a91a-ed532666a264 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:43.978477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5430b-0080-43fa-a91a-ed532666a264 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:43.982241 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5430b-0080-43fa-a91a-ed532666a264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:43.982403 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1074/2129] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:43 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:35:43.982403 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd236506-83ae-4149-a4f5-90b8784aa4c2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:43.997997 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd236506-83ae-4149-a4f5-90b8784aa4c2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:44.004001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c89f3a-1fb2-48ba-8c51-6673a53414be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:44.004962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c89f3a-1fb2-48ba-8c51-6673a53414be admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:44.005440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c89f3a-1fb2-48ba-8c51-6673a53414be admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:44.005974 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c89f3a-1fb2-48ba-8c51-6673a53414be admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:44.006914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c89f3a-1fb2-48ba-8c51-6673a53414be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:44.010049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c89f3a-1fb2-48ba-8c51-6673a53414be admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:44.020897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4cf5430b-0080-43fa-a91a-ed532666a264 None None] MFA Rules not processed for user `98a9e6fe4aa84bf5a7c80ad13d44f1c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:44.023408 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4cf5430b-0080-43fa-a91a-ed532666a264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:44.028482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1075/2130] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:44.033202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c89f3a-1fb2-48ba-8c51-6673a53414be admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:44.045436 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c89f3a-1fb2-48ba-8c51-6673a53414be admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:44.052059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22160a6e-d8e6-47cd-bf0b-75937fbddeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:44.052992 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22160a6e-d8e6-47cd-bf0b-75937fbddeae admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:44.053466 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22160a6e-d8e6-47cd-bf0b-75937fbddeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:44.053884 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22160a6e-d8e6-47cd-bf0b-75937fbddeae admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:44.055197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22160a6e-d8e6-47cd-bf0b-75937fbddeae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:44.056991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22160a6e-d8e6-47cd-bf0b-75937fbddeae admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:44.073518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1076/2131] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:44.074340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22160a6e-d8e6-47cd-bf0b-75937fbddeae admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:44.086404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22160a6e-d8e6-47cd-bf0b-75937fbddeae admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:44.093599 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a269d1-4d25-43b2-a3ce-58d4b644af64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:44.095254 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a269d1-4d25-43b2-a3ce-58d4b644af64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:44.095606 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a269d1-4d25-43b2-a3ce-58d4b644af64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:44.095990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a269d1-4d25-43b2-a3ce-58d4b644af64 admin admin] PATH_INFO: `/v3/projects/43bdc2d9814748f9923336f2d89f6ef4/users/28b81a73e3d24043ae831b00eb0ad500/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:44.121226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a269d1-4d25-43b2-a3ce-58d4b644af64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43bdc2d9814748f9923336f2d89f6ef4, user_id=28b81a73e3d24043ae831b00eb0ad500, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:44.128186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a269d1-4d25-43b2-a3ce-58d4b644af64 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:44.140867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:44.165738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1077/2132] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:44 2022] PUT /identity/v3/projects/43bdc2d9814748f9923336f2d89f6ef4/users/28b81a73e3d24043ae831b00eb0ad500/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:44.168333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a269d1-4d25-43b2-a3ce-58d4b644af64 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:44.238988 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1056/2133] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:43 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:44.241477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5430b-0080-43fa-a91a-ed532666a264 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:44.287160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5430b-0080-43fa-a91a-ed532666a264 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:44.307760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:44.310974 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a269d1-4d25-43b2-a3ce-58d4b644af64 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:44.319591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747a3f3-a614-4967-a650-50d5ec1e2c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:44.321509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747a3f3-a614-4967-a650-50d5ec1e2c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:44.322395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747a3f3-a614-4967-a650-50d5ec1e2c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:44.323068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747a3f3-a614-4967-a650-50d5ec1e2c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:44.325066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747a3f3-a614-4967-a650-50d5ec1e2c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:44.327387 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747a3f3-a614-4967-a650-50d5ec1e2c0b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:44.350153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1078/2134] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:44.352156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0c25e-3971-4bb8-acf0-8833133aa3e4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:44.352686 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0c25e-3971-4bb8-acf0-8833133aa3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:44.353216 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0c25e-3971-4bb8-acf0-8833133aa3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:44.407895 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-82d0c25e-3971-4bb8-acf0-8833133aa3e4 None None] MFA Rules not processed for user `d8dbe8818517441d937d58904037e99d`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:44.409130 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-82d0c25e-3971-4bb8-acf0-8833133aa3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:44.431473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e76af-a58c-4d95-900e-9bf80f288ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:44.432342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e76af-a58c-4d95-900e-9bf80f288ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:44.432623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e76af-a58c-4d95-900e-9bf80f288ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:44.432904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e76af-a58c-4d95-900e-9bf80f288ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:44.435169 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e76af-a58c-4d95-900e-9bf80f288ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:44.436844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e76af-a58c-4d95-900e-9bf80f288ce9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:44.460291 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1057/2135] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:44.462834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e76af-a58c-4d95-900e-9bf80f288ce9 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:44.495280 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e76af-a58c-4d95-900e-9bf80f288ce9 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:44.503611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c7e74-ccca-4db5-8455-12cce0a01ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:44.505553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c7e74-ccca-4db5-8455-12cce0a01ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:44.505910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1079/2136] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:44.506301 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c7e74-ccca-4db5-8455-12cce0a01ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:44.506957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0c25e-3971-4bb8-acf0-8833133aa3e4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:44.507544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c7e74-ccca-4db5-8455-12cce0a01ab8 admin admin] PATH_INFO: `/v3/projects/16aa3bacac424c989ba7872fd175f87d/users/24578c35fb4948468ecbbc62fdfe81cf/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:44.512445 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-82d0c25e-3971-4bb8-acf0-8833133aa3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:44.524797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c7e74-ccca-4db5-8455-12cce0a01ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16aa3bacac424c989ba7872fd175f87d, user_id=24578c35fb4948468ecbbc62fdfe81cf, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:44.527573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c7e74-ccca-4db5-8455-12cce0a01ab8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:44.539787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0c25e-3971-4bb8-acf0-8833133aa3e4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:44.550359 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1058/2137] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:44 2022] PUT /identity/v3/projects/16aa3bacac424c989ba7872fd175f87d/users/24578c35fb4948468ecbbc62fdfe81cf/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:44.551359 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c7e74-ccca-4db5-8455-12cce0a01ab8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:44.649858 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c7e74-ccca-4db5-8455-12cce0a01ab8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:44.651599 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2059e52-1b7a-4441-969c-9a6018f31fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:44.653155 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2059e52-1b7a-4441-969c-9a6018f31fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:44.653567 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2059e52-1b7a-4441-969c-9a6018f31fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:44.654450 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2059e52-1b7a-4441-969c-9a6018f31fbc admin admin] PATH_INFO: `/v3/projects/5c3e5d2c5ca5409f8060ffb0c04f568b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:44.655755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2059e52-1b7a-4441-969c-9a6018f31fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c3e5d2c5ca5409f8060ffb0c04f568b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:44.658148 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2059e52-1b7a-4441-969c-9a6018f31fbc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:44.664704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2f91e-9849-49a6-9390-ab2b8d4b609d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:44.665893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2f91e-9849-49a6-9390-ab2b8d4b609d admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:44.666713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2f91e-9849-49a6-9390-ab2b8d4b609d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:44.666713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2f91e-9849-49a6-9390-ab2b8d4b609d admin admin] PATH_INFO: `/v3/projects/43bdc2d9814748f9923336f2d89f6ef4/users/28b81a73e3d24043ae831b00eb0ad500/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:44.669465 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2f91e-9849-49a6-9390-ab2b8d4b609d admin admin] RBAC: Authorizing `identity:create_grant(project_id=43bdc2d9814748f9923336f2d89f6ef4, user_id=28b81a73e3d24043ae831b00eb0ad500, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:44.672863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2f91e-9849-49a6-9390-ab2b8d4b609d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:44.713594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1059/2138] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:44 2022] PUT /identity/v3/projects/43bdc2d9814748f9923336f2d89f6ef4/users/28b81a73e3d24043ae831b00eb0ad500/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:44.714637 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2f91e-9849-49a6-9390-ab2b8d4b609d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:44.716388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-51d2f91e-9849-49a6-9390-ab2b8d4b609d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:44.745219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:44.761658 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d2059e52-1b7a-4441-969c-9a6018f31fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c3e5d2c5ca5409f8060ffb0c04f568b', 'request_id': 'req-d2059e52-1b7a-4441-969c-9a6018f31fbc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:44.782680 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d2059e52-1b7a-4441-969c-9a6018f31fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c3e5d2c5ca5409f8060ffb0c04f568b', 'request_id': 'req-d2059e52-1b7a-4441-969c-9a6018f31fbc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:44.801948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d2059e52-1b7a-4441-969c-9a6018f31fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c3e5d2c5ca5409f8060ffb0c04f568b', 'request_id': 'req-d2059e52-1b7a-4441-969c-9a6018f31fbc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:44.829375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d2059e52-1b7a-4441-969c-9a6018f31fbc admin admin] The token cache is being invalidate because project 5c3e5d2c5ca5409f8060ffb0c04f568b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:44.830055 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d2059e52-1b7a-4441-969c-9a6018f31fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:44.832620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d2059e52-1b7a-4441-969c-9a6018f31fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:44.839704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1080/2139] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:44 2022] DELETE /identity/v3/projects/5c3e5d2c5ca5409f8060ffb0c04f568b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:44.839875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca331a-e6d8-49a9-bbe2-d0409a70ec57 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:44.840396 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca331a-e6d8-49a9-bbe2-d0409a70ec57 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:44.840523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca331a-e6d8-49a9-bbe2-d0409a70ec57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:44.905882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b1ca331a-e6d8-49a9-bbe2-d0409a70ec57 None None] MFA Rules not processed for user `24578c35fb4948468ecbbc62fdfe81cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:44.907103 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b1ca331a-e6d8-49a9-bbe2-d0409a70ec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:44.909183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2f91e-9849-49a6-9390-ab2b8d4b609d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:44.934709 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:45.089774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1081/2140] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:45.090010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a3036-cd1e-40dd-9932-41db550fc619 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:45.090305 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a3036-cd1e-40dd-9932-41db550fc619 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:45.090589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a3036-cd1e-40dd-9932-41db550fc619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:45.092582 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5162e06-166c-441c-8a45-0f0fc499a5ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:45.093419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5162e06-166c-441c-8a45-0f0fc499a5ce service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:45.093514 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5162e06-166c-441c-8a45-0f0fc499a5ce service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:45.093790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5162e06-166c-441c-8a45-0f0fc499a5ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:45.098356 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f5162e06-166c-441c-8a45-0f0fc499a5ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:45.147709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a56a3036-cd1e-40dd-9932-41db550fc619 None None] MFA Rules not processed for user `28b81a73e3d24043ae831b00eb0ad500`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:45.149109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a56a3036-cd1e-40dd-9932-41db550fc619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:45.217163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5162e06-166c-441c-8a45-0f0fc499a5ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:45.221617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5162e06-166c-441c-8a45-0f0fc499a5ce service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:45.240013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1060/2141] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:45.243969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4258e-c47c-46a2-bffc-1c4560c15a1b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:45.244450 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4258e-c47c-46a2-bffc-1c4560c15a1b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:45.244969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4258e-c47c-46a2-bffc-1c4560c15a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:45.272825 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-67e4258e-c47c-46a2-bffc-1c4560c15a1b None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:45.274885 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-67e4258e-c47c-46a2-bffc-1c4560c15a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:45.316105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1082/2142] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:45.321708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a3036-cd1e-40dd-9932-41db550fc619 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:45.323647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a56a3036-cd1e-40dd-9932-41db550fc619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:45.388249 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1061/2143] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:45.390314 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4258e-c47c-46a2-bffc-1c4560c15a1b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:45.397209 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-67e4258e-c47c-46a2-bffc-1c4560c15a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:45.406269 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:45.432437 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4258e-c47c-46a2-bffc-1c4560c15a1b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:45.440306 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba0151-9d0c-41aa-b950-b4261f3bb321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:45.442306 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba0151-9d0c-41aa-b950-b4261f3bb321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:45.442824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba0151-9d0c-41aa-b950-b4261f3bb321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:45.443342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba0151-9d0c-41aa-b950-b4261f3bb321 admin admin] PATH_INFO: `/v3/users/d3f0571a305f48a6b223cc800255ced6` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:45.444316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a3036-cd1e-40dd-9932-41db550fc619 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:45.445709 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba0151-9d0c-41aa-b950-b4261f3bb321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f0571a305f48a6b223cc800255ced6)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:45.448631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba0151-9d0c-41aa-b950-b4261f3bb321 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:45.450950 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc80b0-264a-440d-80fb-18ae2e2c98ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:45.451636 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc80b0-264a-440d-80fb-18ae2e2c98ab admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:45.451925 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc80b0-264a-440d-80fb-18ae2e2c98ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:45.452420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc80b0-264a-440d-80fb-18ae2e2c98ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:45.453749 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc80b0-264a-440d-80fb-18ae2e2c98ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:45.455886 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacc80b0-264a-440d-80fb-18ae2e2c98ab admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:45.503714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1083/2144] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:45 2022] POST /identity/v3/projects => generated 399 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:45.504898 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc80b0-264a-440d-80fb-18ae2e2c98ab admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:45.507125 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-eacc80b0-264a-440d-80fb-18ae2e2c98ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:45.518223 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-31ba0151-9d0c-41aa-b950-b4261f3bb321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f0571a305f48a6b223cc800255ced6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:45.527488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:45.546180 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-31ba0151-9d0c-41aa-b950-b4261f3bb321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f0571a305f48a6b223cc800255ced6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:45.547878 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-31ba0151-9d0c-41aa-b950-b4261f3bb321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f0571a305f48a6b223cc800255ced6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:45.548913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-31ba0151-9d0c-41aa-b950-b4261f3bb321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f0571a305f48a6b223cc800255ced6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:45.578670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-31ba0151-9d0c-41aa-b950-b4261f3bb321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f0571a305f48a6b223cc800255ced6'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:45.615094 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1062/2145] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:45 2022] DELETE /identity/v3/users/d3f0571a305f48a6b223cc800255ced6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:45.616881 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de28bc-ed8a-4e49-9755-c48b0ac957bc None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:45.617491 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de28bc-ed8a-4e49-9755-c48b0ac957bc None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:45.618006 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de28bc-ed8a-4e49-9755-c48b0ac957bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:45.625977 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc80b0-264a-440d-80fb-18ae2e2c98ab admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:45.657929 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-87de28bc-ed8a-4e49-9755-c48b0ac957bc None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:45.659887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-87de28bc-ed8a-4e49-9755-c48b0ac957bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:45.681432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce9f28-9b86-4ad3-bfce-c53358c24de8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:45.682308 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9f28-9b86-4ad3-bfce-c53358c24de8 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:45.682601 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9f28-9b86-4ad3-bfce-c53358c24de8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:45.682923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce9f28-9b86-4ad3-bfce-c53358c24de8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:45.685322 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-80ce9f28-9b86-4ad3-bfce-c53358c24de8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:45.796984 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1063/2146] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:45.797279 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce9f28-9b86-4ad3-bfce-c53358c24de8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:45.798849 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce9f28-9b86-4ad3-bfce-c53358c24de8 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:45.803240 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de28bc-ed8a-4e49-9755-c48b0ac957bc None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:45.806247 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-87de28bc-ed8a-4e49-9755-c48b0ac957bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:45.808903 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1084/2147] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:45.810432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dc8d2-36cf-4930-95e5-85eb707ba4bd None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:45.810733 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dc8d2-36cf-4930-95e5-85eb707ba4bd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:45.811014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dc8d2-36cf-4930-95e5-85eb707ba4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:45.835522 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de28bc-ed8a-4e49-9755-c48b0ac957bc None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:45.839385 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-687dc8d2-36cf-4930-95e5-85eb707ba4bd None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:45.841007 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-687dc8d2-36cf-4930-95e5-85eb707ba4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:45.846063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca31a1d-e823-40ec-a2dc-d7ff3fd179f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:45.846839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca31a1d-e823-40ec-a2dc-d7ff3fd179f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:45.847199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca31a1d-e823-40ec-a2dc-d7ff3fd179f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:45.847560 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca31a1d-e823-40ec-a2dc-d7ff3fd179f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:45.848462 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca31a1d-e823-40ec-a2dc-d7ff3fd179f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:45.850514 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca31a1d-e823-40ec-a2dc-d7ff3fd179f5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:45.864431 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1085/2148] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:45.865438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dc8d2-36cf-4930-95e5-85eb707ba4bd None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:45.895989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dc8d2-36cf-4930-95e5-85eb707ba4bd None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:45.911800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1064/2149] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:45 2022] POST /identity/v3/users => generated 306 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:45.911800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca31a1d-e823-40ec-a2dc-d7ff3fd179f5 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:45.911800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2ca31a1d-e823-40ec-a2dc-d7ff3fd179f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:45.919658 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b08fc-5fda-463c-a38a-ce7bc203df15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:45.920338 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b08fc-5fda-463c-a38a-ce7bc203df15 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:45.920681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b08fc-5fda-463c-a38a-ce7bc203df15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:45.920969 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b08fc-5fda-463c-a38a-ce7bc203df15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:45.921918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b08fc-5fda-463c-a38a-ce7bc203df15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:45.922314 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b08fc-5fda-463c-a38a-ce7bc203df15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:45.929835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b08fc-5fda-463c-a38a-ce7bc203df15 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:45.956148 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1086/2150] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:45.965735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b08fc-5fda-463c-a38a-ce7bc203df15 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:45.991381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b08fc-5fda-463c-a38a-ce7bc203df15 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:46.004031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9663857-5410-4acf-96c9-1a57d8fa797e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:46.004461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9663857-5410-4acf-96c9-1a57d8fa797e admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:46.005039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9663857-5410-4acf-96c9-1a57d8fa797e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:46.005374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9663857-5410-4acf-96c9-1a57d8fa797e admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:46.006108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9663857-5410-4acf-96c9-1a57d8fa797e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:46.009470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9663857-5410-4acf-96c9-1a57d8fa797e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:46.013465 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca31a1d-e823-40ec-a2dc-d7ff3fd179f5 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:46.023318 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab97399-8001-445f-9c9d-d9a4a239413f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:46.023874 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab97399-8001-445f-9c9d-d9a4a239413f service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:46.024156 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab97399-8001-445f-9c9d-d9a4a239413f service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:46.024418 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab97399-8001-445f-9c9d-d9a4a239413f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:46.038388 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1087/2151] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:46.044019 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9663857-5410-4acf-96c9-1a57d8fa797e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:46.067223 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab97399-8001-445f-9c9d-d9a4a239413f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:46.074179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab97399-8001-445f-9c9d-d9a4a239413f service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:46.090659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9663857-5410-4acf-96c9-1a57d8fa797e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:46.097316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac39d71-4e29-467c-a4b2-b0910bb32300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:46.098105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac39d71-4e29-467c-a4b2-b0910bb32300 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:46.099639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac39d71-4e29-467c-a4b2-b0910bb32300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:46.099941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac39d71-4e29-467c-a4b2-b0910bb32300 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:46.100678 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac39d71-4e29-467c-a4b2-b0910bb32300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:46.102718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac39d71-4e29-467c-a4b2-b0910bb32300 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:46.105236 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1065/2152] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:46.106767 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab97399-8001-445f-9c9d-d9a4a239413f service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:46.108251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:46.139295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab97399-8001-445f-9c9d-d9a4a239413f service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:46.149240 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97cf26-f3dd-4d0e-905e-99d92ed34a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:46.155088 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97cf26-f3dd-4d0e-905e-99d92ed34a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:46.155510 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97cf26-f3dd-4d0e-905e-99d92ed34a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:46.155805 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97cf26-f3dd-4d0e-905e-99d92ed34a5e admin admin] PATH_INFO: `/v3/projects/90c2dea428e240119d1c18c77daa1dbb/users/8529ed83a0164cbeb8b8bcf440208f21/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:46.165099 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1088/2153] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:46 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:46.169250 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac39d71-4e29-467c-a4b2-b0910bb32300 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:46.206566 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97cf26-f3dd-4d0e-905e-99d92ed34a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c2dea428e240119d1c18c77daa1dbb, user_id=8529ed83a0164cbeb8b8bcf440208f21, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:46.209382 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97cf26-f3dd-4d0e-905e-99d92ed34a5e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:46.232175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1066/2154] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:46 2022] PUT /identity/v3/projects/90c2dea428e240119d1c18c77daa1dbb/users/8529ed83a0164cbeb8b8bcf440208f21/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:46.236477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97cf26-f3dd-4d0e-905e-99d92ed34a5e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:46.275219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac39d71-4e29-467c-a4b2-b0910bb32300 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:46.320791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:46.391376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97cf26-f3dd-4d0e-905e-99d92ed34a5e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:46.406273 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ba137-9e00-4e53-9fa6-96d8cd55b646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:46.406979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ba137-9e00-4e53-9fa6-96d8cd55b646 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:46.407266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ba137-9e00-4e53-9fa6-96d8cd55b646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:46.407544 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ba137-9e00-4e53-9fa6-96d8cd55b646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:46.408297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ba137-9e00-4e53-9fa6-96d8cd55b646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:46.410060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ba137-9e00-4e53-9fa6-96d8cd55b646 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:46.428848 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1067/2155] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:46.433116 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ba137-9e00-4e53-9fa6-96d8cd55b646 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:46.438704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e187946-e665-4d53-8f8d-625dc04af5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:46.440929 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e187946-e665-4d53-8f8d-625dc04af5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:46.454046 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ba137-9e00-4e53-9fa6-96d8cd55b646 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:46.455610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e187946-e665-4d53-8f8d-625dc04af5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:46.455907 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e187946-e665-4d53-8f8d-625dc04af5e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:46.458396 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e187946-e665-4d53-8f8d-625dc04af5e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:46.458742 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e187946-e665-4d53-8f8d-625dc04af5e2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:46.469493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a92a4e-735e-4429-9d5f-204589b2e165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:46.470608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a92a4e-735e-4429-9d5f-204589b2e165 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:46.470608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a92a4e-735e-4429-9d5f-204589b2e165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:46.470830 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a92a4e-735e-4429-9d5f-204589b2e165 admin admin] PATH_INFO: `/v3/projects/90c2dea428e240119d1c18c77daa1dbb/users/8529ed83a0164cbeb8b8bcf440208f21/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:46.482988 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a92a4e-735e-4429-9d5f-204589b2e165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c2dea428e240119d1c18c77daa1dbb, user_id=8529ed83a0164cbeb8b8bcf440208f21, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:46.485706 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a92a4e-735e-4429-9d5f-204589b2e165 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:46.509244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1068/2156] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:46 2022] PUT /identity/v3/projects/90c2dea428e240119d1c18c77daa1dbb/users/8529ed83a0164cbeb8b8bcf440208f21/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:46.519577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca065e-3b67-4a0b-90b6-184d823569d6 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:46.519856 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca065e-3b67-4a0b-90b6-184d823569d6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:46.520148 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca065e-3b67-4a0b-90b6-184d823569d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:46.532315 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1089/2157] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:46 2022] POST /identity/v3/users => generated 289 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:35:46.539058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e187946-e665-4d53-8f8d-625dc04af5e2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:46.567193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e187946-e665-4d53-8f8d-625dc04af5e2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:46.598993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-94ca065e-3b67-4a0b-90b6-184d823569d6 None None] MFA Rules not processed for user `8529ed83a0164cbeb8b8bcf440208f21`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:46.600164 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-94ca065e-3b67-4a0b-90b6-184d823569d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:46.709083 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de47cd3-bf8a-4786-86d2-a7b0e5320a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:46.709770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de47cd3-bf8a-4786-86d2-a7b0e5320a57 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:46.710060 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de47cd3-bf8a-4786-86d2-a7b0e5320a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:46.710341 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de47cd3-bf8a-4786-86d2-a7b0e5320a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:46.711082 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de47cd3-bf8a-4786-86d2-a7b0e5320a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:46.712718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de47cd3-bf8a-4786-86d2-a7b0e5320a57 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:46.741902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1090/2158] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:46.742763 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de47cd3-bf8a-4786-86d2-a7b0e5320a57 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:46.746419 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7de47cd3-bf8a-4786-86d2-a7b0e5320a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:46.774781 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1069/2159] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:46 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:35:46.775691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca065e-3b67-4a0b-90b6-184d823569d6 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:46.785944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de47cd3-bf8a-4786-86d2-a7b0e5320a57 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:46.795986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5919f4-32d1-47a1-a9f7-25ffcd4ca55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:46.796904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5919f4-32d1-47a1-a9f7-25ffcd4ca55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:46.797188 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5919f4-32d1-47a1-a9f7-25ffcd4ca55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:46.797500 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5919f4-32d1-47a1-a9f7-25ffcd4ca55a admin admin] PATH_INFO: `/v3/users/bcec12c9da8c4c01bfb2a4f8c27c8c20` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:46.803999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5919f4-32d1-47a1-a9f7-25ffcd4ca55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcec12c9da8c4c01bfb2a4f8c27c8c20)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:46.805798 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5919f4-32d1-47a1-a9f7-25ffcd4ca55a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:46.815092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca065e-3b67-4a0b-90b6-184d823569d6 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:46.830156 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067270aa-8273-4145-a79d-bce8ad76c627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:46.831065 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067270aa-8273-4145-a79d-bce8ad76c627 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:46.831209 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067270aa-8273-4145-a79d-bce8ad76c627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:46.831496 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067270aa-8273-4145-a79d-bce8ad76c627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:46.832244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067270aa-8273-4145-a79d-bce8ad76c627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:46.833327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:46.833930 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067270aa-8273-4145-a79d-bce8ad76c627 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:46.864832 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1070/2160] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:46.865834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067270aa-8273-4145-a79d-bce8ad76c627 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:46.872845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-067270aa-8273-4145-a79d-bce8ad76c627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:46.916659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ae5919f4-32d1-47a1-a9f7-25ffcd4ca55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcec12c9da8c4c01bfb2a4f8c27c8c20'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:46.932830 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ae5919f4-32d1-47a1-a9f7-25ffcd4ca55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcec12c9da8c4c01bfb2a4f8c27c8c20'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:46.933973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ae5919f4-32d1-47a1-a9f7-25ffcd4ca55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcec12c9da8c4c01bfb2a4f8c27c8c20'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:46.934673 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ae5919f4-32d1-47a1-a9f7-25ffcd4ca55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcec12c9da8c4c01bfb2a4f8c27c8c20'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:46.968279 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ae5919f4-32d1-47a1-a9f7-25ffcd4ca55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcec12c9da8c4c01bfb2a4f8c27c8c20'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:46.997416 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1091/2161] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:46 2022] DELETE /identity/v3/users/bcec12c9da8c4c01bfb2a4f8c27c8c20 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:46.998274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5919f4-32d1-47a1-a9f7-25ffcd4ca55a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:47.007165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ae5919f4-32d1-47a1-a9f7-25ffcd4ca55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:47.007580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067270aa-8273-4145-a79d-bce8ad76c627 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:47.091871 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:47.114085 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2a8b8-1942-4153-a043-c10be9213b09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:47.115043 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2a8b8-1942-4153-a043-c10be9213b09 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:47.115235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2a8b8-1942-4153-a043-c10be9213b09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:47.115520 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2a8b8-1942-4153-a043-c10be9213b09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:47.117569 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-28b2a8b8-1942-4153-a043-c10be9213b09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:47.216086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2a8b8-1942-4153-a043-c10be9213b09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:47.218019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2a8b8-1942-4153-a043-c10be9213b09 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:47.219288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5919f4-32d1-47a1-a9f7-25ffcd4ca55a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:47.225101 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3333c-fa6c-43f1-b86e-d3d7edd13649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:47.226536 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3333c-fa6c-43f1-b86e-d3d7edd13649 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:47.227097 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3333c-fa6c-43f1-b86e-d3d7edd13649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:47.227545 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3333c-fa6c-43f1-b86e-d3d7edd13649 admin admin] PATH_INFO: `/v3/projects/071e382339a842baa6493bbd46c26603/users/311b2854dde34d28a8d0863f24e97cbe/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:47.232628 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1071/2162] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:46 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:47.234892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdd135-f13f-4440-b3ae-ef562ddde575 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:47.234892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdd135-f13f-4440-b3ae-ef562ddde575 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:47.235682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdd135-f13f-4440-b3ae-ef562ddde575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:47.258994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d7cdd135-f13f-4440-b3ae-ef562ddde575 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:47.260847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d7cdd135-f13f-4440-b3ae-ef562ddde575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:47.284288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3333c-fa6c-43f1-b86e-d3d7edd13649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=071e382339a842baa6493bbd46c26603, user_id=311b2854dde34d28a8d0863f24e97cbe, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:47.289051 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3333c-fa6c-43f1-b86e-d3d7edd13649 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:47.310689 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1072/2163] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:47.314262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdd135-f13f-4440-b3ae-ef562ddde575 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:47.320739 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d7cdd135-f13f-4440-b3ae-ef562ddde575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:47.322552 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1092/2164] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:46 2022] PUT /identity/v3/projects/071e382339a842baa6493bbd46c26603/users/311b2854dde34d28a8d0863f24e97cbe/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:47.342963 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3333c-fa6c-43f1-b86e-d3d7edd13649 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:47.348690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-48e3333c-fa6c-43f1-b86e-d3d7edd13649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:47.356341 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdd135-f13f-4440-b3ae-ef562ddde575 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:47.476226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3333c-fa6c-43f1-b86e-d3d7edd13649 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:47.487749 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10a89a-bbf8-449c-815a-0c69bc6eae67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:47.490018 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10a89a-bbf8-449c-815a-0c69bc6eae67 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:47.490018 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10a89a-bbf8-449c-815a-0c69bc6eae67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:47.490018 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10a89a-bbf8-449c-815a-0c69bc6eae67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:47.499848 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edda65f-cc2e-41bb-bfae-c2aa562a4fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:47.500996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edda65f-cc2e-41bb-bfae-c2aa562a4fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:47.501331 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edda65f-cc2e-41bb-bfae-c2aa562a4fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:47.501652 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edda65f-cc2e-41bb-bfae-c2aa562a4fb8 admin admin] PATH_INFO: `/v3/projects/11b2dd4b7fe941f083b3da861c87210c` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:47.503141 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edda65f-cc2e-41bb-bfae-c2aa562a4fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b2dd4b7fe941f083b3da861c87210c)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:47.505235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edda65f-cc2e-41bb-bfae-c2aa562a4fb8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:47.558787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:47.609310 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2edda65f-cc2e-41bb-bfae-c2aa562a4fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b2dd4b7fe941f083b3da861c87210c', 'request_id': 'req-2edda65f-cc2e-41bb-bfae-c2aa562a4fb8'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:47.628857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2edda65f-cc2e-41bb-bfae-c2aa562a4fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b2dd4b7fe941f083b3da861c87210c', 'request_id': 'req-2edda65f-cc2e-41bb-bfae-c2aa562a4fb8'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:47.643987 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2edda65f-cc2e-41bb-bfae-c2aa562a4fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b2dd4b7fe941f083b3da861c87210c', 'request_id': 'req-2edda65f-cc2e-41bb-bfae-c2aa562a4fb8'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:47.670187 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10a89a-bbf8-449c-815a-0c69bc6eae67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:47.673121 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2edda65f-cc2e-41bb-bfae-c2aa562a4fb8 admin admin] The token cache is being invalidate because project 11b2dd4b7fe941f083b3da861c87210c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:47.673442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2edda65f-cc2e-41bb-bfae-c2aa562a4fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:47.673664 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10a89a-bbf8-449c-815a-0c69bc6eae67 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:47.677325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2edda65f-cc2e-41bb-bfae-c2aa562a4fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:47.678925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1073/2165] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:47 2022] DELETE /identity/v3/projects/11b2dd4b7fe941f083b3da861c87210c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:47.680247 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398cdef-b9f2-47b7-ba77-777e5a7f15a8 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:47.680477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398cdef-b9f2-47b7-ba77-777e5a7f15a8 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:47.680763 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398cdef-b9f2-47b7-ba77-777e5a7f15a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:47.696787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1093/2166] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:47.699016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10a89a-bbf8-449c-815a-0c69bc6eae67 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:47.700733 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7a10a89a-bbf8-449c-815a-0c69bc6eae67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:47.751693 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1398cdef-b9f2-47b7-ba77-777e5a7f15a8 None None] MFA Rules not processed for user `311b2854dde34d28a8d0863f24e97cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:47.753170 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1398cdef-b9f2-47b7-ba77-777e5a7f15a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:47.759958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:47.864591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10a89a-bbf8-449c-815a-0c69bc6eae67 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:47.924013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1074/2167] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:47.924895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398cdef-b9f2-47b7-ba77-777e5a7f15a8 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:47.926265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1398cdef-b9f2-47b7-ba77-777e5a7f15a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:47.952807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70e1e8-6d72-480e-806a-f1080b0c8ab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:47.954040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70e1e8-6d72-480e-806a-f1080b0c8ab7 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:47.954466 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70e1e8-6d72-480e-806a-f1080b0c8ab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:47.954833 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70e1e8-6d72-480e-806a-f1080b0c8ab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:47.958342 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7c70e1e8-6d72-480e-806a-f1080b0c8ab7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:48.052577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398cdef-b9f2-47b7-ba77-777e5a7f15a8 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:48.059580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791fd2f-b34f-4362-965e-b04d564114d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:48.060520 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791fd2f-b34f-4362-965e-b04d564114d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:48.060808 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791fd2f-b34f-4362-965e-b04d564114d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:48.061090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791fd2f-b34f-4362-965e-b04d564114d0 admin admin] PATH_INFO: `/v3/users/62a514ae61794341a6d317cda430448e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:48.075762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70e1e8-6d72-480e-806a-f1080b0c8ab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:48.077396 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70e1e8-6d72-480e-806a-f1080b0c8ab7 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:48.078427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791fd2f-b34f-4362-965e-b04d564114d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a514ae61794341a6d317cda430448e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:48.080542 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b791fd2f-b34f-4362-965e-b04d564114d0 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:48.091368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1094/2168] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:48.092507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70e1e8-6d72-480e-806a-f1080b0c8ab7 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:48.093969 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7c70e1e8-6d72-480e-806a-f1080b0c8ab7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:48.140037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70e1e8-6d72-480e-806a-f1080b0c8ab7 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:48.184142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef02824-b54e-4a7d-b513-77d1eaa64553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:48.184947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef02824-b54e-4a7d-b513-77d1eaa64553 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:48.185233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef02824-b54e-4a7d-b513-77d1eaa64553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:48.185554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef02824-b54e-4a7d-b513-77d1eaa64553 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:48.186878 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef02824-b54e-4a7d-b513-77d1eaa64553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:48.188992 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef02824-b54e-4a7d-b513-77d1eaa64553 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:48.214239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b791fd2f-b34f-4362-965e-b04d564114d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a514ae61794341a6d317cda430448e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:48.227751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b791fd2f-b34f-4362-965e-b04d564114d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a514ae61794341a6d317cda430448e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:48.228493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b791fd2f-b34f-4362-965e-b04d564114d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a514ae61794341a6d317cda430448e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:48.229241 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b791fd2f-b34f-4362-965e-b04d564114d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a514ae61794341a6d317cda430448e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:48.258366 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-b791fd2f-b34f-4362-965e-b04d564114d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a514ae61794341a6d317cda430448e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:48.289986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1095/2169] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:48 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:48.290429 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1075/2170] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:47 2022] DELETE /identity/v3/users/62a514ae61794341a6d317cda430448e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:48.290517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef02824-b54e-4a7d-b513-77d1eaa64553 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:48.292361 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7ef02824-b54e-4a7d-b513-77d1eaa64553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:48.297124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791fd2f-b34f-4362-965e-b04d564114d0 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:48.301401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b791fd2f-b34f-4362-965e-b04d564114d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:48.310144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:48.391012 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef02824-b54e-4a7d-b513-77d1eaa64553 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:48.416365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:48.514872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791fd2f-b34f-4362-965e-b04d564114d0 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:48.531920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b246e-6837-4ac2-889e-371b8f210cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:48.535106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b246e-6837-4ac2-889e-371b8f210cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:48.540305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b246e-6837-4ac2-889e-371b8f210cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:48.541385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b246e-6837-4ac2-889e-371b8f210cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:48.544061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b246e-6837-4ac2-889e-371b8f210cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:48.549060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b246e-6837-4ac2-889e-371b8f210cc5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:48.577448 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:48.579213 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:48.579647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:48.580055 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e admin admin] PATH_INFO: `/v3/projects/b6159667417f409f930a537de1867b01` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:48.584504 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6159667417f409f930a537de1867b01)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:48.587000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:48.626279 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1076/2171] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:48 2022] POST /identity/v3/users => generated 288 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:48.631053 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b246e-6837-4ac2-889e-371b8f210cc5 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:48.669638 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b246e-6837-4ac2-889e-371b8f210cc5 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:48.673056 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6159667417f409f930a537de1867b01', 'request_id': 'req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:48.680990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6159667417f409f930a537de1867b01', 'request_id': 'req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:48.690277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6159667417f409f930a537de1867b01', 'request_id': 'req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:48.729403 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e admin admin] The token cache is being invalidate because project b6159667417f409f930a537de1867b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:48.729601 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:48.731987 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:48.736193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1096/2172] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:48 2022] DELETE /identity/v3/projects/b6159667417f409f930a537de1867b01 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:48.740338 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:48.742114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:48.871890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e4b5a-521b-4364-b53c-b2a8c4efec88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:48.873422 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e4b5a-521b-4364-b53c-b2a8c4efec88 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:48.873856 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e4b5a-521b-4364-b53c-b2a8c4efec88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:48.874394 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e4b5a-521b-4364-b53c-b2a8c4efec88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:48.875694 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e4b5a-521b-4364-b53c-b2a8c4efec88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:48.875841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:48.880368 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e4b5a-521b-4364-b53c-b2a8c4efec88 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:48.899145 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1077/2173] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:48.900146 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e4b5a-521b-4364-b53c-b2a8c4efec88 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:48.902879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8e9e4b5a-521b-4364-b53c-b2a8c4efec88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:48.911956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f8374-ea36-446c-8bd6-fbb476e2d15e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:48.919826 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e4b5a-521b-4364-b53c-b2a8c4efec88 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:48.927867 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a136b-02e7-4641-ab22-65307b9ddc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:48.928325 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c88f86-f197-4159-831c-d6b6c7a9cee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:48.929766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c88f86-f197-4159-831c-d6b6c7a9cee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:48.930235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a136b-02e7-4641-ab22-65307b9ddc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:48.930580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a136b-02e7-4641-ab22-65307b9ddc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:48.930859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c88f86-f197-4159-831c-d6b6c7a9cee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:48.930961 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a136b-02e7-4641-ab22-65307b9ddc55 admin admin] PATH_INFO: `/v3/users/6b3ffed5d6784828b5a3383994e49122` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:48.931404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c88f86-f197-4159-831c-d6b6c7a9cee4 admin admin] PATH_INFO: `/v3/users/8593240e36fc40dcac15838d49925665` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:48.932351 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a136b-02e7-4641-ab22-65307b9ddc55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b3ffed5d6784828b5a3383994e49122)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:48.933039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c88f86-f197-4159-831c-d6b6c7a9cee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8593240e36fc40dcac15838d49925665)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:48.935456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a136b-02e7-4641-ab22-65307b9ddc55 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:48.937031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c88f86-f197-4159-831c-d6b6c7a9cee4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:49.009192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0d1a136b-02e7-4641-ab22-65307b9ddc55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b3ffed5d6784828b5a3383994e49122'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:49.019690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-67c88f86-f197-4159-831c-d6b6c7a9cee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8593240e36fc40dcac15838d49925665'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:49.021938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0d1a136b-02e7-4641-ab22-65307b9ddc55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b3ffed5d6784828b5a3383994e49122'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:49.023442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0d1a136b-02e7-4641-ab22-65307b9ddc55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b3ffed5d6784828b5a3383994e49122'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:49.025264 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0d1a136b-02e7-4641-ab22-65307b9ddc55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b3ffed5d6784828b5a3383994e49122'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:49.032255 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-67c88f86-f197-4159-831c-d6b6c7a9cee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8593240e36fc40dcac15838d49925665'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:49.032893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-67c88f86-f197-4159-831c-d6b6c7a9cee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8593240e36fc40dcac15838d49925665'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:49.033747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-67c88f86-f197-4159-831c-d6b6c7a9cee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8593240e36fc40dcac15838d49925665'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:49.049225 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-0d1a136b-02e7-4641-ab22-65307b9ddc55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b3ffed5d6784828b5a3383994e49122'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:49.054822 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-67c88f86-f197-4159-831c-d6b6c7a9cee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8593240e36fc40dcac15838d49925665'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:49.071856 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1078/2174] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:48 2022] DELETE /identity/v3/users/6b3ffed5d6784828b5a3383994e49122 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:49.072084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1097/2175] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:48 2022] DELETE /identity/v3/users/8593240e36fc40dcac15838d49925665 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:49.075531 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c88f86-f197-4159-831c-d6b6c7a9cee4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:49.081603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2009-46b7-40e4-a265-0dd964cff640 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:49.082183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2009-46b7-40e4-a265-0dd964cff640 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:49.082648 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d2009-46b7-40e4-a265-0dd964cff640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:49.085841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-67c88f86-f197-4159-831c-d6b6c7a9cee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:49.106291 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a98d2009-46b7-40e4-a265-0dd964cff640 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:49.108864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a98d2009-46b7-40e4-a265-0dd964cff640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:49.140154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:49.227512 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1079/2176] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:49.233581 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c88f86-f197-4159-831c-d6b6c7a9cee4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:49.245845 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a0437-cf73-4f9d-b86e-9a2a6d14a195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:49.246551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a0437-cf73-4f9d-b86e-9a2a6d14a195 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:49.246837 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a0437-cf73-4f9d-b86e-9a2a6d14a195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:49.247115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a0437-cf73-4f9d-b86e-9a2a6d14a195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:49.248013 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a0437-cf73-4f9d-b86e-9a2a6d14a195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:49.250250 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a0437-cf73-4f9d-b86e-9a2a6d14a195 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:49.259708 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d2009-46b7-40e4-a265-0dd964cff640 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:49.262179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a98d2009-46b7-40e4-a265-0dd964cff640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:49.267422 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1098/2177] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:49.269130 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a0437-cf73-4f9d-b86e-9a2a6d14a195 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:49.290580 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a0437-cf73-4f9d-b86e-9a2a6d14a195 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:49.304995 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56d73b-d034-4f13-902e-99cbc5b823ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:49.306454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56d73b-d034-4f13-902e-99cbc5b823ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:49.306867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56d73b-d034-4f13-902e-99cbc5b823ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:49.307253 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56d73b-d034-4f13-902e-99cbc5b823ca admin admin] PATH_INFO: `/v3/projects/a7d040da08c244a3932f759ac198eeb6/users/871652f2416645ab8029c257d326d8e4/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:49.350359 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56d73b-d034-4f13-902e-99cbc5b823ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d040da08c244a3932f759ac198eeb6, user_id=871652f2416645ab8029c257d326d8e4, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:49.353050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56d73b-d034-4f13-902e-99cbc5b823ca admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:49.383891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1099/2178] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:49 2022] PUT /identity/v3/projects/a7d040da08c244a3932f759ac198eeb6/users/871652f2416645ab8029c257d326d8e4/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:49.392920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d2009-46b7-40e4-a265-0dd964cff640 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:49.400832 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5e2e1-4474-4a4e-94cb-17200253e62e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:49.401278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5e2e1-4474-4a4e-94cb-17200253e62e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:49.404778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5e2e1-4474-4a4e-94cb-17200253e62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:49.478286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-32d5e2e1-4474-4a4e-94cb-17200253e62e None None] MFA Rules not processed for user `871652f2416645ab8029c257d326d8e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:49.483239 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-32d5e2e1-4474-4a4e-94cb-17200253e62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:49.536615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb54ea9-f5cf-4f4b-9aca-af801a5bef4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:49.537583 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb54ea9-f5cf-4f4b-9aca-af801a5bef4e service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:49.538143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb54ea9-f5cf-4f4b-9aca-af801a5bef4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:49.538501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb54ea9-f5cf-4f4b-9aca-af801a5bef4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:49.550826 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:49.624938 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1100/2179] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:49.626065 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5e2e1-4474-4a4e-94cb-17200253e62e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:49.627433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-32d5e2e1-4474-4a4e-94cb-17200253e62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:49.661137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb54ea9-f5cf-4f4b-9aca-af801a5bef4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:49.663109 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb54ea9-f5cf-4f4b-9aca-af801a5bef4e service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:49.676800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1080/2180] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:35:49.677722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb54ea9-f5cf-4f4b-9aca-af801a5bef4e service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:49.679089 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ebb54ea9-f5cf-4f4b-9aca-af801a5bef4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:49.700187 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb54ea9-f5cf-4f4b-9aca-af801a5bef4e service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:49.711482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914490ee-948d-4d90-9b67-e015eee4de46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:49.712514 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914490ee-948d-4d90-9b67-e015eee4de46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:49.712896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914490ee-948d-4d90-9b67-e015eee4de46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:49.713299 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914490ee-948d-4d90-9b67-e015eee4de46 admin admin] PATH_INFO: `/v3/projects/ceb2e683ddc34ceda951a40c716459dd` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:49.714800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914490ee-948d-4d90-9b67-e015eee4de46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb2e683ddc34ceda951a40c716459dd)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:49.716974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914490ee-948d-4d90-9b67-e015eee4de46 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:49.756501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:49.800188 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-914490ee-948d-4d90-9b67-e015eee4de46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb2e683ddc34ceda951a40c716459dd', 'request_id': 'req-914490ee-948d-4d90-9b67-e015eee4de46'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:49.802598 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5e2e1-4474-4a4e-94cb-17200253e62e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:49.806536 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-914490ee-948d-4d90-9b67-e015eee4de46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb2e683ddc34ceda951a40c716459dd', 'request_id': 'req-914490ee-948d-4d90-9b67-e015eee4de46'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:49.814447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-914490ee-948d-4d90-9b67-e015eee4de46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb2e683ddc34ceda951a40c716459dd', 'request_id': 'req-914490ee-948d-4d90-9b67-e015eee4de46'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:49.832602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-914490ee-948d-4d90-9b67-e015eee4de46 admin admin] The token cache is being invalidate because project ceb2e683ddc34ceda951a40c716459dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:49.833075 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-914490ee-948d-4d90-9b67-e015eee4de46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:49.834323 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-914490ee-948d-4d90-9b67-e015eee4de46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:49.837688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1081/2181] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:49 2022] DELETE /identity/v3/projects/ceb2e683ddc34ceda951a40c716459dd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:49.840502 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914490ee-948d-4d90-9b67-e015eee4de46 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:49.843777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-914490ee-948d-4d90-9b67-e015eee4de46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:49.989042 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834e476-cb81-4106-8582-30e47997f3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:49.990039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834e476-cb81-4106-8582-30e47997f3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:49.990428 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834e476-cb81-4106-8582-30e47997f3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:49.990622 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834e476-cb81-4106-8582-30e47997f3a1 admin admin] PATH_INFO: `/v3/projects/8c9ee3236322444e915b7447bc853f82` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:49.996508 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834e476-cb81-4106-8582-30e47997f3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9ee3236322444e915b7447bc853f82)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:50.002098 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834e476-cb81-4106-8582-30e47997f3a1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:50.082430 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914490ee-948d-4d90-9b67-e015eee4de46 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:50.108188 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ca52d-bf08-4079-b3c0-a5085fb610d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:50.109593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ca52d-bf08-4079-b3c0-a5085fb610d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:50.109892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ca52d-bf08-4079-b3c0-a5085fb610d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:50.110171 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ca52d-bf08-4079-b3c0-a5085fb610d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:50.110888 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ca52d-bf08-4079-b3c0-a5085fb610d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:50.113400 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ca52d-bf08-4079-b3c0-a5085fb610d7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:50.158607 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b834e476-cb81-4106-8582-30e47997f3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9ee3236322444e915b7447bc853f82', 'request_id': 'req-b834e476-cb81-4106-8582-30e47997f3a1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.171129 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1082/2182] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:49 2022] POST /identity/v3/projects => generated 375 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:50.172293 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b834e476-cb81-4106-8582-30e47997f3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9ee3236322444e915b7447bc853f82', 'request_id': 'req-b834e476-cb81-4106-8582-30e47997f3a1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.173676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ca52d-bf08-4079-b3c0-a5085fb610d7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:50.177155 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9f1ca52d-bf08-4079-b3c0-a5085fb610d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:50.184198 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b834e476-cb81-4106-8582-30e47997f3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9ee3236322444e915b7447bc853f82', 'request_id': 'req-b834e476-cb81-4106-8582-30e47997f3a1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.208095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b834e476-cb81-4106-8582-30e47997f3a1 admin admin] The token cache is being invalidate because project 8c9ee3236322444e915b7447bc853f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:50.210494 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b834e476-cb81-4106-8582-30e47997f3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.212114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b834e476-cb81-4106-8582-30e47997f3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.215543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1101/2183] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:49 2022] DELETE /identity/v3/projects/8c9ee3236322444e915b7447bc853f82 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:50.218093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834e476-cb81-4106-8582-30e47997f3a1 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:50.222688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b834e476-cb81-4106-8582-30e47997f3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:50.264999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:50.335940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ca52d-bf08-4079-b3c0-a5085fb610d7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:50.343224 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf95fd-793b-4d4a-aa92-a91f9e64f650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:50.345834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf95fd-793b-4d4a-aa92-a91f9e64f650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:50.346176 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf95fd-793b-4d4a-aa92-a91f9e64f650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:50.348808 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf95fd-793b-4d4a-aa92-a91f9e64f650 admin admin] PATH_INFO: `/v3/users/39b43dff97fe4b8c871c647f2d798f6e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:50.351368 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf95fd-793b-4d4a-aa92-a91f9e64f650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b43dff97fe4b8c871c647f2d798f6e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:50.353493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf95fd-793b-4d4a-aa92-a91f9e64f650 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:50.372632 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834e476-cb81-4106-8582-30e47997f3a1 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:50.378137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48e548-27a8-4c73-9e2e-70a60ca5aeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:50.378756 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48e548-27a8-4c73-9e2e-70a60ca5aeb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:50.379044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48e548-27a8-4c73-9e2e-70a60ca5aeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:50.379610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48e548-27a8-4c73-9e2e-70a60ca5aeb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:50.380393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48e548-27a8-4c73-9e2e-70a60ca5aeb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:50.382308 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48e548-27a8-4c73-9e2e-70a60ca5aeb9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:50.410630 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1102/2184] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:50 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:50.411904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48e548-27a8-4c73-9e2e-70a60ca5aeb9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:50.414581 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1e48e548-27a8-4c73-9e2e-70a60ca5aeb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:50.429433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48e548-27a8-4c73-9e2e-70a60ca5aeb9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:50.436804 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e622822-0fdb-4189-bcff-d4a39a9fb023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:50.437739 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e622822-0fdb-4189-bcff-d4a39a9fb023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:50.438031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e622822-0fdb-4189-bcff-d4a39a9fb023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:50.438310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e622822-0fdb-4189-bcff-d4a39a9fb023 admin admin] PATH_INFO: `/v3/projects/90d74e330c8a417493b38d5ae2f0238a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:50.440029 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e622822-0fdb-4189-bcff-d4a39a9fb023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90d74e330c8a417493b38d5ae2f0238a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:50.441817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:50.443254 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e622822-0fdb-4189-bcff-d4a39a9fb023 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:50.451714 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6bbf95fd-793b-4d4a-aa92-a91f9e64f650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b43dff97fe4b8c871c647f2d798f6e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.479413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6bbf95fd-793b-4d4a-aa92-a91f9e64f650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b43dff97fe4b8c871c647f2d798f6e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.479413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6bbf95fd-793b-4d4a-aa92-a91f9e64f650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b43dff97fe4b8c871c647f2d798f6e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.479413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6bbf95fd-793b-4d4a-aa92-a91f9e64f650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b43dff97fe4b8c871c647f2d798f6e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.500251 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6bbf95fd-793b-4d4a-aa92-a91f9e64f650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b43dff97fe4b8c871c647f2d798f6e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.521873 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1083/2185] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:50 2022] DELETE /identity/v3/users/39b43dff97fe4b8c871c647f2d798f6e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:50.521873 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f949d6-8b2a-4747-873e-c1c47f4b7346 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:50.521873 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f949d6-8b2a-4747-873e-c1c47f4b7346 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:50.521873 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f949d6-8b2a-4747-873e-c1c47f4b7346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:50.530760 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5e622822-0fdb-4189-bcff-d4a39a9fb023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90d74e330c8a417493b38d5ae2f0238a', 'request_id': 'req-5e622822-0fdb-4189-bcff-d4a39a9fb023'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.544530 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5e622822-0fdb-4189-bcff-d4a39a9fb023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90d74e330c8a417493b38d5ae2f0238a', 'request_id': 'req-5e622822-0fdb-4189-bcff-d4a39a9fb023'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.555229 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d1f949d6-8b2a-4747-873e-c1c47f4b7346 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:50.555780 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5e622822-0fdb-4189-bcff-d4a39a9fb023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90d74e330c8a417493b38d5ae2f0238a', 'request_id': 'req-5e622822-0fdb-4189-bcff-d4a39a9fb023'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.558076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d1f949d6-8b2a-4747-873e-c1c47f4b7346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:50.578412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5e622822-0fdb-4189-bcff-d4a39a9fb023 admin admin] The token cache is being invalidate because project 90d74e330c8a417493b38d5ae2f0238a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:50.578412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5e622822-0fdb-4189-bcff-d4a39a9fb023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.579279 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5e622822-0fdb-4189-bcff-d4a39a9fb023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.581829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1103/2186] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:50 2022] DELETE /identity/v3/projects/90d74e330c8a417493b38d5ae2f0238a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:50.583047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e622822-0fdb-4189-bcff-d4a39a9fb023 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:50.584695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5e622822-0fdb-4189-bcff-d4a39a9fb023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:50.713251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e622822-0fdb-4189-bcff-d4a39a9fb023 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:50.728100 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1084/2187] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:50.731630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f949d6-8b2a-4747-873e-c1c47f4b7346 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:50.735153 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d1f949d6-8b2a-4747-873e-c1c47f4b7346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:50.756287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:50.783292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f949d6-8b2a-4747-873e-c1c47f4b7346 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:50.803287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26fb04-f936-4b35-9cba-babe7db14fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:50.804227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26fb04-f936-4b35-9cba-babe7db14fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:50.804606 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26fb04-f936-4b35-9cba-babe7db14fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:50.805040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26fb04-f936-4b35-9cba-babe7db14fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:50.805991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26fb04-f936-4b35-9cba-babe7db14fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:50.807917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26fb04-f936-4b35-9cba-babe7db14fa6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:50.811084 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a5561-dbbc-40fd-9940-45eb41fbab98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:50.813363 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a5561-dbbc-40fd-9940-45eb41fbab98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:50.814049 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a5561-dbbc-40fd-9940-45eb41fbab98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:50.814466 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a5561-dbbc-40fd-9940-45eb41fbab98 admin admin] PATH_INFO: `/v3/users/28b81a73e3d24043ae831b00eb0ad500` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:50.817531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a5561-dbbc-40fd-9940-45eb41fbab98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b81a73e3d24043ae831b00eb0ad500)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:50.826310 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a5561-dbbc-40fd-9940-45eb41fbab98 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:50.841998 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1104/2188] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:50.843738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76155ef8-49a3-49c3-84a0-37d81f1978d9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:50.844243 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76155ef8-49a3-49c3-84a0-37d81f1978d9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:50.846495 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76155ef8-49a3-49c3-84a0-37d81f1978d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:50.878251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-76155ef8-49a3-49c3-84a0-37d81f1978d9 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:50.880149 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-76155ef8-49a3-49c3-84a0-37d81f1978d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:50.895758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1105/2189] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:50.896918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76155ef8-49a3-49c3-84a0-37d81f1978d9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:50.911587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76155ef8-49a3-49c3-84a0-37d81f1978d9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:50.927286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114232aa-d492-463f-aa4a-7abaa34813da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:50.928221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114232aa-d492-463f-aa4a-7abaa34813da admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:50.928508 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114232aa-d492-463f-aa4a-7abaa34813da admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:50.928785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114232aa-d492-463f-aa4a-7abaa34813da admin admin] PATH_INFO: `/v3/projects/0e587faaaf87425cbc467f4a695c3b8b/users/456dc2e0bced4af9be80c2bee8261277/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:50.944443 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6c6a5561-dbbc-40fd-9940-45eb41fbab98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b81a73e3d24043ae831b00eb0ad500'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.960197 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6c6a5561-dbbc-40fd-9940-45eb41fbab98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b81a73e3d24043ae831b00eb0ad500'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.961062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6c6a5561-dbbc-40fd-9940-45eb41fbab98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b81a73e3d24043ae831b00eb0ad500'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.961657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6c6a5561-dbbc-40fd-9940-45eb41fbab98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b81a73e3d24043ae831b00eb0ad500'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:50.967922 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114232aa-d492-463f-aa4a-7abaa34813da admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e587faaaf87425cbc467f4a695c3b8b, user_id=456dc2e0bced4af9be80c2bee8261277, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:50.970876 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114232aa-d492-463f-aa4a-7abaa34813da admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:50.980133 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6c6a5561-dbbc-40fd-9940-45eb41fbab98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b81a73e3d24043ae831b00eb0ad500'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:51.001411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1106/2190] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:50 2022] PUT /identity/v3/projects/0e587faaaf87425cbc467f4a695c3b8b/users/456dc2e0bced4af9be80c2bee8261277/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:51.002370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114232aa-d492-463f-aa4a-7abaa34813da admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:51.004766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-114232aa-d492-463f-aa4a-7abaa34813da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:51.022013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1085/2191] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:50 2022] DELETE /identity/v3/users/28b81a73e3d24043ae831b00eb0ad500 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:51.023237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a5561-dbbc-40fd-9940-45eb41fbab98 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:51.025599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6c6a5561-dbbc-40fd-9940-45eb41fbab98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:51.102244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114232aa-d492-463f-aa4a-7abaa34813da admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:51.125207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:51.183828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a5561-dbbc-40fd-9940-45eb41fbab98 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:51.189559 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252aa2a1-e115-47a7-bbd0-18dd5c4fa0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:51.190613 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aa2a1-e115-47a7-bbd0-18dd5c4fa0ba admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:51.190965 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aa2a1-e115-47a7-bbd0-18dd5c4fa0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:51.191323 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252aa2a1-e115-47a7-bbd0-18dd5c4fa0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:51.192323 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252aa2a1-e115-47a7-bbd0-18dd5c4fa0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:51.194389 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252aa2a1-e115-47a7-bbd0-18dd5c4fa0ba admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:51.214231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1086/2192] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:51.214708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea91150-feff-4b42-8a44-697a0da2df3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:51.215463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea91150-feff-4b42-8a44-697a0da2df3a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:51.215801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea91150-feff-4b42-8a44-697a0da2df3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:51.216082 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea91150-feff-4b42-8a44-697a0da2df3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:51.216344 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252aa2a1-e115-47a7-bbd0-18dd5c4fa0ba admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:51.218114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea91150-feff-4b42-8a44-697a0da2df3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:51.218442 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea91150-feff-4b42-8a44-697a0da2df3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:51.219317 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-252aa2a1-e115-47a7-bbd0-18dd5c4fa0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:51.220343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea91150-feff-4b42-8a44-697a0da2df3a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:51.237300 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252aa2a1-e115-47a7-bbd0-18dd5c4fa0ba admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:51.246390 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1107/2193] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:51.247507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea91150-feff-4b42-8a44-697a0da2df3a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:51.250625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d6a34-e831-433c-ab45-4fddd5e59b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:51.251555 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d6a34-e831-433c-ab45-4fddd5e59b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:51.251841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d6a34-e831-433c-ab45-4fddd5e59b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:51.252118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d6a34-e831-433c-ab45-4fddd5e59b18 admin admin] PATH_INFO: `/v3/projects/6ca01e537da9460988200208a98cde3e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:51.253411 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d6a34-e831-433c-ab45-4fddd5e59b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca01e537da9460988200208a98cde3e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:51.255574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d6a34-e831-433c-ab45-4fddd5e59b18 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:51.265523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea91150-feff-4b42-8a44-697a0da2df3a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:51.271497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df36de6-96ef-40d8-9f67-69fb3dfc4295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:51.272414 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36de6-96ef-40d8-9f67-69fb3dfc4295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:51.272698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36de6-96ef-40d8-9f67-69fb3dfc4295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:51.272974 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36de6-96ef-40d8-9f67-69fb3dfc4295 admin admin] PATH_INFO: `/v3/projects/0e587faaaf87425cbc467f4a695c3b8b/users/456dc2e0bced4af9be80c2bee8261277/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:51.275580 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df36de6-96ef-40d8-9f67-69fb3dfc4295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e587faaaf87425cbc467f4a695c3b8b, user_id=456dc2e0bced4af9be80c2bee8261277, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:51.278753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df36de6-96ef-40d8-9f67-69fb3dfc4295 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:51.294076 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1108/2194] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:51 2022] PUT /identity/v3/projects/0e587faaaf87425cbc467f4a695c3b8b/users/456dc2e0bced4af9be80c2bee8261277/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:51.294907 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df36de6-96ef-40d8-9f67-69fb3dfc4295 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:51.349204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-247d6a34-e831-433c-ab45-4fddd5e59b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca01e537da9460988200208a98cde3e', 'request_id': 'req-247d6a34-e831-433c-ab45-4fddd5e59b18'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:51.355758 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-247d6a34-e831-433c-ab45-4fddd5e59b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca01e537da9460988200208a98cde3e', 'request_id': 'req-247d6a34-e831-433c-ab45-4fddd5e59b18'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:51.362868 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-247d6a34-e831-433c-ab45-4fddd5e59b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca01e537da9460988200208a98cde3e', 'request_id': 'req-247d6a34-e831-433c-ab45-4fddd5e59b18'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:51.369676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:51.384388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-247d6a34-e831-433c-ab45-4fddd5e59b18 admin admin] The token cache is being invalidate because project 6ca01e537da9460988200208a98cde3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:51.384784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-247d6a34-e831-433c-ab45-4fddd5e59b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:51.386472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-247d6a34-e831-433c-ab45-4fddd5e59b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:51.402272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1087/2195] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:51 2022] DELETE /identity/v3/projects/6ca01e537da9460988200208a98cde3e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:51.406891 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc799c9-1a19-4cb5-adf1-032d87d2021b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:51.407194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc799c9-1a19-4cb5-adf1-032d87d2021b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:51.407484 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc799c9-1a19-4cb5-adf1-032d87d2021b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:51.438755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df36de6-96ef-40d8-9f67-69fb3dfc4295 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:51.489162 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4cc799c9-1a19-4cb5-adf1-032d87d2021b None None] MFA Rules not processed for user `456dc2e0bced4af9be80c2bee8261277`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:51.490960 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4cc799c9-1a19-4cb5-adf1-032d87d2021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:51.570314 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44e3c7-239e-46dc-b36c-458674c1b5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:51.571091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44e3c7-239e-46dc-b36c-458674c1b5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:51.571383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44e3c7-239e-46dc-b36c-458674c1b5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:51.571665 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44e3c7-239e-46dc-b36c-458674c1b5a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:51.572805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44e3c7-239e-46dc-b36c-458674c1b5a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:51.574872 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44e3c7-239e-46dc-b36c-458674c1b5a0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:51.625305 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1109/2196] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:51 2022] POST /identity/v3/projects => generated 387 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:51.625305 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ac2d3-f8f8-4273-bedd-391de828032a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:51.625305 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ac2d3-f8f8-4273-bedd-391de828032a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:51.625305 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ac2d3-f8f8-4273-bedd-391de828032a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:51.647539 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-004ac2d3-f8f8-4273-bedd-391de828032a None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:51.649762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-004ac2d3-f8f8-4273-bedd-391de828032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:51.657866 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1088/2197] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:51.660548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc799c9-1a19-4cb5-adf1-032d87d2021b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:51.663273 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4cc799c9-1a19-4cb5-adf1-032d87d2021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:51.680737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc799c9-1a19-4cb5-adf1-032d87d2021b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:51.734971 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:51.773801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1110/2198] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:51.773801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ac2d3-f8f8-4273-bedd-391de828032a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:51.773801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-004ac2d3-f8f8-4273-bedd-391de828032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:51.798936 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8e963-593f-4d91-a3c7-4ae2004d7a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:51.799679 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8e963-593f-4d91-a3c7-4ae2004d7a3d admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:51.799990 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8e963-593f-4d91-a3c7-4ae2004d7a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:51.800836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8e963-593f-4d91-a3c7-4ae2004d7a3d admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:51.801925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8e963-593f-4d91-a3c7-4ae2004d7a3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:51.804318 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8e963-593f-4d91-a3c7-4ae2004d7a3d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:51.837586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1089/2199] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:51 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:51.842109 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490b145-9c8f-4db3-aa3f-7790312722c5 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:51.842399 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490b145-9c8f-4db3-aa3f-7790312722c5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:51.842743 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490b145-9c8f-4db3-aa3f-7790312722c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:51.845121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ac2d3-f8f8-4273-bedd-391de828032a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:51.850535 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945b4c3-d073-4674-aca8-b8237c2b9006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:51.851283 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b4c3-d073-4674-aca8-b8237c2b9006 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:51.851921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b4c3-d073-4674-aca8-b8237c2b9006 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:51.852389 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945b4c3-d073-4674-aca8-b8237c2b9006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:51.854343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a945b4c3-d073-4674-aca8-b8237c2b9006 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:51.862297 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:51.863490 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d490b145-9c8f-4db3-aa3f-7790312722c5 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:51.864780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d490b145-9c8f-4db3-aa3f-7790312722c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:51.876907 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1090/2200] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:51.876907 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490b145-9c8f-4db3-aa3f-7790312722c5 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:51.887385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490b145-9c8f-4db3-aa3f-7790312722c5 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:51.892781 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3c075-9b41-4788-8d25-159f1ef07de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:51.893554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3c075-9b41-4788-8d25-159f1ef07de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:51.893838 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3c075-9b41-4788-8d25-159f1ef07de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:51.894113 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3c075-9b41-4788-8d25-159f1ef07de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:51.894861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3c075-9b41-4788-8d25-159f1ef07de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:51.896527 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3c075-9b41-4788-8d25-159f1ef07de7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:51.908381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1091/2201] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:51.909086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3c075-9b41-4788-8d25-159f1ef07de7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:51.921007 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3c075-9b41-4788-8d25-159f1ef07de7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:51.925922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dcc45-db62-47c4-8ff1-b7d4e9156816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:51.926642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dcc45-db62-47c4-8ff1-b7d4e9156816 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:51.926969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dcc45-db62-47c4-8ff1-b7d4e9156816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:51.927418 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3dcc45-db62-47c4-8ff1-b7d4e9156816 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:51.928088 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3dcc45-db62-47c4-8ff1-b7d4e9156816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:51.928398 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3dcc45-db62-47c4-8ff1-b7d4e9156816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:51.930076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3dcc45-db62-47c4-8ff1-b7d4e9156816 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:51.953226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945b4c3-d073-4674-aca8-b8237c2b9006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:51.953226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945b4c3-d073-4674-aca8-b8237c2b9006 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:51.954603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1092/2202] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:51.956171 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dcc45-db62-47c4-8ff1-b7d4e9156816 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:51.962625 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1111/2203] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:51.963660 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945b4c3-d073-4674-aca8-b8237c2b9006 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:51.973416 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3dcc45-db62-47c4-8ff1-b7d4e9156816 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:51.980275 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945b4c3-d073-4674-aca8-b8237c2b9006 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:51.981102 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab6f5a-74b6-4783-a740-7319c2cca707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:51.981891 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab6f5a-74b6-4783-a740-7319c2cca707 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:51.982236 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab6f5a-74b6-4783-a740-7319c2cca707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:51.982584 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab6f5a-74b6-4783-a740-7319c2cca707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:51.983402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab6f5a-74b6-4783-a740-7319c2cca707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:51.985810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab6f5a-74b6-4783-a740-7319c2cca707 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:51.987587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a13d7-6088-454f-bc05-ef1ef832b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:51.988984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a13d7-6088-454f-bc05-ef1ef832b500 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:51.989326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a13d7-6088-454f-bc05-ef1ef832b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:51.989877 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a13d7-6088-454f-bc05-ef1ef832b500 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:51.990673 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a13d7-6088-454f-bc05-ef1ef832b500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:51.993797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a13d7-6088-454f-bc05-ef1ef832b500 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:51.998836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1093/2204] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:52.003343 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab6f5a-74b6-4783-a740-7319c2cca707 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:52.022713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab6f5a-74b6-4783-a740-7319c2cca707 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:52.029097 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055f48b-a8fc-4eb1-beb0-cc51ca0f27c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:52.029986 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055f48b-a8fc-4eb1-beb0-cc51ca0f27c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:52.030279 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055f48b-a8fc-4eb1-beb0-cc51ca0f27c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:52.030563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055f48b-a8fc-4eb1-beb0-cc51ca0f27c7 admin admin] PATH_INFO: `/v3/projects/a90a80967b2b4adfbd79526a5296deb4/users/afb16e3cfc0b4da5a6d519cb38d5b05c/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:52.032391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1112/2205] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:51 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:52.037999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a13d7-6088-454f-bc05-ef1ef832b500 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:52.056068 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055f48b-a8fc-4eb1-beb0-cc51ca0f27c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90a80967b2b4adfbd79526a5296deb4, user_id=afb16e3cfc0b4da5a6d519cb38d5b05c, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:52.060729 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055f48b-a8fc-4eb1-beb0-cc51ca0f27c7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:52.088765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1094/2206] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:52 2022] PUT /identity/v3/projects/a90a80967b2b4adfbd79526a5296deb4/users/afb16e3cfc0b4da5a6d519cb38d5b05c/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:52.104064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79e1fb-07ca-45a8-83ee-dc32e34788db None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:52.104977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79e1fb-07ca-45a8-83ee-dc32e34788db None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:52.105265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79e1fb-07ca-45a8-83ee-dc32e34788db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:52.133965 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a13d7-6088-454f-bc05-ef1ef832b500 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:52.154174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8d79e1fb-07ca-45a8-83ee-dc32e34788db None None] MFA Rules not processed for user `afb16e3cfc0b4da5a6d519cb38d5b05c`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:52.155295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8d79e1fb-07ca-45a8-83ee-dc32e34788db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:52.236141 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff99591-c196-4854-b198-997d5f689801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:52.236957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99591-c196-4854-b198-997d5f689801 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:52.238017 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99591-c196-4854-b198-997d5f689801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:52.238355 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99591-c196-4854-b198-997d5f689801 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:52.240333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff99591-c196-4854-b198-997d5f689801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:52.242878 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff99591-c196-4854-b198-997d5f689801 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:52.282033 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1113/2207] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:52 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:52.283043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff99591-c196-4854-b198-997d5f689801 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:52.304094 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1095/2208] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:35:52.307391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79e1fb-07ca-45a8-83ee-dc32e34788db None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:52.310214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff99591-c196-4854-b198-997d5f689801 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:52.329434 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e347179-fcf1-45e2-a945-005fd3880940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:52.330459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e347179-fcf1-45e2-a945-005fd3880940 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:52.331203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79e1fb-07ca-45a8-83ee-dc32e34788db None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:52.333692 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e347179-fcf1-45e2-a945-005fd3880940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:52.334137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e347179-fcf1-45e2-a945-005fd3880940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:52.335052 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e347179-fcf1-45e2-a945-005fd3880940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:52.337615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc227c5-67a3-4239-9fc6-f5199a88ac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:52.340042 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e347179-fcf1-45e2-a945-005fd3880940 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:52.341873 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc227c5-67a3-4239-9fc6-f5199a88ac7e admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:52.342376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc227c5-67a3-4239-9fc6-f5199a88ac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:52.342772 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc227c5-67a3-4239-9fc6-f5199a88ac7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:52.343611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc227c5-67a3-4239-9fc6-f5199a88ac7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:52.346405 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc227c5-67a3-4239-9fc6-f5199a88ac7e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:52.371487 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1114/2209] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:52.373759 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e347179-fcf1-45e2-a945-005fd3880940 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:52.401567 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5e347179-fcf1-45e2-a945-005fd3880940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:52.422646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1096/2210] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:52 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:52.423523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc227c5-67a3-4239-9fc6-f5199a88ac7e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:52.446099 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e347179-fcf1-45e2-a945-005fd3880940 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:52.470499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:52.535085 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:52.570408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2829745-34f4-4169-b8e6-6541c8e814e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:52.571303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2829745-34f4-4169-b8e6-6541c8e814e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:52.571697 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2829745-34f4-4169-b8e6-6541c8e814e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:52.572053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2829745-34f4-4169-b8e6-6541c8e814e0 admin admin] PATH_INFO: `/v3/projects/43bdc2d9814748f9923336f2d89f6ef4` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:52.573318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2829745-34f4-4169-b8e6-6541c8e814e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43bdc2d9814748f9923336f2d89f6ef4)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:52.575430 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2829745-34f4-4169-b8e6-6541c8e814e0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:52.644199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc227c5-67a3-4239-9fc6-f5199a88ac7e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:52.672996 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f2829745-34f4-4169-b8e6-6541c8e814e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43bdc2d9814748f9923336f2d89f6ef4', 'request_id': 'req-f2829745-34f4-4169-b8e6-6541c8e814e0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:52.683852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f2829745-34f4-4169-b8e6-6541c8e814e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43bdc2d9814748f9923336f2d89f6ef4', 'request_id': 'req-f2829745-34f4-4169-b8e6-6541c8e814e0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:52.714515 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f2829745-34f4-4169-b8e6-6541c8e814e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43bdc2d9814748f9923336f2d89f6ef4', 'request_id': 'req-f2829745-34f4-4169-b8e6-6541c8e814e0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:52.741321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f2829745-34f4-4169-b8e6-6541c8e814e0 admin admin] The token cache is being invalidate because project 43bdc2d9814748f9923336f2d89f6ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:52.742021 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f2829745-34f4-4169-b8e6-6541c8e814e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:52.742960 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f2829745-34f4-4169-b8e6-6541c8e814e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:52.746150 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1115/2211] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:52 2022] DELETE /identity/v3/projects/43bdc2d9814748f9923336f2d89f6ef4 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:52.747700 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2829745-34f4-4169-b8e6-6541c8e814e0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:52.750542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f2829745-34f4-4169-b8e6-6541c8e814e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:52.805638 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92381582-0bae-479c-8977-c348f22f0ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:52.806208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92381582-0bae-479c-8977-c348f22f0ccb admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:52.806400 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92381582-0bae-479c-8977-c348f22f0ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:52.806673 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92381582-0bae-479c-8977-c348f22f0ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:52.807424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92381582-0bae-479c-8977-c348f22f0ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:52.809058 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92381582-0bae-479c-8977-c348f22f0ccb admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:52.822588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1097/2212] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:52.823995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec898a-e046-4bda-97c8-624d42204ad6 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:52.824286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec898a-e046-4bda-97c8-624d42204ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:52.824566 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec898a-e046-4bda-97c8-624d42204ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:52.844798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-edec898a-e046-4bda-97c8-624d42204ad6 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:52.846263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-edec898a-e046-4bda-97c8-624d42204ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:52.863198 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1098/2213] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:52.863198 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec898a-e046-4bda-97c8-624d42204ad6 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:52.863198 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-edec898a-e046-4bda-97c8-624d42204ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:52.863546 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2829745-34f4-4169-b8e6-6541c8e814e0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:52.871594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec898a-e046-4bda-97c8-624d42204ad6 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:52.876684 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab997098-f18c-4bad-9d8b-5f5a3c8bbf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:52.877455 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab997098-f18c-4bad-9d8b-5f5a3c8bbf0f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:52.879021 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7d00d-7166-4e4b-ac6b-fcc0984a33f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:52.879205 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab997098-f18c-4bad-9d8b-5f5a3c8bbf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:52.879990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab997098-f18c-4bad-9d8b-5f5a3c8bbf0f admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:52.881408 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7d00d-7166-4e4b-ac6b-fcc0984a33f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:52.882069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7d00d-7166-4e4b-ac6b-fcc0984a33f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:52.882802 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7d00d-7166-4e4b-ac6b-fcc0984a33f2 admin admin] PATH_INFO: `/v3/projects/45500b2041194db2a5776817c032426b/users/78f0a521bd0348b4b76a32f1be8f6431/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:52.884049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab997098-f18c-4bad-9d8b-5f5a3c8bbf0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:52.895133 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab997098-f18c-4bad-9d8b-5f5a3c8bbf0f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:52.926059 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7d00d-7166-4e4b-ac6b-fcc0984a33f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45500b2041194db2a5776817c032426b, user_id=78f0a521bd0348b4b76a32f1be8f6431, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:52.930005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7d00d-7166-4e4b-ac6b-fcc0984a33f2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:52.945429 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1116/2214] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:52 2022] POST /identity/v3/users => generated 300 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:52.948201 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad9d1e-1b24-46eb-a753-e6c3706215b8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:52.948709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad9d1e-1b24-46eb-a753-e6c3706215b8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:52.949237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad9d1e-1b24-46eb-a753-e6c3706215b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:52.973452 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1099/2215] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:52 2022] PUT /identity/v3/projects/45500b2041194db2a5776817c032426b/users/78f0a521bd0348b4b76a32f1be8f6431/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:52.973452 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7d00d-7166-4e4b-ac6b-fcc0984a33f2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:52.987157 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-24ad9d1e-1b24-46eb-a753-e6c3706215b8 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:52.988383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-24ad9d1e-1b24-46eb-a753-e6c3706215b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:53.050353 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:53.086942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7d00d-7166-4e4b-ac6b-fcc0984a33f2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:53.094586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db381e7b-7019-4224-97f3-a13960111ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:53.096088 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db381e7b-7019-4224-97f3-a13960111ffd admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:53.096539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db381e7b-7019-4224-97f3-a13960111ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:53.096822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db381e7b-7019-4224-97f3-a13960111ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:53.097923 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db381e7b-7019-4224-97f3-a13960111ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:53.102030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db381e7b-7019-4224-97f3-a13960111ffd admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:53.118581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1100/2216] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:53.118581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adac1f-8e8f-444f-b819-00ee862e45e7 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:53.118581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adac1f-8e8f-444f-b819-00ee862e45e7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:53.118581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adac1f-8e8f-444f-b819-00ee862e45e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:53.122918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1117/2217] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:53.122918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad9d1e-1b24-46eb-a753-e6c3706215b8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:53.136992 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad9d1e-1b24-46eb-a753-e6c3706215b8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:53.142261 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6aa18-15fe-495d-92e0-294a8ac55047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:53.143265 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6aa18-15fe-495d-92e0-294a8ac55047 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:53.143623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6aa18-15fe-495d-92e0-294a8ac55047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:53.144002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6aa18-15fe-495d-92e0-294a8ac55047 admin admin] PATH_INFO: `/v3/projects/ace7aa54bf6342cb88ba6319f28b4e72/users/879b6fe6c11248008011b5f9707ca72c/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:53.154841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-41adac1f-8e8f-444f-b819-00ee862e45e7 None None] MFA Rules not processed for user `78f0a521bd0348b4b76a32f1be8f6431`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:53.156261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-41adac1f-8e8f-444f-b819-00ee862e45e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:53.159767 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6aa18-15fe-495d-92e0-294a8ac55047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace7aa54bf6342cb88ba6319f28b4e72, user_id=879b6fe6c11248008011b5f9707ca72c, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:53.162674 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6aa18-15fe-495d-92e0-294a8ac55047 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:53.180445 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1118/2218] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:53 2022] PUT /identity/v3/projects/ace7aa54bf6342cb88ba6319f28b4e72/users/879b6fe6c11248008011b5f9707ca72c/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:53.181293 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6aa18-15fe-495d-92e0-294a8ac55047 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:53.188060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:53.251834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1101/2219] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:53.252702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adac1f-8e8f-444f-b819-00ee862e45e7 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:53.256847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-41adac1f-8e8f-444f-b819-00ee862e45e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:53.276984 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adac1f-8e8f-444f-b819-00ee862e45e7 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:53.284918 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ac422-457e-4def-9306-45dc34b9c869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:53.286198 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ac422-457e-4def-9306-45dc34b9c869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:53.286556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ac422-457e-4def-9306-45dc34b9c869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:53.286912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ac422-457e-4def-9306-45dc34b9c869 admin admin] PATH_INFO: `/v3/users/24578c35fb4948468ecbbc62fdfe81cf` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:53.288700 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6aa18-15fe-495d-92e0-294a8ac55047 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:53.290474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ac422-457e-4def-9306-45dc34b9c869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24578c35fb4948468ecbbc62fdfe81cf)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:53.293067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ac422-457e-4def-9306-45dc34b9c869 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:53.294481 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b891ca-137f-43d9-bfb6-42e3a1bd9c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:53.295214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b891ca-137f-43d9-bfb6-42e3a1bd9c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:53.295499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b891ca-137f-43d9-bfb6-42e3a1bd9c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:53.295781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b891ca-137f-43d9-bfb6-42e3a1bd9c06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:53.296513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b891ca-137f-43d9-bfb6-42e3a1bd9c06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:53.296814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b891ca-137f-43d9-bfb6-42e3a1bd9c06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:53.298506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b891ca-137f-43d9-bfb6-42e3a1bd9c06 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:53.315324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1119/2220] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:53.315324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b891ca-137f-43d9-bfb6-42e3a1bd9c06 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:53.327237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b891ca-137f-43d9-bfb6-42e3a1bd9c06 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:53.347726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e570c1-d133-4b38-8df2-8d43810c537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:53.350623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e570c1-d133-4b38-8df2-8d43810c537d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:53.351017 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e570c1-d133-4b38-8df2-8d43810c537d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:53.351403 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e570c1-d133-4b38-8df2-8d43810c537d admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:53.353860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e570c1-d133-4b38-8df2-8d43810c537d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:53.355991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e570c1-d133-4b38-8df2-8d43810c537d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:53.378347 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e11ac422-457e-4def-9306-45dc34b9c869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24578c35fb4948468ecbbc62fdfe81cf'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:53.383745 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1120/2221] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:53.385615 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e570c1-d133-4b38-8df2-8d43810c537d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:53.399109 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e11ac422-457e-4def-9306-45dc34b9c869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24578c35fb4948468ecbbc62fdfe81cf'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:53.401856 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e11ac422-457e-4def-9306-45dc34b9c869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24578c35fb4948468ecbbc62fdfe81cf'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:53.402553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e11ac422-457e-4def-9306-45dc34b9c869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24578c35fb4948468ecbbc62fdfe81cf'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:53.405815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e570c1-d133-4b38-8df2-8d43810c537d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:53.414596 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8565d-1779-4688-878d-0b53cd817e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:53.416200 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8565d-1779-4688-878d-0b53cd817e66 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:53.417057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8565d-1779-4688-878d-0b53cd817e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:53.419140 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8565d-1779-4688-878d-0b53cd817e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:53.421955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8565d-1779-4688-878d-0b53cd817e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:53.425123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-e11ac422-457e-4def-9306-45dc34b9c869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24578c35fb4948468ecbbc62fdfe81cf'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:53.427324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8565d-1779-4688-878d-0b53cd817e66 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:53.440976 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1102/2222] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:53 2022] DELETE /identity/v3/users/24578c35fb4948468ecbbc62fdfe81cf => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:53.442379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e02fca-e181-4678-8a17-b5d0be7bbe0f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:53.442666 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e02fca-e181-4678-8a17-b5d0be7bbe0f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:53.442940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e02fca-e181-4678-8a17-b5d0be7bbe0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:53.466046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1121/2223] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:53 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:53.467303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8565d-1779-4688-878d-0b53cd817e66 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:53.469233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c7c8565d-1779-4688-878d-0b53cd817e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:53.486747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d0e02fca-e181-4678-8a17-b5d0be7bbe0f None None] MFA Rules not processed for user `33d4efb515524324a8442438b3a9c7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:53.488101 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d0e02fca-e181-4678-8a17-b5d0be7bbe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:53.551616 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8565d-1779-4688-878d-0b53cd817e66 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:53.559119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e27db-a863-4cc9-86eb-002e4cb9f965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:53.560800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e27db-a863-4cc9-86eb-002e4cb9f965 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:53.561448 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e27db-a863-4cc9-86eb-002e4cb9f965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:53.561816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e27db-a863-4cc9-86eb-002e4cb9f965 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:53.562981 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e27db-a863-4cc9-86eb-002e4cb9f965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:53.565739 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e27db-a863-4cc9-86eb-002e4cb9f965 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:53.574657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1103/2224] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:53.575808 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e02fca-e181-4678-8a17-b5d0be7bbe0f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:53.579129 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d0e02fca-e181-4678-8a17-b5d0be7bbe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:53.588257 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:53.596668 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e02fca-e181-4678-8a17-b5d0be7bbe0f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:53.602133 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dbe06-9c3f-484d-9e24-6b0a331705c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:53.603040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dbe06-9c3f-484d-9e24-6b0a331705c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:53.603495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dbe06-9c3f-484d-9e24-6b0a331705c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:53.603777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dbe06-9c3f-484d-9e24-6b0a331705c2 admin admin] PATH_INFO: `/v3/projects/ace7aa54bf6342cb88ba6319f28b4e72/users/879b6fe6c11248008011b5f9707ca72c/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:53.606726 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718dbe06-9c3f-484d-9e24-6b0a331705c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace7aa54bf6342cb88ba6319f28b4e72, user_id=879b6fe6c11248008011b5f9707ca72c, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:53.606861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1122/2225] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:53 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:53.608136 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec71762-5b69-4446-8076-016f5152d22c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:53.608436 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec71762-5b69-4446-8076-016f5152d22c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:53.608777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec71762-5b69-4446-8076-016f5152d22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:53.609769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718dbe06-9c3f-484d-9e24-6b0a331705c2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:53.622733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1104/2226] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:53 2022] PUT /identity/v3/projects/ace7aa54bf6342cb88ba6319f28b4e72/users/879b6fe6c11248008011b5f9707ca72c/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:53.623550 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dbe06-9c3f-484d-9e24-6b0a331705c2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:53.625622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-718dbe06-9c3f-484d-9e24-6b0a331705c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:53.640547 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-aec71762-5b69-4446-8076-016f5152d22c None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:53.642208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-aec71762-5b69-4446-8076-016f5152d22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:53.650510 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:53.742843 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dbe06-9c3f-484d-9e24-6b0a331705c2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:53.749269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8b321-fa18-4350-9f51-3e05df40fef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:53.749982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8b321-fa18-4350-9f51-3e05df40fef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:53.750407 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8b321-fa18-4350-9f51-3e05df40fef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:53.750730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8b321-fa18-4350-9f51-3e05df40fef4 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:53.751403 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8b321-fa18-4350-9f51-3e05df40fef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:53.753704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8b321-fa18-4350-9f51-3e05df40fef4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:53.783991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1123/2227] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:53.785098 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec71762-5b69-4446-8076-016f5152d22c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:53.787529 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1105/2228] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:53 2022] POST /identity/v3/users => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:53.788836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8b321-fa18-4350-9f51-3e05df40fef4 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:53.797912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-aec71762-5b69-4446-8076-016f5152d22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:53.804298 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8b321-fa18-4350-9f51-3e05df40fef4 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:53.810419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdb166-da47-4586-8877-756dbf27fad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:53.811120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdb166-da47-4586-8877-756dbf27fad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:53.811396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdb166-da47-4586-8877-756dbf27fad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:53.811681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdb166-da47-4586-8877-756dbf27fad6 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:53.812386 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdb166-da47-4586-8877-756dbf27fad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:53.814435 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdb166-da47-4586-8877-756dbf27fad6 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:53.856902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1106/2229] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:53 2022] POST /identity/v3/users => generated 287 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:53.856902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5a7c6-ea36-447a-8bc1-ae14f86d7c1e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:53.857939 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5a7c6-ea36-447a-8bc1-ae14f86d7c1e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:53.858247 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5a7c6-ea36-447a-8bc1-ae14f86d7c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:53.905415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-6bc5a7c6-ea36-447a-8bc1-ae14f86d7c1e None None] MFA Rules not processed for user `879b6fe6c11248008011b5f9707ca72c`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:53.907174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6bc5a7c6-ea36-447a-8bc1-ae14f86d7c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:53.920887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec71762-5b69-4446-8076-016f5152d22c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:53.928173 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86596c63-355d-4b36-9769-145dd72c32c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:53.929100 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86596c63-355d-4b36-9769-145dd72c32c8 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:53.929811 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86596c63-355d-4b36-9769-145dd72c32c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:53.930225 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86596c63-355d-4b36-9769-145dd72c32c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:54.009633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86596c63-355d-4b36-9769-145dd72c32c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:54.011341 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86596c63-355d-4b36-9769-145dd72c32c8 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:54.026766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1124/2231] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:54.026956 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1107/2231] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:54.026956 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5a7c6-ea36-447a-8bc1-ae14f86d7c1e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:54.027098 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86596c63-355d-4b36-9769-145dd72c32c8 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:54.027194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6bc5a7c6-ea36-447a-8bc1-ae14f86d7c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:54.047197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86596c63-355d-4b36-9769-145dd72c32c8 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:54.057963 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac519b9-1a80-4e69-85b0-c854211de9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:54.058624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac519b9-1a80-4e69-85b0-c854211de9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:54.058906 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac519b9-1a80-4e69-85b0-c854211de9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:54.061045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac519b9-1a80-4e69-85b0-c854211de9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:54.061796 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac519b9-1a80-4e69-85b0-c854211de9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:54.064997 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac519b9-1a80-4e69-85b0-c854211de9a9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:54.098522 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1125/2232] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:54.102804 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac519b9-1a80-4e69-85b0-c854211de9a9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:54.116071 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac519b9-1a80-4e69-85b0-c854211de9a9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:54.121970 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30bab8-aa5d-4691-a252-eb846f28fe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:54.122659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30bab8-aa5d-4691-a252-eb846f28fe1f admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:54.122944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30bab8-aa5d-4691-a252-eb846f28fe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:54.123256 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30bab8-aa5d-4691-a252-eb846f28fe1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:54.123961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30bab8-aa5d-4691-a252-eb846f28fe1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:54.126621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30bab8-aa5d-4691-a252-eb846f28fe1f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:54.142764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1126/2233] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:54.142764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30bab8-aa5d-4691-a252-eb846f28fe1f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:54.143601 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4c30bab8-aa5d-4691-a252-eb846f28fe1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:54.161541 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:54.161684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5a7c6-ea36-447a-8bc1-ae14f86d7c1e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:54.171420 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f72ac7-c892-4076-9594-9f1a04b7c930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:54.177404 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f72ac7-c892-4076-9594-9f1a04b7c930 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:54.177404 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f72ac7-c892-4076-9594-9f1a04b7c930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:54.177404 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f72ac7-c892-4076-9594-9f1a04b7c930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:54.198157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f72ac7-c892-4076-9594-9f1a04b7c930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:54.199817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f72ac7-c892-4076-9594-9f1a04b7c930 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:54.220346 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1108/2234] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:54.221211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f72ac7-c892-4076-9594-9f1a04b7c930 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:54.226989 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-18f72ac7-c892-4076-9594-9f1a04b7c930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:54.244681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:54.254588 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30bab8-aa5d-4691-a252-eb846f28fe1f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:54.259614 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cbd02-8511-4ad5-83aa-ab838bcf962a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:54.260284 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cbd02-8511-4ad5-83aa-ab838bcf962a service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:54.260984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cbd02-8511-4ad5-83aa-ab838bcf962a service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:54.261814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cbd02-8511-4ad5-83aa-ab838bcf962a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:54.263832 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a40cbd02-8511-4ad5-83aa-ab838bcf962a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:54.301516 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f72ac7-c892-4076-9594-9f1a04b7c930 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:54.305920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ffc4d-f62d-4594-bd5b-702c43367fa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:54.307193 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ffc4d-f62d-4594-bd5b-702c43367fa4 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:54.307676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ffc4d-f62d-4594-bd5b-702c43367fa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:54.308098 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ffc4d-f62d-4594-bd5b-702c43367fa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:54.323488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ffc4d-f62d-4594-bd5b-702c43367fa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:54.326163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ffc4d-f62d-4594-bd5b-702c43367fa4 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:54.338847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1109/2235] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:54.340043 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ffc4d-f62d-4594-bd5b-702c43367fa4 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:54.371150 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ffc4d-f62d-4594-bd5b-702c43367fa4 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:54.378422 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf950b0-9be3-42bc-bdff-bdb059810477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:54.380073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf950b0-9be3-42bc-bdff-bdb059810477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:54.380073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf950b0-9be3-42bc-bdff-bdb059810477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:54.380569 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf950b0-9be3-42bc-bdff-bdb059810477 admin admin] PATH_INFO: `/v3/projects/6279dd364492474c9ba72898b70d9698/users/f80f698e941f4c5080a5f3d7ef7ae352/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:54.422361 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf950b0-9be3-42bc-bdff-bdb059810477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6279dd364492474c9ba72898b70d9698, user_id=f80f698e941f4c5080a5f3d7ef7ae352, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:54.427882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cbd02-8511-4ad5-83aa-ab838bcf962a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:54.428045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf950b0-9be3-42bc-bdff-bdb059810477 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:54.430988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cbd02-8511-4ad5-83aa-ab838bcf962a service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:54.468104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1110/2236] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:54 2022] PUT /identity/v3/projects/6279dd364492474c9ba72898b70d9698/users/f80f698e941f4c5080a5f3d7ef7ae352/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:54.468104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf950b0-9be3-42bc-bdff-bdb059810477 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:54.472713 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1127/2237] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:54.479180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cbd02-8511-4ad5-83aa-ab838bcf962a service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:54.530026 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cbd02-8511-4ad5-83aa-ab838bcf962a service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:54.599675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf950b0-9be3-42bc-bdff-bdb059810477 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:54.605920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfd1aa-6efd-4a51-8b75-802a2953d240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:54.606991 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfd1aa-6efd-4a51-8b75-802a2953d240 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:54.607479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfd1aa-6efd-4a51-8b75-802a2953d240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:54.608266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfd1aa-6efd-4a51-8b75-802a2953d240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:54.609580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bfd1aa-6efd-4a51-8b75-802a2953d240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:54.611795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bfd1aa-6efd-4a51-8b75-802a2953d240 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:54.631330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1111/2238] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:54.632501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfd1aa-6efd-4a51-8b75-802a2953d240 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:54.650223 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfd1aa-6efd-4a51-8b75-802a2953d240 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:54.683203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bee765-8ca3-485e-a81b-5c4a9255001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:54.687756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bee765-8ca3-485e-a81b-5c4a9255001a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:54.688067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bee765-8ca3-485e-a81b-5c4a9255001a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:54.688622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bee765-8ca3-485e-a81b-5c4a9255001a admin admin] PATH_INFO: `/v3/users/afb16e3cfc0b4da5a6d519cb38d5b05c` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:54.689813 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bee765-8ca3-485e-a81b-5c4a9255001a admin admin] RBAC: Authorizing `identity:delete_user(user_id=afb16e3cfc0b4da5a6d519cb38d5b05c)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:54.694281 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bee765-8ca3-485e-a81b-5c4a9255001a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:54.699162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbee7b-5602-468d-99ed-3a81c0f0011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:54.702487 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbee7b-5602-468d-99ed-3a81c0f0011d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:54.710081 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbee7b-5602-468d-99ed-3a81c0f0011d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:54.710591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cbee7b-5602-468d-99ed-3a81c0f0011d admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:54.712940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbee7b-5602-468d-99ed-3a81c0f0011d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:54.725459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cbee7b-5602-468d-99ed-3a81c0f0011d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:54.747949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1128/2239] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:54.747949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbee7b-5602-468d-99ed-3a81c0f0011d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:54.761230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cbee7b-5602-468d-99ed-3a81c0f0011d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:54.769387 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51135605-4820-44fe-ae7e-43eb18986606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:54.770800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51135605-4820-44fe-ae7e-43eb18986606 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:54.771277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51135605-4820-44fe-ae7e-43eb18986606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:54.771627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51135605-4820-44fe-ae7e-43eb18986606 admin admin] PATH_INFO: `/v3/projects/c7c1e1acac3042be9dc5c4d8163b2ab8/users/6486e63263a4417c93c5bc4c36bd925a/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:54.803188 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-04bee765-8ca3-485e-a81b-5c4a9255001a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afb16e3cfc0b4da5a6d519cb38d5b05c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:54.805686 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51135605-4820-44fe-ae7e-43eb18986606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c1e1acac3042be9dc5c4d8163b2ab8, user_id=6486e63263a4417c93c5bc4c36bd925a, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:54.811730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51135605-4820-44fe-ae7e-43eb18986606 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:54.813264 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-04bee765-8ca3-485e-a81b-5c4a9255001a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afb16e3cfc0b4da5a6d519cb38d5b05c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:54.814761 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-04bee765-8ca3-485e-a81b-5c4a9255001a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afb16e3cfc0b4da5a6d519cb38d5b05c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:54.816059 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-04bee765-8ca3-485e-a81b-5c4a9255001a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afb16e3cfc0b4da5a6d519cb38d5b05c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:54.841390 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1129/2240] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:54 2022] PUT /identity/v3/projects/c7c1e1acac3042be9dc5c4d8163b2ab8/users/6486e63263a4417c93c5bc4c36bd925a/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:54.845332 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51135605-4820-44fe-ae7e-43eb18986606 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:54.847400 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-51135605-4820-44fe-ae7e-43eb18986606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:54.851717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-04bee765-8ca3-485e-a81b-5c4a9255001a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afb16e3cfc0b4da5a6d519cb38d5b05c'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:54.866949 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:54.874512 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1112/2241] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:54 2022] DELETE /identity/v3/users/afb16e3cfc0b4da5a6d519cb38d5b05c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:54.877829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701a497-8f91-4525-bc24-c121f730e7f7 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:54.878798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701a497-8f91-4525-bc24-c121f730e7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:54.882653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701a497-8f91-4525-bc24-c121f730e7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:54.912790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:54.947662 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e701a497-8f91-4525-bc24-c121f730e7f7 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:54.951017 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e701a497-8f91-4525-bc24-c121f730e7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:54.958034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51135605-4820-44fe-ae7e-43eb18986606 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:55.059383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeeb19-2cb6-4784-a7df-53216b7e881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:55.063399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeeb19-2cb6-4784-a7df-53216b7e881f admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:55.063917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeeb19-2cb6-4784-a7df-53216b7e881f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:55.064749 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeeb19-2cb6-4784-a7df-53216b7e881f admin admin] PATH_INFO: `/v3/projects/6279dd364492474c9ba72898b70d9698/users/f80f698e941f4c5080a5f3d7ef7ae352/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:55.070157 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbeeb19-2cb6-4784-a7df-53216b7e881f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6279dd364492474c9ba72898b70d9698, user_id=f80f698e941f4c5080a5f3d7ef7ae352, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:55.079128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbeeb19-2cb6-4784-a7df-53216b7e881f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:55.107996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1113/2242] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:55.110752 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52ec60-2874-4694-a525-d704d3ff2c86 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:55.111073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52ec60-2874-4694-a525-d704d3ff2c86 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:55.111349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52ec60-2874-4694-a525-d704d3ff2c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:55.127888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1130/2243] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:54 2022] PUT /identity/v3/projects/6279dd364492474c9ba72898b70d9698/users/f80f698e941f4c5080a5f3d7ef7ae352/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:55.130228 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeeb19-2cb6-4784-a7df-53216b7e881f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:55.136622 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bcbeeb19-2cb6-4784-a7df-53216b7e881f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:55.143535 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ab52ec60-2874-4694-a525-d704d3ff2c86 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:55.144955 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ab52ec60-2874-4694-a525-d704d3ff2c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:55.331614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1114/2244] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:55.331614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52ec60-2874-4694-a525-d704d3ff2c86 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:55.333979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ab52ec60-2874-4694-a525-d704d3ff2c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:55.407727 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeeb19-2cb6-4784-a7df-53216b7e881f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:55.412771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:55.413691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:55.415067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:55.415067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc admin admin] PATH_INFO: `/v3/projects/16aa3bacac424c989ba7872fd175f87d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:55.418546 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=16aa3bacac424c989ba7872fd175f87d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:55.423059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:55.465977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52ec60-2874-4694-a525-d704d3ff2c86 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:55.470845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aedc0f-b120-4177-909d-3d201e7dc13b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:55.471578 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aedc0f-b120-4177-909d-3d201e7dc13b service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:55.471865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aedc0f-b120-4177-909d-3d201e7dc13b service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:55.472149 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aedc0f-b120-4177-909d-3d201e7dc13b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:55.490626 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aedc0f-b120-4177-909d-3d201e7dc13b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:55.493095 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aedc0f-b120-4177-909d-3d201e7dc13b service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:55.520033 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1115/2245] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:55.524227 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508f994-3e3f-4138-8986-28ef63989e5a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:55.524475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508f994-3e3f-4138-8986-28ef63989e5a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:55.524761 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508f994-3e3f-4138-8986-28ef63989e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:55.546811 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16aa3bacac424c989ba7872fd175f87d', 'request_id': 'req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:55.553569 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16aa3bacac424c989ba7872fd175f87d', 'request_id': 'req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:55.561164 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16aa3bacac424c989ba7872fd175f87d', 'request_id': 'req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:55.583422 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc admin admin] The token cache is being invalidate because project 16aa3bacac424c989ba7872fd175f87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:55.584119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:55.585092 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:55.588440 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1131/2246] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:55 2022] DELETE /identity/v3/projects/16aa3bacac424c989ba7872fd175f87d => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:55.590322 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:55.593979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:55.616742 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:55.650414 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9508f994-3e3f-4138-8986-28ef63989e5a None None] MFA Rules not processed for user `f80f698e941f4c5080a5f3d7ef7ae352`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:55.651671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9508f994-3e3f-4138-8986-28ef63989e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:55.697985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:55.736689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90d5d0-ec96-4a4f-8a8a-1f75bb5d9ecc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:55.741607 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b8cbf-4ac7-43e6-afe7-ad59fcc492bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:55.742527 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b8cbf-4ac7-43e6-afe7-ad59fcc492bc service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:55.743116 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b8cbf-4ac7-43e6-afe7-ad59fcc492bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:55.743408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b8cbf-4ac7-43e6-afe7-ad59fcc492bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:55.751206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-337b8cbf-4ac7-43e6-afe7-ad59fcc492bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:55.753397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1116/2247] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:55.754681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508f994-3e3f-4138-8986-28ef63989e5a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:55.756786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9508f994-3e3f-4138-8986-28ef63989e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:55.855751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508f994-3e3f-4138-8986-28ef63989e5a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:55.874014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bd1d5-f3ad-4b05-8ddc-5cf1d21d931d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:55.877782 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bd1d5-f3ad-4b05-8ddc-5cf1d21d931d service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:55.878417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bd1d5-f3ad-4b05-8ddc-5cf1d21d931d service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:55.878713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303bd1d5-f3ad-4b05-8ddc-5cf1d21d931d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:55.887582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b8cbf-4ac7-43e6-afe7-ad59fcc492bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:55.889918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b8cbf-4ac7-43e6-afe7-ad59fcc492bc service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:55.890243 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-303bd1d5-f3ad-4b05-8ddc-5cf1d21d931d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:55.903447 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1132/2248] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:55.904323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b8cbf-4ac7-43e6-afe7-ad59fcc492bc service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:55.905679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-337b8cbf-4ac7-43e6-afe7-ad59fcc492bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:55.923181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b8cbf-4ac7-43e6-afe7-ad59fcc492bc service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:55.928713 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e0702-9e41-4e31-844e-915c46710cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:55.929834 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e0702-9e41-4e31-844e-915c46710cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:55.930023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e0702-9e41-4e31-844e-915c46710cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:55.930424 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e0702-9e41-4e31-844e-915c46710cdd admin admin] PATH_INFO: `/v3/users/8529ed83a0164cbeb8b8bcf440208f21` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:55.931809 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e0702-9e41-4e31-844e-915c46710cdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8529ed83a0164cbeb8b8bcf440208f21)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:55.934504 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e0702-9e41-4e31-844e-915c46710cdd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:56.032236 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0c6e0702-9e41-4e31-844e-915c46710cdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8529ed83a0164cbeb8b8bcf440208f21'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:56.050880 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0c6e0702-9e41-4e31-844e-915c46710cdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8529ed83a0164cbeb8b8bcf440208f21'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:56.052604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0c6e0702-9e41-4e31-844e-915c46710cdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8529ed83a0164cbeb8b8bcf440208f21'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:56.053073 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bd1d5-f3ad-4b05-8ddc-5cf1d21d931d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:56.054381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0c6e0702-9e41-4e31-844e-915c46710cdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8529ed83a0164cbeb8b8bcf440208f21'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:56.058246 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303bd1d5-f3ad-4b05-8ddc-5cf1d21d931d service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:56.087233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0c6e0702-9e41-4e31-844e-915c46710cdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8529ed83a0164cbeb8b8bcf440208f21'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:56.102587 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1117/2249] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:56.104122 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bd1d5-f3ad-4b05-8ddc-5cf1d21d931d service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:56.105827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-303bd1d5-f3ad-4b05-8ddc-5cf1d21d931d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:56.120267 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303bd1d5-f3ad-4b05-8ddc-5cf1d21d931d service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:56.125153 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b4044-2851-4a0d-bdf9-c2e36b7f4e51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:56.126012 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4044-2851-4a0d-bdf9-c2e36b7f4e51 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:56.126305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4044-2851-4a0d-bdf9-c2e36b7f4e51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:56.126588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4044-2851-4a0d-bdf9-c2e36b7f4e51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:56.128705 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-574b4044-2851-4a0d-bdf9-c2e36b7f4e51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:56.141285 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1133/2250] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:55 2022] DELETE /identity/v3/users/8529ed83a0164cbeb8b8bcf440208f21 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:56.147971 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b4044-2851-4a0d-bdf9-c2e36b7f4e51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:56.149563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b4044-2851-4a0d-bdf9-c2e36b7f4e51 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:56.184910 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1118/2251] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:56.345377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e0702-9e41-4e31-844e-915c46710cdd admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:56.347856 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0c6e0702-9e41-4e31-844e-915c46710cdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:56.426528 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:56.491851 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e0702-9e41-4e31-844e-915c46710cdd admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:56.505626 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be62b0-633e-4a94-932f-4568952dbdd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:56.507333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be62b0-633e-4a94-932f-4568952dbdd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:56.507779 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be62b0-633e-4a94-932f-4568952dbdd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:56.508259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be62b0-633e-4a94-932f-4568952dbdd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:56.510597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-02be62b0-633e-4a94-932f-4568952dbdd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:56.641046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be62b0-633e-4a94-932f-4568952dbdd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:56.661554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be62b0-633e-4a94-932f-4568952dbdd8 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:56.682532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1134/2252] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:35:57.033217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b4044-2851-4a0d-bdf9-c2e36b7f4e51 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:57.034859 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-574b4044-2851-4a0d-bdf9-c2e36b7f4e51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:57.049731 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b4044-2851-4a0d-bdf9-c2e36b7f4e51 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:57.141554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e50e8-7b6a-4bc5-9be0-c091a686fb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:57.142533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e50e8-7b6a-4bc5-9be0-c091a686fb03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:57.142820 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e50e8-7b6a-4bc5-9be0-c091a686fb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:57.143159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e50e8-7b6a-4bc5-9be0-c091a686fb03 admin admin] PATH_INFO: `/v3/users/78f0a521bd0348b4b76a32f1be8f6431` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:57.144447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e50e8-7b6a-4bc5-9be0-c091a686fb03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f0a521bd0348b4b76a32f1be8f6431)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:57.146647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e50e8-7b6a-4bc5-9be0-c091a686fb03 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:57.152430 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:57.158342 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be62b0-633e-4a94-932f-4568952dbdd8 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:57.159815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-02be62b0-633e-4a94-932f-4568952dbdd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:57.187433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be62b0-633e-4a94-932f-4568952dbdd8 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:57.203788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79bc10-04af-479c-9f71-ac8c0ec6a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:57.204820 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79bc10-04af-479c-9f71-ac8c0ec6a6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:57.205170 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79bc10-04af-479c-9f71-ac8c0ec6a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:57.205560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79bc10-04af-479c-9f71-ac8c0ec6a6f7 admin admin] PATH_INFO: `/v3/projects/90c2dea428e240119d1c18c77daa1dbb` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:57.206962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79bc10-04af-479c-9f71-ac8c0ec6a6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c2dea428e240119d1c18c77daa1dbb)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:57.209189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79bc10-04af-479c-9f71-ac8c0ec6a6f7 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:57.222394 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a08e50e8-7b6a-4bc5-9be0-c091a686fb03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f0a521bd0348b4b76a32f1be8f6431'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:57.241328 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a08e50e8-7b6a-4bc5-9be0-c091a686fb03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f0a521bd0348b4b76a32f1be8f6431'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:57.242034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a08e50e8-7b6a-4bc5-9be0-c091a686fb03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f0a521bd0348b4b76a32f1be8f6431'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:57.243332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a08e50e8-7b6a-4bc5-9be0-c091a686fb03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f0a521bd0348b4b76a32f1be8f6431'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:57.268645 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a08e50e8-7b6a-4bc5-9be0-c091a686fb03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f0a521bd0348b4b76a32f1be8f6431'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:57.294237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-be79bc10-04af-479c-9f71-ac8c0ec6a6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c2dea428e240119d1c18c77daa1dbb', 'request_id': 'req-be79bc10-04af-479c-9f71-ac8c0ec6a6f7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:57.315794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1119/2253] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:57 2022] DELETE /identity/v3/users/78f0a521bd0348b4b76a32f1be8f6431 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:57.319275 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-be79bc10-04af-479c-9f71-ac8c0ec6a6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c2dea428e240119d1c18c77daa1dbb', 'request_id': 'req-be79bc10-04af-479c-9f71-ac8c0ec6a6f7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:57.320209 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0713091-3e22-4ae9-a012-4c609bbfebdc None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:57.320505 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0713091-3e22-4ae9-a012-4c609bbfebdc None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:57.320786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0713091-3e22-4ae9-a012-4c609bbfebdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:57.327591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-be79bc10-04af-479c-9f71-ac8c0ec6a6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c2dea428e240119d1c18c77daa1dbb', 'request_id': 'req-be79bc10-04af-479c-9f71-ac8c0ec6a6f7'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:57.351361 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-be79bc10-04af-479c-9f71-ac8c0ec6a6f7 admin admin] The token cache is being invalidate because project 90c2dea428e240119d1c18c77daa1dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:57.352274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-be79bc10-04af-479c-9f71-ac8c0ec6a6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:57.354410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-be79bc10-04af-479c-9f71-ac8c0ec6a6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:57.369570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c0713091-3e22-4ae9-a012-4c609bbfebdc None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:57.372490 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c0713091-3e22-4ae9-a012-4c609bbfebdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:57.376280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1135/2254] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:57 2022] DELETE /identity/v3/projects/90c2dea428e240119d1c18c77daa1dbb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:57.378357 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f393b04-9b03-4db6-b338-ca719c44f36a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:57.378788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f393b04-9b03-4db6-b338-ca719c44f36a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:57.379308 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f393b04-9b03-4db6-b338-ca719c44f36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:57.440668 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1f393b04-9b03-4db6-b338-ca719c44f36a None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:57.441992 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1f393b04-9b03-4db6-b338-ca719c44f36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:57.517992 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1120/2255] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:57.530911 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1136/2256] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:57.539899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a9273-18d6-467a-83eb-eea112172047 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:57.541242 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a9273-18d6-467a-83eb-eea112172047 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:57.541324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a9273-18d6-467a-83eb-eea112172047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:57.578271 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f393b04-9b03-4db6-b338-ca719c44f36a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:57.579721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1f393b04-9b03-4db6-b338-ca719c44f36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:57.598116 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:57.610980 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-105a9273-18d6-467a-83eb-eea112172047 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:57.616094 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-105a9273-18d6-467a-83eb-eea112172047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:57.639754 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1121/2257] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:57.640789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a9273-18d6-467a-83eb-eea112172047 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:57.680680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a9273-18d6-467a-83eb-eea112172047 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:57.697238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce71927-d8ab-4c2a-92da-72b1d96c4854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:57.700028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce71927-d8ab-4c2a-92da-72b1d96c4854 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:57.700367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce71927-d8ab-4c2a-92da-72b1d96c4854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:57.700653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce71927-d8ab-4c2a-92da-72b1d96c4854 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:57.702918 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce71927-d8ab-4c2a-92da-72b1d96c4854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:35:57.703243 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce71927-d8ab-4c2a-92da-72b1d96c4854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:57.708415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce71927-d8ab-4c2a-92da-72b1d96c4854 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:57.754170 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f393b04-9b03-4db6-b338-ca719c44f36a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:57.755704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1122/2258] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:35:57.758464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce71927-d8ab-4c2a-92da-72b1d96c4854 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:57.762736 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66bf89-72f5-4476-994c-4a3a4d92b627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:57.763523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66bf89-72f5-4476-994c-4a3a4d92b627 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:57.763849 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66bf89-72f5-4476-994c-4a3a4d92b627 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:57.764234 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66bf89-72f5-4476-994c-4a3a4d92b627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:57.785125 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce71927-d8ab-4c2a-92da-72b1d96c4854 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:57.793978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66bf89-72f5-4476-994c-4a3a4d92b627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:57.795451 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66bf89-72f5-4476-994c-4a3a4d92b627 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:57.803840 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeebbac-9c15-4382-a493-44732512f337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:57.804530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeebbac-9c15-4382-a493-44732512f337 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:57.804842 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeebbac-9c15-4382-a493-44732512f337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:57.805184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeebbac-9c15-4382-a493-44732512f337 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:57.805974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeebbac-9c15-4382-a493-44732512f337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:57.807907 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeebbac-9c15-4382-a493-44732512f337 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:57.825152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1137/2259] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:35:57.858630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1123/2260] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:35:57 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:57.862162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66bf89-72f5-4476-994c-4a3a4d92b627 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:57.882069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66bf89-72f5-4476-994c-4a3a4d92b627 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:58.077008 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33ca68-a6a2-4ddd-adcc-b93c944966a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:58.077754 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33ca68-a6a2-4ddd-adcc-b93c944966a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:58.078044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33ca68-a6a2-4ddd-adcc-b93c944966a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:58.078323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33ca68-a6a2-4ddd-adcc-b93c944966a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:58.079084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33ca68-a6a2-4ddd-adcc-b93c944966a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:58.080953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33ca68-a6a2-4ddd-adcc-b93c944966a0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:58.134686 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1138/2261] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:35:57 2022] POST /identity/v3/users => generated 288 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:35:58.136965 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeebbac-9c15-4382-a493-44732512f337 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:58.166850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33ca68-a6a2-4ddd-adcc-b93c944966a0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:58.169554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-be33ca68-a6a2-4ddd-adcc-b93c944966a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:58.177692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeebbac-9c15-4382-a493-44732512f337 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:58.186086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b891d91-42bd-4cef-8e55-38819fed220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:58.191710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b891d91-42bd-4cef-8e55-38819fed220c admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:58.191710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b891d91-42bd-4cef-8e55-38819fed220c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:58.192143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b891d91-42bd-4cef-8e55-38819fed220c admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:58.194744 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b891d91-42bd-4cef-8e55-38819fed220c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:58.196765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b891d91-42bd-4cef-8e55-38819fed220c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:58.201842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33ca68-a6a2-4ddd-adcc-b93c944966a0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:58.213710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882881a0-6de8-49c0-b67a-ca3d35a66c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:58.215676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1124/2262] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:58.218401 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882881a0-6de8-49c0-b67a-ca3d35a66c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:58.218786 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882881a0-6de8-49c0-b67a-ca3d35a66c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:58.219324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b891d91-42bd-4cef-8e55-38819fed220c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:58.219632 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882881a0-6de8-49c0-b67a-ca3d35a66c75 admin admin] PATH_INFO: `/v3/projects/a90a80967b2b4adfbd79526a5296deb4` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:58.221712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882881a0-6de8-49c0-b67a-ca3d35a66c75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a90a80967b2b4adfbd79526a5296deb4)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:58.235296 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b891d91-42bd-4cef-8e55-38819fed220c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:58.241166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa69ef4-0762-4e1b-8b04-d090543672d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:58.242061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa69ef4-0762-4e1b-8b04-d090543672d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:58.242352 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa69ef4-0762-4e1b-8b04-d090543672d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:58.242769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa69ef4-0762-4e1b-8b04-d090543672d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:58.243524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa69ef4-0762-4e1b-8b04-d090543672d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:58.245431 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa69ef4-0762-4e1b-8b04-d090543672d5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:58.248727 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882881a0-6de8-49c0-b67a-ca3d35a66c75 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:58.256917 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1125/2263] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:35:58.261187 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa69ef4-0762-4e1b-8b04-d090543672d5 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:58.286090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa69ef4-0762-4e1b-8b04-d090543672d5 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:58.301784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221f8da-2fce-4eed-9fae-837cebd1c804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:58.306937 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221f8da-2fce-4eed-9fae-837cebd1c804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:58.307275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221f8da-2fce-4eed-9fae-837cebd1c804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:58.307978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221f8da-2fce-4eed-9fae-837cebd1c804 admin admin] PATH_INFO: `/v3/projects/e82195f25244464bab177cbd13112a10/users/b513f50c76d24e608eae5f0f3237c6aa/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:58.363759 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-882881a0-6de8-49c0-b67a-ca3d35a66c75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a90a80967b2b4adfbd79526a5296deb4', 'request_id': 'req-882881a0-6de8-49c0-b67a-ca3d35a66c75'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:58.378944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221f8da-2fce-4eed-9fae-837cebd1c804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82195f25244464bab177cbd13112a10, user_id=b513f50c76d24e608eae5f0f3237c6aa, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:58.382825 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221f8da-2fce-4eed-9fae-837cebd1c804 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:58.387334 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:58.389130 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-882881a0-6de8-49c0-b67a-ca3d35a66c75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a90a80967b2b4adfbd79526a5296deb4', 'request_id': 'req-882881a0-6de8-49c0-b67a-ca3d35a66c75'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:58.407157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1126/2264] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:35:58 2022] PUT /identity/v3/projects/e82195f25244464bab177cbd13112a10/users/b513f50c76d24e608eae5f0f3237c6aa/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:58.408308 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221f8da-2fce-4eed-9fae-837cebd1c804 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:58.411548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2221f8da-2fce-4eed-9fae-837cebd1c804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:58.418011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-882881a0-6de8-49c0-b67a-ca3d35a66c75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a90a80967b2b4adfbd79526a5296deb4', 'request_id': 'req-882881a0-6de8-49c0-b67a-ca3d35a66c75'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:58.434761 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-882881a0-6de8-49c0-b67a-ca3d35a66c75 admin admin] The token cache is being invalidate because project a90a80967b2b4adfbd79526a5296deb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:58.435087 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-882881a0-6de8-49c0-b67a-ca3d35a66c75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:58.437072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-882881a0-6de8-49c0-b67a-ca3d35a66c75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:58.441850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1139/2265] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:58 2022] DELETE /identity/v3/projects/a90a80967b2b4adfbd79526a5296deb4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:58.441850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6a582-c080-4aab-af79-560255fd2ce1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:58.441850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6a582-c080-4aab-af79-560255fd2ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:58.441850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6a582-c080-4aab-af79-560255fd2ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:58.485447 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-abf6a582-c080-4aab-af79-560255fd2ce1 None None] MFA Rules not processed for user `b513f50c76d24e608eae5f0f3237c6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:58.486665 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-abf6a582-c080-4aab-af79-560255fd2ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:58.499852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:58.518857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221f8da-2fce-4eed-9fae-837cebd1c804 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:58.526404 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c783504-97d9-4870-9a25-b150520371dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:58.528889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c783504-97d9-4870-9a25-b150520371dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:58.529480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c783504-97d9-4870-9a25-b150520371dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:58.530054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c783504-97d9-4870-9a25-b150520371dd admin admin] PATH_INFO: `/v3/projects/45500b2041194db2a5776817c032426b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:58.531615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c783504-97d9-4870-9a25-b150520371dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=45500b2041194db2a5776817c032426b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:58.534486 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c783504-97d9-4870-9a25-b150520371dd admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:58.585600 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1140/2266] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:58.586862 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6a582-c080-4aab-af79-560255fd2ce1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:58.588395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-abf6a582-c080-4aab-af79-560255fd2ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:58.616718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6a582-c080-4aab-af79-560255fd2ce1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:58.626539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3c783504-97d9-4870-9a25-b150520371dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45500b2041194db2a5776817c032426b', 'request_id': 'req-3c783504-97d9-4870-9a25-b150520371dd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:58.634098 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3c783504-97d9-4870-9a25-b150520371dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45500b2041194db2a5776817c032426b', 'request_id': 'req-3c783504-97d9-4870-9a25-b150520371dd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:58.642339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3c783504-97d9-4870-9a25-b150520371dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45500b2041194db2a5776817c032426b', 'request_id': 'req-3c783504-97d9-4870-9a25-b150520371dd'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:58.660772 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3c783504-97d9-4870-9a25-b150520371dd admin admin] The token cache is being invalidate because project 45500b2041194db2a5776817c032426b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:58.660976 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3c783504-97d9-4870-9a25-b150520371dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:58.662184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3c783504-97d9-4870-9a25-b150520371dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:58.666932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1127/2267] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:58 2022] DELETE /identity/v3/projects/45500b2041194db2a5776817c032426b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:58.668407 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf97991-fe09-4c35-8663-67951f7d6d66 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:58.668700 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf97991-fe09-4c35-8663-67951f7d6d66 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:58.668982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf97991-fe09-4c35-8663-67951f7d6d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:58.707674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2cf97991-fe09-4c35-8663-67951f7d6d66 None None] MFA Rules not processed for user `6486e63263a4417c93c5bc4c36bd925a`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:58.709138 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2cf97991-fe09-4c35-8663-67951f7d6d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:58.724635 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552da6f-2284-4258-9407-f7d08d540f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:58.726198 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552da6f-2284-4258-9407-f7d08d540f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:58.726494 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552da6f-2284-4258-9407-f7d08d540f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:58.727094 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552da6f-2284-4258-9407-f7d08d540f5f admin admin] PATH_INFO: `/v3/users/879b6fe6c11248008011b5f9707ca72c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:58.728481 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552da6f-2284-4258-9407-f7d08d540f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=879b6fe6c11248008011b5f9707ca72c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:58.730890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9552da6f-2284-4258-9407-f7d08d540f5f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:58.799652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9552da6f-2284-4258-9407-f7d08d540f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879b6fe6c11248008011b5f9707ca72c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:58.810114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9552da6f-2284-4258-9407-f7d08d540f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879b6fe6c11248008011b5f9707ca72c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:58.810925 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9552da6f-2284-4258-9407-f7d08d540f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879b6fe6c11248008011b5f9707ca72c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:58.811741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9552da6f-2284-4258-9407-f7d08d540f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879b6fe6c11248008011b5f9707ca72c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:58.829446 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-9552da6f-2284-4258-9407-f7d08d540f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879b6fe6c11248008011b5f9707ca72c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:58.852861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1141/2268] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:58 2022] DELETE /identity/v3/users/879b6fe6c11248008011b5f9707ca72c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:58.852861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552da6f-2284-4258-9407-f7d08d540f5f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:58.862300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9552da6f-2284-4258-9407-f7d08d540f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:58.872548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1128/2269] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:58.876645 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf97991-fe09-4c35-8663-67951f7d6d66 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:58.888658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2cf97991-fe09-4c35-8663-67951f7d6d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:58.922592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf97991-fe09-4c35-8663-67951f7d6d66 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:58.934497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:58.941299 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:58.982138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9552da6f-2284-4258-9407-f7d08d540f5f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:58.987319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f127cfd-f27d-406f-aa00-46a4cd9ff5d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:58.988313 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f127cfd-f27d-406f-aa00-46a4cd9ff5d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:58.988778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f127cfd-f27d-406f-aa00-46a4cd9ff5d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:58.989063 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f127cfd-f27d-406f-aa00-46a4cd9ff5d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:58.991969 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2f127cfd-f27d-406f-aa00-46a4cd9ff5d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:59.015312 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93e206-746e-40f9-bc48-cc55659c1b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:59.016217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93e206-746e-40f9-bc48-cc55659c1b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:59.018200 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93e206-746e-40f9-bc48-cc55659c1b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:59.018500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93e206-746e-40f9-bc48-cc55659c1b62 admin admin] PATH_INFO: `/v3/users/f80f698e941f4c5080a5f3d7ef7ae352` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:59.019836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93e206-746e-40f9-bc48-cc55659c1b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80f698e941f4c5080a5f3d7ef7ae352)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:59.022704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93e206-746e-40f9-bc48-cc55659c1b62 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:59.066306 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f127cfd-f27d-406f-aa00-46a4cd9ff5d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:59.070590 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f127cfd-f27d-406f-aa00-46a4cd9ff5d0 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:59.081241 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1e93e206-746e-40f9-bc48-cc55659c1b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80f698e941f4c5080a5f3d7ef7ae352'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:59.082485 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1142/2270] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:59.083816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cc9a9-aa5b-4198-85f3-8d356a3ef4e0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:59.084208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cc9a9-aa5b-4198-85f3-8d356a3ef4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:59.084585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cc9a9-aa5b-4198-85f3-8d356a3ef4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:59.091215 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1e93e206-746e-40f9-bc48-cc55659c1b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80f698e941f4c5080a5f3d7ef7ae352'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:59.092052 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1e93e206-746e-40f9-bc48-cc55659c1b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80f698e941f4c5080a5f3d7ef7ae352'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:59.092961 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1e93e206-746e-40f9-bc48-cc55659c1b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80f698e941f4c5080a5f3d7ef7ae352'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:59.109884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1e93e206-746e-40f9-bc48-cc55659c1b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80f698e941f4c5080a5f3d7ef7ae352'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:59.120982 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-857cc9a9-aa5b-4198-85f3-8d356a3ef4e0 None None] MFA Rules not processed for user `33d4efb515524324a8442438b3a9c7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:59.122895 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-857cc9a9-aa5b-4198-85f3-8d356a3ef4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:59.126144 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1129/2271] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:35:58 2022] DELETE /identity/v3/users/f80f698e941f4c5080a5f3d7ef7ae352 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:35:59.127417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93e206-746e-40f9-bc48-cc55659c1b62 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:59.128742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1e93e206-746e-40f9-bc48-cc55659c1b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:59.198570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93e206-746e-40f9-bc48-cc55659c1b62 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:59.203147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b64511-9a2c-4c22-aa2e-bc1765d5bc7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:59.203858 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b64511-9a2c-4c22-aa2e-bc1765d5bc7b service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:59.204210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b64511-9a2c-4c22-aa2e-bc1765d5bc7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:59.204433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b64511-9a2c-4c22-aa2e-bc1765d5bc7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:59.207288 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d3b64511-9a2c-4c22-aa2e-bc1765d5bc7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:59.209246 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1143/2272] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:35:59.314033 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:59.333861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b64511-9a2c-4c22-aa2e-bc1765d5bc7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:59.335534 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b64511-9a2c-4c22-aa2e-bc1765d5bc7b service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:59.346136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1130/2273] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:35:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:35:59.569516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cc9a9-aa5b-4198-85f3-8d356a3ef4e0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:59.571355 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-857cc9a9-aa5b-4198-85f3-8d356a3ef4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:59.594368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cc9a9-aa5b-4198-85f3-8d356a3ef4e0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:59.721854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518ebfc-6b24-4994-9688-cf3ee9499808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:35:59.724717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518ebfc-6b24-4994-9688-cf3ee9499808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:59.727398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518ebfc-6b24-4994-9688-cf3ee9499808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:59.727945 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518ebfc-6b24-4994-9688-cf3ee9499808 admin admin] PATH_INFO: `/v3/projects/ace7aa54bf6342cb88ba6319f28b4e72` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:59.732312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518ebfc-6b24-4994-9688-cf3ee9499808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace7aa54bf6342cb88ba6319f28b4e72)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:35:59.739643 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518ebfc-6b24-4994-9688-cf3ee9499808 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:35:59.812357 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:35:59.832521 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c518ebfc-6b24-4994-9688-cf3ee9499808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace7aa54bf6342cb88ba6319f28b4e72', 'request_id': 'req-c518ebfc-6b24-4994-9688-cf3ee9499808'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:59.848683 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c518ebfc-6b24-4994-9688-cf3ee9499808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace7aa54bf6342cb88ba6319f28b4e72', 'request_id': 'req-c518ebfc-6b24-4994-9688-cf3ee9499808'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:59.864593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c518ebfc-6b24-4994-9688-cf3ee9499808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace7aa54bf6342cb88ba6319f28b4e72', 'request_id': 'req-c518ebfc-6b24-4994-9688-cf3ee9499808'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:59.900216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b64511-9a2c-4c22-aa2e-bc1765d5bc7b service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:35:59.901732 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d3b64511-9a2c-4c22-aa2e-bc1765d5bc7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:35:59.905055 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c518ebfc-6b24-4994-9688-cf3ee9499808 admin admin] The token cache is being invalidate because project ace7aa54bf6342cb88ba6319f28b4e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:35:59.907596 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c518ebfc-6b24-4994-9688-cf3ee9499808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:59.908438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c518ebfc-6b24-4994-9688-cf3ee9499808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:35:59.912340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1144/2274] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:59 2022] DELETE /identity/v3/projects/ace7aa54bf6342cb88ba6319f28b4e72 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:35:59.928060 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c040733-77ab-40d3-9361-410038651772 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:35:59.928384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c040733-77ab-40d3-9361-410038651772 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:35:59.935689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c040733-77ab-40d3-9361-410038651772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:35:59.942991 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b64511-9a2c-4c22-aa2e-bc1765d5bc7b service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:35:59.991652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7c040733-77ab-40d3-9361-410038651772 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:35:59.993181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7c040733-77ab-40d3-9361-410038651772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:00.087483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e5ec5-beec-4e96-b821-7556a2245adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:00.089023 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e5ec5-beec-4e96-b821-7556a2245adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.089316 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e5ec5-beec-4e96-b821-7556a2245adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.089623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e5ec5-beec-4e96-b821-7556a2245adb admin admin] PATH_INFO: `/v3/projects/6279dd364492474c9ba72898b70d9698` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.093019 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e5ec5-beec-4e96-b821-7556a2245adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6279dd364492474c9ba72898b70d9698)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:00.095117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e5ec5-beec-4e96-b821-7556a2245adb admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:00.158533 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1145/2275] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:00.160231 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e944454-253d-4bde-89f3-e9c1ea61d603 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.169752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e944454-253d-4bde-89f3-e9c1ea61d603 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.170071 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e944454-253d-4bde-89f3-e9c1ea61d603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.202171 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3e944454-253d-4bde-89f3-e9c1ea61d603 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:00.202385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3a5e5ec5-beec-4e96-b821-7556a2245adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6279dd364492474c9ba72898b70d9698', 'request_id': 'req-3a5e5ec5-beec-4e96-b821-7556a2245adb'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:00.204326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3e944454-253d-4bde-89f3-e9c1ea61d603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:00.210807 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3a5e5ec5-beec-4e96-b821-7556a2245adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6279dd364492474c9ba72898b70d9698', 'request_id': 'req-3a5e5ec5-beec-4e96-b821-7556a2245adb'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:00.220136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3a5e5ec5-beec-4e96-b821-7556a2245adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6279dd364492474c9ba72898b70d9698', 'request_id': 'req-3a5e5ec5-beec-4e96-b821-7556a2245adb'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:00.238915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3a5e5ec5-beec-4e96-b821-7556a2245adb admin admin] The token cache is being invalidate because project 6279dd364492474c9ba72898b70d9698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:36:00.239895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3a5e5ec5-beec-4e96-b821-7556a2245adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:00.240740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3a5e5ec5-beec-4e96-b821-7556a2245adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:00.242901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1131/2276] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:35:59 2022] DELETE /identity/v3/projects/6279dd364492474c9ba72898b70d9698 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:36:00.249579 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ee601-c76b-475d-ab89-8fd48cfe0690 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.259199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ee601-c76b-475d-ab89-8fd48cfe0690 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.259787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ee601-c76b-475d-ab89-8fd48cfe0690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.294794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1146/2277] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:00.297616 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e944454-253d-4bde-89f3-e9c1ea61d603 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:00.306826 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-aa6ee601-c76b-475d-ab89-8fd48cfe0690 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:00.308239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-aa6ee601-c76b-475d-ab89-8fd48cfe0690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:00.309170 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e944454-253d-4bde-89f3-e9c1ea61d603 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:00.321772 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e83c41-1576-427a-a778-b2c7d8c4fa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:00.321772 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e83c41-1576-427a-a778-b2c7d8c4fa48 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.321772 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e83c41-1576-427a-a778-b2c7d8c4fa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.321772 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e83c41-1576-427a-a778-b2c7d8c4fa48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.322156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e83c41-1576-427a-a778-b2c7d8c4fa48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:36:00.322156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e83c41-1576-427a-a778-b2c7d8c4fa48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:00.322297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1132/2278] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:00.323417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e83c41-1576-427a-a778-b2c7d8c4fa48 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:00.325772 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161497c2-bd7e-4ab9-86ef-ea7e90de7477 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.326063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161497c2-bd7e-4ab9-86ef-ea7e90de7477 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.326369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161497c2-bd7e-4ab9-86ef-ea7e90de7477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.339570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1147/2279] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:36:00.343307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e83c41-1576-427a-a778-b2c7d8c4fa48 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:00.346786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-161497c2-bd7e-4ab9-86ef-ea7e90de7477 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:00.348223 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-161497c2-bd7e-4ab9-86ef-ea7e90de7477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:00.355593 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e83c41-1576-427a-a778-b2c7d8c4fa48 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:00.361244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1133/2280] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:00.362233 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161497c2-bd7e-4ab9-86ef-ea7e90de7477 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:00.364670 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef3ae0-c7a1-4f6b-996b-f50398d3c6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:00.365849 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3ae0-c7a1-4f6b-996b-f50398d3c6fa admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.366145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3ae0-c7a1-4f6b-996b-f50398d3c6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.366457 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3ae0-c7a1-4f6b-996b-f50398d3c6fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.367600 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef3ae0-c7a1-4f6b-996b-f50398d3c6fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:00.371663 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef3ae0-c7a1-4f6b-996b-f50398d3c6fa admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:00.372250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161497c2-bd7e-4ab9-86ef-ea7e90de7477 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:00.378319 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba258210-c5c4-4098-b416-2f9bf8c312f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:00.379149 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba258210-c5c4-4098-b416-2f9bf8c312f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.379443 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba258210-c5c4-4098-b416-2f9bf8c312f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.379722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba258210-c5c4-4098-b416-2f9bf8c312f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.380473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba258210-c5c4-4098-b416-2f9bf8c312f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:36:00.380793 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba258210-c5c4-4098-b416-2f9bf8c312f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:00.382707 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba258210-c5c4-4098-b416-2f9bf8c312f2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:00.404649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1148/2281] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:36:00 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:36:00.408840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef3ae0-c7a1-4f6b-996b-f50398d3c6fa admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:00.409410 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1134/2282] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:36:00.414425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba258210-c5c4-4098-b416-2f9bf8c312f2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:00.433579 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba258210-c5c4-4098-b416-2f9bf8c312f2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:00.450048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:00.505335 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef3ae0-c7a1-4f6b-996b-f50398d3c6fa admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:00.505704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:00.514512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cba89-bce0-4221-bdb1-84f6a570a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:00.514512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cba89-bce0-4221-bdb1-84f6a570a53b admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.514512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cba89-bce0-4221-bdb1-84f6a570a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.514512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cba89-bce0-4221-bdb1-84f6a570a53b admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.514880 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cba89-bce0-4221-bdb1-84f6a570a53b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:00.515615 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7cba89-bce0-4221-bdb1-84f6a570a53b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:00.546442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b44492-1080-45e5-8d09-33be89f9b842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:00.547582 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b44492-1080-45e5-8d09-33be89f9b842 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.548061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b44492-1080-45e5-8d09-33be89f9b842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.548514 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b44492-1080-45e5-8d09-33be89f9b842 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.549366 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b44492-1080-45e5-8d09-33be89f9b842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:00.552201 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b44492-1080-45e5-8d09-33be89f9b842 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:00.569817 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1149/2283] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:36:00 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:36:00.578372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cba89-bce0-4221-bdb1-84f6a570a53b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:00.596594 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cba89-bce0-4221-bdb1-84f6a570a53b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:00.609260 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05c1a8-3afd-4459-8bbd-b0a874cc2019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:00.609615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1135/2284] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:36:00 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:36:00.609714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05c1a8-3afd-4459-8bbd-b0a874cc2019 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.609714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05c1a8-3afd-4459-8bbd-b0a874cc2019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.610044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05c1a8-3afd-4459-8bbd-b0a874cc2019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.610289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b44492-1080-45e5-8d09-33be89f9b842 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:00.613107 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05c1a8-3afd-4459-8bbd-b0a874cc2019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:00.617911 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05c1a8-3afd-4459-8bbd-b0a874cc2019 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:00.640777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1150/2285] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:36:00.646095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05c1a8-3afd-4459-8bbd-b0a874cc2019 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:00.660031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05c1a8-3afd-4459-8bbd-b0a874cc2019 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:00.713757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b44492-1080-45e5-8d09-33be89f9b842 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:00.726934 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e93e1-62c3-4cc8-aeea-ec3c3aca1980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:00.728331 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e93e1-62c3-4cc8-aeea-ec3c3aca1980 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.728803 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e93e1-62c3-4cc8-aeea-ec3c3aca1980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.729503 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e93e1-62c3-4cc8-aeea-ec3c3aca1980 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.731396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e93e1-62c3-4cc8-aeea-ec3c3aca1980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:00.731776 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c2345-aeaf-4cf7-8d53-72b968d0f910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:00.732351 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c2345-aeaf-4cf7-8d53-72b968d0f910 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.732660 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c2345-aeaf-4cf7-8d53-72b968d0f910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.732938 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c2345-aeaf-4cf7-8d53-72b968d0f910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.733730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c2345-aeaf-4cf7-8d53-72b968d0f910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:00.735968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e93e1-62c3-4cc8-aeea-ec3c3aca1980 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:00.739410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c2345-aeaf-4cf7-8d53-72b968d0f910 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:00.768740 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1151/2286] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:00.769570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c2345-aeaf-4cf7-8d53-72b968d0f910 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:00.778292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1136/2287] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:36:00 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:00.789511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e93e1-62c3-4cc8-aeea-ec3c3aca1980 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:00.789675 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c2345-aeaf-4cf7-8d53-72b968d0f910 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:00.793844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b9a0d-3b4e-42f2-8c9b-35f6c8ba984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:00.794869 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b9a0d-3b4e-42f2-8c9b-35f6c8ba984e admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.795309 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b9a0d-3b4e-42f2-8c9b-35f6c8ba984e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.795598 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b9a0d-3b4e-42f2-8c9b-35f6c8ba984e admin admin] PATH_INFO: `/v3/projects/729d992ed262479f8470e9a8151f804b/users/c481b4d79d694b3a90cd07b9ef37c37a/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.801014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e93e1-62c3-4cc8-aeea-ec3c3aca1980 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:00.806330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd42670-c2ed-4434-97ec-1cd762726b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:00.807152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd42670-c2ed-4434-97ec-1cd762726b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.807437 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd42670-c2ed-4434-97ec-1cd762726b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.807712 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd42670-c2ed-4434-97ec-1cd762726b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.808702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd42670-c2ed-4434-97ec-1cd762726b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:00.810725 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd42670-c2ed-4434-97ec-1cd762726b17 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:00.817289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b9a0d-3b4e-42f2-8c9b-35f6c8ba984e admin admin] RBAC: Authorizing `identity:create_grant(project_id=729d992ed262479f8470e9a8151f804b, user_id=c481b4d79d694b3a90cd07b9ef37c37a, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:00.822769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b9a0d-3b4e-42f2-8c9b-35f6c8ba984e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:00.823272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1137/2288] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:36:00.827365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd42670-c2ed-4434-97ec-1cd762726b17 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:00.839540 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd42670-c2ed-4434-97ec-1cd762726b17 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:00.843595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1152/2289] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:36:00 2022] PUT /identity/v3/projects/729d992ed262479f8470e9a8151f804b/users/c481b4d79d694b3a90cd07b9ef37c37a/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:00.859514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec9844-370c-4d04-a25a-8c5c389748e5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.859807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec9844-370c-4d04-a25a-8c5c389748e5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.860084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec9844-370c-4d04-a25a-8c5c389748e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.915110 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-71ec9844-370c-4d04-a25a-8c5c389748e5 None None] MFA Rules not processed for user `c481b4d79d694b3a90cd07b9ef37c37a`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:00.916224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-71ec9844-370c-4d04-a25a-8c5c389748e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:00.940589 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e4df9-539e-41d0-9f06-38de73ebc2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:00.941780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e4df9-539e-41d0-9f06-38de73ebc2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.942288 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e4df9-539e-41d0-9f06-38de73ebc2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.942771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e4df9-539e-41d0-9f06-38de73ebc2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.943741 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e4df9-539e-41d0-9f06-38de73ebc2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:00.945691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e4df9-539e-41d0-9f06-38de73ebc2e4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:00.959861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1138/2290] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:36:00.963237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0c92f-12e6-4b3f-9d16-d323b7e89485 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:00.963237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0c92f-12e6-4b3f-9d16-d323b7e89485 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:00.963237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0c92f-12e6-4b3f-9d16-d323b7e89485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:00.983243 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-82b0c92f-12e6-4b3f-9d16-d323b7e89485 None None] MFA Rules not processed for user `6486e63263a4417c93c5bc4c36bd925a`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:00.984532 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-82b0c92f-12e6-4b3f-9d16-d323b7e89485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:01.002791 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1153/2291] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:01.006437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec9844-370c-4d04-a25a-8c5c389748e5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:01.017540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec9844-370c-4d04-a25a-8c5c389748e5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:01.024261 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70234d-4a10-4454-b33e-d46d7b0a16bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:01.025463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70234d-4a10-4454-b33e-d46d7b0a16bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:01.025760 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70234d-4a10-4454-b33e-d46d7b0a16bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:01.026178 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70234d-4a10-4454-b33e-d46d7b0a16bf admin admin] PATH_INFO: `/v3/projects/99ee436ed7bc4064ac7ef844c95ecf13/users/e00d14b0bc3f44ec93c7f8919166c745/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:01.029242 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:01.047020 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:01.049005 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70234d-4a10-4454-b33e-d46d7b0a16bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ee436ed7bc4064ac7ef844c95ecf13, user_id=e00d14b0bc3f44ec93c7f8919166c745, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:01.052265 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70234d-4a10-4454-b33e-d46d7b0a16bf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:01.057951 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1139/2292] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:01.059532 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0c92f-12e6-4b3f-9d16-d323b7e89485 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:01.074874 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0c92f-12e6-4b3f-9d16-d323b7e89485 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:01.077028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1154/2293] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:36:01 2022] PUT /identity/v3/projects/99ee436ed7bc4064ac7ef844c95ecf13/users/e00d14b0bc3f44ec93c7f8919166c745/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:01.088277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3685da-318d-463d-b785-66bd1bfba5d4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:01.088582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3685da-318d-463d-b785-66bd1bfba5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:01.088866 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3685da-318d-463d-b785-66bd1bfba5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:01.125290 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fd3685da-318d-463d-b785-66bd1bfba5d4 None None] MFA Rules not processed for user `e00d14b0bc3f44ec93c7f8919166c745`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:01.127578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fd3685da-318d-463d-b785-66bd1bfba5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:01.143451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7463c-a168-4bad-830a-001e43668b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:01.144127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7463c-a168-4bad-830a-001e43668b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:01.144413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7463c-a168-4bad-830a-001e43668b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:01.144723 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7463c-a168-4bad-830a-001e43668b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:01.145447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7463c-a168-4bad-830a-001e43668b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:01.147359 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7463c-a168-4bad-830a-001e43668b92 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:01.177390 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1140/2294] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:36:01 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:01.181066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7463c-a168-4bad-830a-001e43668b92 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:01.237629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1155/2295] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:36:01.251371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3685da-318d-463d-b785-66bd1bfba5d4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:01.253115 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fd3685da-318d-463d-b785-66bd1bfba5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:01.277709 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7463c-a168-4bad-830a-001e43668b92 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:01.288140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb38ee8-4e6b-463e-94b3-4e6f17bcbff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:01.289003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb38ee8-4e6b-463e-94b3-4e6f17bcbff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:01.289479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb38ee8-4e6b-463e-94b3-4e6f17bcbff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:01.289765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb38ee8-4e6b-463e-94b3-4e6f17bcbff9 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:01.291083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb38ee8-4e6b-463e-94b3-4e6f17bcbff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:01.293175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb38ee8-4e6b-463e-94b3-4e6f17bcbff9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:01.316604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1141/2296] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:36:01 2022] POST /identity/v3/users => generated 298 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:36:01.317643 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb38ee8-4e6b-463e-94b3-4e6f17bcbff9 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:01.319645 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-beb38ee8-4e6b-463e-94b3-4e6f17bcbff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:01.324174 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3685da-318d-463d-b785-66bd1bfba5d4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:01.333096 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb38ee8-4e6b-463e-94b3-4e6f17bcbff9 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:01.338099 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3f61f-515f-418b-988c-cc35031aef46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:01.338992 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3f61f-515f-418b-988c-cc35031aef46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:01.339279 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3f61f-515f-418b-988c-cc35031aef46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:01.339563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3f61f-515f-418b-988c-cc35031aef46 admin admin] PATH_INFO: `/v3/users/311b2854dde34d28a8d0863f24e97cbe` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:01.340779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3f61f-515f-418b-988c-cc35031aef46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=311b2854dde34d28a8d0863f24e97cbe)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:01.342816 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3f61f-515f-418b-988c-cc35031aef46 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:01.413248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aed1c2-167e-440d-a8dc-edee5e8aad12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:01.414618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aed1c2-167e-440d-a8dc-edee5e8aad12 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:01.414919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aed1c2-167e-440d-a8dc-edee5e8aad12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:01.415197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aed1c2-167e-440d-a8dc-edee5e8aad12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:01.422715 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-67d3f61f-515f-418b-988c-cc35031aef46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '311b2854dde34d28a8d0863f24e97cbe'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:01.434673 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-67d3f61f-515f-418b-988c-cc35031aef46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '311b2854dde34d28a8d0863f24e97cbe'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:01.435379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-67d3f61f-515f-418b-988c-cc35031aef46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '311b2854dde34d28a8d0863f24e97cbe'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:01.437982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-67d3f61f-515f-418b-988c-cc35031aef46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '311b2854dde34d28a8d0863f24e97cbe'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:01.452530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:01.454690 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-67d3f61f-515f-418b-988c-cc35031aef46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '311b2854dde34d28a8d0863f24e97cbe'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:01.472892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1142/2297] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:36:01 2022] DELETE /identity/v3/users/311b2854dde34d28a8d0863f24e97cbe => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:01.473883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3f61f-515f-418b-988c-cc35031aef46 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:01.478257 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-67d3f61f-515f-418b-988c-cc35031aef46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:01.489026 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:01.516075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aed1c2-167e-440d-a8dc-edee5e8aad12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:01.517949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aed1c2-167e-440d-a8dc-edee5e8aad12 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:01.527922 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1156/2298] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:36:01.529969 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a3dc-7088-4e70-9855-a8df404c12ed None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:01.530335 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a3dc-7088-4e70-9855-a8df404c12ed None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:01.530862 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a3dc-7088-4e70-9855-a8df404c12ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:01.558747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8009a3dc-7088-4e70-9855-a8df404c12ed None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:01.559863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8009a3dc-7088-4e70-9855-a8df404c12ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:01.581603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3f61f-515f-418b-988c-cc35031aef46 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:01.587383 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6810d-952c-4d7a-9523-e8a395daac37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:01.588199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6810d-952c-4d7a-9523-e8a395daac37 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:01.588498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6810d-952c-4d7a-9523-e8a395daac37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:01.588775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6810d-952c-4d7a-9523-e8a395daac37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:01.589884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6810d-952c-4d7a-9523-e8a395daac37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:01.591425 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6810d-952c-4d7a-9523-e8a395daac37 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:01.604824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1143/2299] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:01.604824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6810d-952c-4d7a-9523-e8a395daac37 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:01.606845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-89c6810d-952c-4d7a-9523-e8a395daac37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:01.619961 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6810d-952c-4d7a-9523-e8a395daac37 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:01.625405 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7ceb9-108a-4acc-a5af-b3fa3f26e76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:01.626266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7ceb9-108a-4acc-a5af-b3fa3f26e76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:01.626542 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7ceb9-108a-4acc-a5af-b3fa3f26e76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:01.626820 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7ceb9-108a-4acc-a5af-b3fa3f26e76e admin admin] PATH_INFO: `/v3/users/e00d14b0bc3f44ec93c7f8919166c745` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:01.628108 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7ceb9-108a-4acc-a5af-b3fa3f26e76e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00d14b0bc3f44ec93c7f8919166c745)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:01.628831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1157/2300] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:01.630153 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7ceb9-108a-4acc-a5af-b3fa3f26e76e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:01.632998 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009a3dc-7088-4e70-9855-a8df404c12ed None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:01.643470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009a3dc-7088-4e70-9855-a8df404c12ed None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:01.654100 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec576d-52a1-44ff-bfef-29e2ddbae92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:01.655999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec576d-52a1-44ff-bfef-29e2ddbae92a admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:01.656695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec576d-52a1-44ff-bfef-29e2ddbae92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:01.657294 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec576d-52a1-44ff-bfef-29e2ddbae92a admin admin] PATH_INFO: `/v3/projects/f6ed1f357d024088858ccb87d8da248f/users/cf8902dc4f0649be9658d5e32f2d02d9/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:01.676514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec576d-52a1-44ff-bfef-29e2ddbae92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ed1f357d024088858ccb87d8da248f, user_id=cf8902dc4f0649be9658d5e32f2d02d9, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:01.680223 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec576d-52a1-44ff-bfef-29e2ddbae92a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:01.697810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7cd7ceb9-108a-4acc-a5af-b3fa3f26e76e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00d14b0bc3f44ec93c7f8919166c745'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:01.699168 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1158/2301] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:36:01 2022] PUT /identity/v3/projects/f6ed1f357d024088858ccb87d8da248f/users/cf8902dc4f0649be9658d5e32f2d02d9/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:01.700019 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec576d-52a1-44ff-bfef-29e2ddbae92a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:01.701868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-02ec576d-52a1-44ff-bfef-29e2ddbae92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:01.710991 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7cd7ceb9-108a-4acc-a5af-b3fa3f26e76e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00d14b0bc3f44ec93c7f8919166c745'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:01.711680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7cd7ceb9-108a-4acc-a5af-b3fa3f26e76e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00d14b0bc3f44ec93c7f8919166c745'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:01.712526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7cd7ceb9-108a-4acc-a5af-b3fa3f26e76e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00d14b0bc3f44ec93c7f8919166c745'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:01.749622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-7cd7ceb9-108a-4acc-a5af-b3fa3f26e76e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00d14b0bc3f44ec93c7f8919166c745'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:01.763574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1144/2302] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:36:01 2022] DELETE /identity/v3/users/e00d14b0bc3f44ec93c7f8919166c745 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:01.764330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7ceb9-108a-4acc-a5af-b3fa3f26e76e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:01.765699 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7cd7ceb9-108a-4acc-a5af-b3fa3f26e76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:01.802690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec576d-52a1-44ff-bfef-29e2ddbae92a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:01.831729 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:01.857239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7ceb9-108a-4acc-a5af-b3fa3f26e76e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:01.869800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aed3da-b997-4c08-80b2-a202cab9c177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:01.870737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aed3da-b997-4c08-80b2-a202cab9c177 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:01.871206 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aed3da-b997-4c08-80b2-a202cab9c177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:01.871853 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aed3da-b997-4c08-80b2-a202cab9c177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:01.875413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66eeb0-e282-4e75-9896-804e6b090268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:01.875539 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aed3da-b997-4c08-80b2-a202cab9c177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:01.875620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66eeb0-e282-4e75-9896-804e6b090268 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:01.875620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66eeb0-e282-4e75-9896-804e6b090268 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:01.875620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66eeb0-e282-4e75-9896-804e6b090268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:01.877914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7d66eeb0-e282-4e75-9896-804e6b090268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:01.879573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aed3da-b997-4c08-80b2-a202cab9c177 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:01.896734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1145/2303] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:01.898811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b487da-feaa-429e-9635-fa3b4c09f0ef None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:01.899284 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b487da-feaa-429e-9635-fa3b4c09f0ef None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:01.900777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b487da-feaa-429e-9635-fa3b4c09f0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:01.915201 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66eeb0-e282-4e75-9896-804e6b090268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:01.916867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66eeb0-e282-4e75-9896-804e6b090268 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:01.931291 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a4b487da-feaa-429e-9635-fa3b4c09f0ef None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:01.932522 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a4b487da-feaa-429e-9635-fa3b4c09f0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:01.934749 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1159/2304] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:01.943187 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66eeb0-e282-4e75-9896-804e6b090268 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:01.953951 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1146/2305] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:01.966538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66eeb0-e282-4e75-9896-804e6b090268 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:01.971654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b487da-feaa-429e-9635-fa3b4c09f0ef None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:01.974272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a4b487da-feaa-429e-9635-fa3b4c09f0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:01.983414 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57268cdb-ba59-4225-bd22-951150340201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:01.985935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268cdb-ba59-4225-bd22-951150340201 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:01.986319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268cdb-ba59-4225-bd22-951150340201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:01.988149 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268cdb-ba59-4225-bd22-951150340201 admin admin] PATH_INFO: `/v3/projects/f6ed1f357d024088858ccb87d8da248f/users/cf8902dc4f0649be9658d5e32f2d02d9/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:01.991829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57268cdb-ba59-4225-bd22-951150340201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ed1f357d024088858ccb87d8da248f, user_id=cf8902dc4f0649be9658d5e32f2d02d9, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:01.996588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b487da-feaa-429e-9635-fa3b4c09f0ef None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:01.998560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57268cdb-ba59-4225-bd22-951150340201 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:02.005454 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a962e-c7fc-4336-b14c-f463e7c519cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:02.006422 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a962e-c7fc-4336-b14c-f463e7c519cb service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:02.007540 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a962e-c7fc-4336-b14c-f463e7c519cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:02.008705 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a962e-c7fc-4336-b14c-f463e7c519cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:02.026974 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1160/2306] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:36:01 2022] PUT /identity/v3/projects/f6ed1f357d024088858ccb87d8da248f/users/cf8902dc4f0649be9658d5e32f2d02d9/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:02.032342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a962e-c7fc-4336-b14c-f463e7c519cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:02.034219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a962e-c7fc-4336-b14c-f463e7c519cb service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:02.044146 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77e708-8189-4812-a963-03f8a8b2b7b4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:02.045937 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77e708-8189-4812-a963-03f8a8b2b7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:02.048028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77e708-8189-4812-a963-03f8a8b2b7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:02.068843 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1147/2307] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:36:02.083444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:02.147814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-bb77e708-8189-4812-a963-03f8a8b2b7b4 None None] MFA Rules not processed for user `cf8902dc4f0649be9658d5e32f2d02d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:02.149075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bb77e708-8189-4812-a963-03f8a8b2b7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:02.284900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1161/2308] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:02.299497 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a962e-c7fc-4336-b14c-f463e7c519cb service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:02.301282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-de6a962e-c7fc-4336-b14c-f463e7c519cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:02.391579 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a962e-c7fc-4336-b14c-f463e7c519cb service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:02.440177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77e708-8189-4812-a963-03f8a8b2b7b4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:02.442917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bb77e708-8189-4812-a963-03f8a8b2b7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:02.460892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d2ea8-1693-45b4-be8f-4661c2a921d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:02.461726 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d2ea8-1693-45b4-be8f-4661c2a921d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:02.462506 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d2ea8-1693-45b4-be8f-4661c2a921d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:02.462909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d2ea8-1693-45b4-be8f-4661c2a921d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:02.474721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d2ea8-1693-45b4-be8f-4661c2a921d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:02.476481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d2ea8-1693-45b4-be8f-4661c2a921d0 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:02.501014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1148/2309] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:02.542687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d2ea8-1693-45b4-be8f-4661c2a921d0 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:02.544314 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0d0d2ea8-1693-45b4-be8f-4661c2a921d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:02.611116 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77e708-8189-4812-a963-03f8a8b2b7b4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:02.617986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:02.619081 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:02.619602 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:02.619963 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53 admin admin] PATH_INFO: `/v3/projects/071e382339a842baa6493bbd46c26603` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:02.621445 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=071e382339a842baa6493bbd46c26603)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:02.623579 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:02.654965 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d2ea8-1693-45b4-be8f-4661c2a921d0 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:02.661460 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925fce0-2bb9-4598-979d-a35673d54915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:02.662529 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925fce0-2bb9-4598-979d-a35673d54915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:02.663613 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925fce0-2bb9-4598-979d-a35673d54915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:02.663902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925fce0-2bb9-4598-979d-a35673d54915 admin admin] PATH_INFO: `/v3/projects/99ee436ed7bc4064ac7ef844c95ecf13` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:02.666117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925fce0-2bb9-4598-979d-a35673d54915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ee436ed7bc4064ac7ef844c95ecf13)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:02.668482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925fce0-2bb9-4598-979d-a35673d54915 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:02.701012 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071e382339a842baa6493bbd46c26603', 'request_id': 'req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:02.710357 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071e382339a842baa6493bbd46c26603', 'request_id': 'req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:02.719658 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071e382339a842baa6493bbd46c26603', 'request_id': 'req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:02.724776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:02.742610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53 admin admin] The token cache is being invalidate because project 071e382339a842baa6493bbd46c26603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:36:02.743791 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:02.744747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:02.744876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1925fce0-2bb9-4598-979d-a35673d54915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ee436ed7bc4064ac7ef844c95ecf13', 'request_id': 'req-1925fce0-2bb9-4598-979d-a35673d54915'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:02.747117 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1162/2310] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:36:02 2022] DELETE /identity/v3/projects/071e382339a842baa6493bbd46c26603 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:36:02.748064 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:02.751344 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1925fce0-2bb9-4598-979d-a35673d54915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ee436ed7bc4064ac7ef844c95ecf13', 'request_id': 'req-1925fce0-2bb9-4598-979d-a35673d54915'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:02.752040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:02.758156 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1925fce0-2bb9-4598-979d-a35673d54915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ee436ed7bc4064ac7ef844c95ecf13', 'request_id': 'req-1925fce0-2bb9-4598-979d-a35673d54915'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:02.786366 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:02.790139 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1925fce0-2bb9-4598-979d-a35673d54915 admin admin] The token cache is being invalidate because project 99ee436ed7bc4064ac7ef844c95ecf13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:36:02.790457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1925fce0-2bb9-4598-979d-a35673d54915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:02.792722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1925fce0-2bb9-4598-979d-a35673d54915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:02.798441 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1149/2311] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:36:02 2022] DELETE /identity/v3/projects/99ee436ed7bc4064ac7ef844c95ecf13 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:02.804734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925fce0-2bb9-4598-979d-a35673d54915 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:02.811009 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1925fce0-2bb9-4598-979d-a35673d54915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:02.860663 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d932bea-ff44-4ff5-ba5b-95b5b579ea53 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:02.951470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925fce0-2bb9-4598-979d-a35673d54915 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:02.966022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d5c68-5eb8-4fd1-b58d-5f05be37354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:02.967685 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d5c68-5eb8-4fd1-b58d-5f05be37354a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:02.968720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d5c68-5eb8-4fd1-b58d-5f05be37354a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:02.969157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d5c68-5eb8-4fd1-b58d-5f05be37354a admin admin] PATH_INFO: `/v3/users/871652f2416645ab8029c257d326d8e4` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:02.971344 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d5c68-5eb8-4fd1-b58d-5f05be37354a admin admin] RBAC: Authorizing `identity:delete_user(user_id=871652f2416645ab8029c257d326d8e4)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:02.987968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d5c68-5eb8-4fd1-b58d-5f05be37354a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:02.999155 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bf6e1-f43b-4dc3-9f0d-a78ae928e432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:03.000142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bf6e1-f43b-4dc3-9f0d-a78ae928e432 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:03.000434 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bf6e1-f43b-4dc3-9f0d-a78ae928e432 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:03.000717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bf6e1-f43b-4dc3-9f0d-a78ae928e432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:03.002814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d66bf6e1-f43b-4dc3-9f0d-a78ae928e432 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:03.081974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-158d5c68-5eb8-4fd1-b58d-5f05be37354a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '871652f2416645ab8029c257d326d8e4'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:03.094441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bf6e1-f43b-4dc3-9f0d-a78ae928e432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:03.094611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-158d5c68-5eb8-4fd1-b58d-5f05be37354a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '871652f2416645ab8029c257d326d8e4'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:03.096188 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-158d5c68-5eb8-4fd1-b58d-5f05be37354a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '871652f2416645ab8029c257d326d8e4'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:03.096355 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bf6e1-f43b-4dc3-9f0d-a78ae928e432 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:03.096958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-158d5c68-5eb8-4fd1-b58d-5f05be37354a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '871652f2416645ab8029c257d326d8e4'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:03.108377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1163/2312] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:03.110018 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0fc6b-3c7b-4502-a358-fa974d3d7718 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:03.110320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0fc6b-3c7b-4502-a358-fa974d3d7718 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:03.110611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0fc6b-3c7b-4502-a358-fa974d3d7718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:03.112061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-158d5c68-5eb8-4fd1-b58d-5f05be37354a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '871652f2416645ab8029c257d326d8e4'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:03.134087 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e1e0fc6b-3c7b-4502-a358-fa974d3d7718 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:03.135323 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e1e0fc6b-3c7b-4502-a358-fa974d3d7718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:03.143417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1150/2313] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:36:02 2022] DELETE /identity/v3/users/871652f2416645ab8029c257d326d8e4 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:03.245548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1164/2314] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:03.255511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434aa0b-66da-4b31-bfbd-fe755e22b82e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:03.256136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434aa0b-66da-4b31-bfbd-fe755e22b82e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:03.256735 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434aa0b-66da-4b31-bfbd-fe755e22b82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:03.288776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-3434aa0b-66da-4b31-bfbd-fe755e22b82e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:03.290116 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3434aa0b-66da-4b31-bfbd-fe755e22b82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:03.314441 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1151/2315] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:36:03.317242 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0fc6b-3c7b-4502-a358-fa974d3d7718 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:03.333821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0fc6b-3c7b-4502-a358-fa974d3d7718 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:03.346683 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f87ef1-832d-45e5-bea2-8402c6a2a757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:03.347463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f87ef1-832d-45e5-bea2-8402c6a2a757 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:03.348053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f87ef1-832d-45e5-bea2-8402c6a2a757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:03.348344 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f87ef1-832d-45e5-bea2-8402c6a2a757 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:03.349099 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f87ef1-832d-45e5-bea2-8402c6a2a757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:36:03.352037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f87ef1-832d-45e5-bea2-8402c6a2a757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:03.353714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f87ef1-832d-45e5-bea2-8402c6a2a757 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:03.380093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1165/2316] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:36:03.384885 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434aa0b-66da-4b31-bfbd-fe755e22b82e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:03.402568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434aa0b-66da-4b31-bfbd-fe755e22b82e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:03.409289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c53adb-6b46-469c-8232-6a028a935785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:03.410966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c53adb-6b46-469c-8232-6a028a935785 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:03.411333 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c53adb-6b46-469c-8232-6a028a935785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:03.411671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c53adb-6b46-469c-8232-6a028a935785 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:03.412641 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c53adb-6b46-469c-8232-6a028a935785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:03.418206 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c53adb-6b46-469c-8232-6a028a935785 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:03.471137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1152/2317] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:36:03 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:03.475478 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f87ef1-832d-45e5-bea2-8402c6a2a757 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:03.491155 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f87ef1-832d-45e5-bea2-8402c6a2a757 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:03.526019 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:03.655266 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797f3df-7e0e-4e87-9fe7-dd861a4899bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:03.655966 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797f3df-7e0e-4e87-9fe7-dd861a4899bc admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:03.656257 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797f3df-7e0e-4e87-9fe7-dd861a4899bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:03.656532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797f3df-7e0e-4e87-9fe7-dd861a4899bc admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:03.658075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797f3df-7e0e-4e87-9fe7-dd861a4899bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:03.665895 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797f3df-7e0e-4e87-9fe7-dd861a4899bc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:03.699549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1166/2318] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:36:03 2022] POST /identity/v3/users => generated 288 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:03.704211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c53adb-6b46-469c-8232-6a028a935785 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:03.716212 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c53adb-6b46-469c-8232-6a028a935785 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:03.722032 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96fde4-bf93-4e92-b8a6-faaec5fcbaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:03.723138 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96fde4-bf93-4e92-b8a6-faaec5fcbaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:03.723455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96fde4-bf93-4e92-b8a6-faaec5fcbaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:03.723768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96fde4-bf93-4e92-b8a6-faaec5fcbaf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:03.724586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96fde4-bf93-4e92-b8a6-faaec5fcbaf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:03.726493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96fde4-bf93-4e92-b8a6-faaec5fcbaf2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:03.729511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:03.750167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1153/2319] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:03.751309 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797f3df-7e0e-4e87-9fe7-dd861a4899bc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:03.763805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797f3df-7e0e-4e87-9fe7-dd861a4899bc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:03.769560 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96fde4-bf93-4e92-b8a6-faaec5fcbaf2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:03.771784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8c96fde4-bf93-4e92-b8a6-faaec5fcbaf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:03.791155 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd3cc-2f90-44c9-b0ed-35c159e45cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:03.791897 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd3cc-2f90-44c9-b0ed-35c159e45cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:03.792256 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd3cc-2f90-44c9-b0ed-35c159e45cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:03.792604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd3cc-2f90-44c9-b0ed-35c159e45cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:03.793552 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edd3cc-2f90-44c9-b0ed-35c159e45cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:03.795413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edd3cc-2f90-44c9-b0ed-35c159e45cf9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:03.796993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96fde4-bf93-4e92-b8a6-faaec5fcbaf2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:03.802577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5d691-c6e8-407a-a0bc-d7ad8d583a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:03.803775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5d691-c6e8-407a-a0bc-d7ad8d583a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:03.804277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5d691-c6e8-407a-a0bc-d7ad8d583a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:03.804739 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5d691-c6e8-407a-a0bc-d7ad8d583a15 admin admin] PATH_INFO: `/v3/projects/a7d040da08c244a3932f759ac198eeb6` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:03.806481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5d691-c6e8-407a-a0bc-d7ad8d583a15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7d040da08c244a3932f759ac198eeb6)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:03.809480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5d691-c6e8-407a-a0bc-d7ad8d583a15 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:03.814030 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1167/2320] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:36:03.818282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd3cc-2f90-44c9-b0ed-35c159e45cf9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:03.837321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd3cc-2f90-44c9-b0ed-35c159e45cf9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:03.844797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b9d26-a27b-4a77-ac6f-30b00418b0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:03.846209 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b9d26-a27b-4a77-ac6f-30b00418b0db admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:03.846607 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b9d26-a27b-4a77-ac6f-30b00418b0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:03.846786 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b9d26-a27b-4a77-ac6f-30b00418b0db admin admin] PATH_INFO: `/v3/projects/d2b6527a723a4dedada56f282f32023e/users/302f6f50262b49aea0981928b74970e4/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:03.884884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a7d5d691-c6e8-407a-a0bc-d7ad8d583a15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7d040da08c244a3932f759ac198eeb6', 'request_id': 'req-a7d5d691-c6e8-407a-a0bc-d7ad8d583a15'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:03.888351 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b9d26-a27b-4a77-ac6f-30b00418b0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b6527a723a4dedada56f282f32023e, user_id=302f6f50262b49aea0981928b74970e4, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:03.893086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b9d26-a27b-4a77-ac6f-30b00418b0db admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:03.893825 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a7d5d691-c6e8-407a-a0bc-d7ad8d583a15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7d040da08c244a3932f759ac198eeb6', 'request_id': 'req-a7d5d691-c6e8-407a-a0bc-d7ad8d583a15'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:03.903865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a7d5d691-c6e8-407a-a0bc-d7ad8d583a15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7d040da08c244a3932f759ac198eeb6', 'request_id': 'req-a7d5d691-c6e8-407a-a0bc-d7ad8d583a15'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:03.926422 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a7d5d691-c6e8-407a-a0bc-d7ad8d583a15 admin admin] The token cache is being invalidate because project a7d040da08c244a3932f759ac198eeb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:36:03.926725 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a7d5d691-c6e8-407a-a0bc-d7ad8d583a15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:03.928063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a7d5d691-c6e8-407a-a0bc-d7ad8d583a15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:03.929486 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1168/2321] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:36:03 2022] PUT /identity/v3/projects/d2b6527a723a4dedada56f282f32023e/users/302f6f50262b49aea0981928b74970e4/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:36:03.932849 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1154/2322] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:36:03 2022] DELETE /identity/v3/projects/a7d040da08c244a3932f759ac198eeb6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:03.934215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b9d26-a27b-4a77-ac6f-30b00418b0db admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:03.936693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3b2b9d26-a27b-4a77-ac6f-30b00418b0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:03.941044 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e9442-f91d-45f7-9ca5-42ff682a9c89 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:03.941702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e9442-f91d-45f7-9ca5-42ff682a9c89 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:03.942804 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e9442-f91d-45f7-9ca5-42ff682a9c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:03.981734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-0b9e9442-f91d-45f7-9ca5-42ff682a9c89 None None] MFA Rules not processed for user `302f6f50262b49aea0981928b74970e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:03.983779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0b9e9442-f91d-45f7-9ca5-42ff682a9c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:04.030112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b9d26-a27b-4a77-ac6f-30b00418b0db admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:04.036449 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085030a7-3555-4166-8260-02325e38b614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:04.037772 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085030a7-3555-4166-8260-02325e38b614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:04.038257 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085030a7-3555-4166-8260-02325e38b614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:04.038605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085030a7-3555-4166-8260-02325e38b614 admin admin] PATH_INFO: `/v3/users/456dc2e0bced4af9be80c2bee8261277` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:04.039957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085030a7-3555-4166-8260-02325e38b614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=456dc2e0bced4af9be80c2bee8261277)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:04.042813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085030a7-3555-4166-8260-02325e38b614 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:04.114317 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1155/2323] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:36:04.126999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e9442-f91d-45f7-9ca5-42ff682a9c89 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:04.132604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0b9e9442-f91d-45f7-9ca5-42ff682a9c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:04.159034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-085030a7-3555-4166-8260-02325e38b614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '456dc2e0bced4af9be80c2bee8261277'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:04.178613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-085030a7-3555-4166-8260-02325e38b614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '456dc2e0bced4af9be80c2bee8261277'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:04.180510 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-085030a7-3555-4166-8260-02325e38b614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '456dc2e0bced4af9be80c2bee8261277'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:04.181689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-085030a7-3555-4166-8260-02325e38b614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '456dc2e0bced4af9be80c2bee8261277'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:04.216774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-085030a7-3555-4166-8260-02325e38b614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '456dc2e0bced4af9be80c2bee8261277'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:04.220574 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:04.239771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e9442-f91d-45f7-9ca5-42ff682a9c89 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:04.242280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1169/2324] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:36:03 2022] DELETE /identity/v3/users/456dc2e0bced4af9be80c2bee8261277 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:04.269304 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:04.299316 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b479f2-a283-4351-985c-9a977f888d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:04.300225 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b479f2-a283-4351-985c-9a977f888d5d service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:04.300524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b479f2-a283-4351-985c-9a977f888d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:04.300849 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b479f2-a283-4351-985c-9a977f888d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:04.302847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-20b479f2-a283-4351-985c-9a977f888d5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:04.370966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b479f2-a283-4351-985c-9a977f888d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:04.372919 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b479f2-a283-4351-985c-9a977f888d5d service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:04.386735 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1156/2325] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:36:05.060020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085030a7-3555-4166-8260-02325e38b614 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:05.061605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-085030a7-3555-4166-8260-02325e38b614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:05.090641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085030a7-3555-4166-8260-02325e38b614 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:05.096390 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738419f-e368-49ab-b818-6cec3863538a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:05.097327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738419f-e368-49ab-b818-6cec3863538a service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:05.097770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738419f-e368-49ab-b818-6cec3863538a service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:05.098116 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738419f-e368-49ab-b818-6cec3863538a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:05.100041 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b738419f-e368-49ab-b818-6cec3863538a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:05.198270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738419f-e368-49ab-b818-6cec3863538a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:05.200090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738419f-e368-49ab-b818-6cec3863538a service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:05.216142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1170/2326] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:05 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:05.481526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b479f2-a283-4351-985c-9a977f888d5d service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:05.483523 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-20b479f2-a283-4351-985c-9a977f888d5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:05.598757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b479f2-a283-4351-985c-9a977f888d5d service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:05.603722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e1d93-ca4b-43b4-b1e0-8dccb36c6d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:05.604972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1d93-ca4b-43b4-b1e0-8dccb36c6d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:05.605649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1d93-ca4b-43b4-b1e0-8dccb36c6d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:05.606312 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e1d93-ca4b-43b4-b1e0-8dccb36c6d27 admin admin] PATH_INFO: `/v3/projects/0e587faaaf87425cbc467f4a695c3b8b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:05.607845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e1d93-ca4b-43b4-b1e0-8dccb36c6d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e587faaaf87425cbc467f4a695c3b8b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:05.609620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e1d93-ca4b-43b4-b1e0-8dccb36c6d27 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:05.669434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-aa6e1d93-ca4b-43b4-b1e0-8dccb36c6d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e587faaaf87425cbc467f4a695c3b8b', 'request_id': 'req-aa6e1d93-ca4b-43b4-b1e0-8dccb36c6d27'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:05.676559 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-aa6e1d93-ca4b-43b4-b1e0-8dccb36c6d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e587faaaf87425cbc467f4a695c3b8b', 'request_id': 'req-aa6e1d93-ca4b-43b4-b1e0-8dccb36c6d27'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:05.685037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-aa6e1d93-ca4b-43b4-b1e0-8dccb36c6d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e587faaaf87425cbc467f4a695c3b8b', 'request_id': 'req-aa6e1d93-ca4b-43b4-b1e0-8dccb36c6d27'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:05.704940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-aa6e1d93-ca4b-43b4-b1e0-8dccb36c6d27 admin admin] The token cache is being invalidate because project 0e587faaaf87425cbc467f4a695c3b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:36:05.705564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-aa6e1d93-ca4b-43b4-b1e0-8dccb36c6d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:05.706350 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-aa6e1d93-ca4b-43b4-b1e0-8dccb36c6d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:05.708313 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1157/2327] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:36:05 2022] DELETE /identity/v3/projects/0e587faaaf87425cbc467f4a695c3b8b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:05.715077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bf067-eaf6-4ec6-ab62-6dbd1a095092 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:05.715370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bf067-eaf6-4ec6-ab62-6dbd1a095092 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:05.715700 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bf067-eaf6-4ec6-ab62-6dbd1a095092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:05.742849 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-bd8bf067-eaf6-4ec6-ab62-6dbd1a095092 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:05.744293 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-bd8bf067-eaf6-4ec6-ab62-6dbd1a095092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:05.859955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1171/2328] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:05.868368 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530dbd3-c3bd-4f5f-a172-56bbe491bcfe None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:05.868905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530dbd3-c3bd-4f5f-a172-56bbe491bcfe None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:05.869279 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530dbd3-c3bd-4f5f-a172-56bbe491bcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:05.913739 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c530dbd3-c3bd-4f5f-a172-56bbe491bcfe None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:05.913739 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c530dbd3-c3bd-4f5f-a172-56bbe491bcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:05.929789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1158/2329] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:05.930961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bf067-eaf6-4ec6-ab62-6dbd1a095092 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:05.950539 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bf067-eaf6-4ec6-ab62-6dbd1a095092 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:05.974430 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2b59b-4983-4bf0-a223-ddbaedd1f845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:05.992924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2b59b-4983-4bf0-a223-ddbaedd1f845 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:05.993381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2b59b-4983-4bf0-a223-ddbaedd1f845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:05.993721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2b59b-4983-4bf0-a223-ddbaedd1f845 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:05.996815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2b59b-4983-4bf0-a223-ddbaedd1f845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:36:05.997978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2b59b-4983-4bf0-a223-ddbaedd1f845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:06.002321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2b59b-4983-4bf0-a223-ddbaedd1f845 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:06.047946 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530dbd3-c3bd-4f5f-a172-56bbe491bcfe None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:06.055035 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1172/2330] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:36:06.056684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:06.083554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530dbd3-c3bd-4f5f-a172-56bbe491bcfe None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:06.101834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc803db7-3a44-45e6-a9f3-546ce2f62bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:06.106780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc803db7-3a44-45e6-a9f3-546ce2f62bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:06.108455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc803db7-3a44-45e6-a9f3-546ce2f62bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:06.111828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc803db7-3a44-45e6-a9f3-546ce2f62bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:06.112716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc803db7-3a44-45e6-a9f3-546ce2f62bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:06.119244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc803db7-3a44-45e6-a9f3-546ce2f62bc8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:06.221475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1159/2331] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:36:06 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:06.225847 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2b59b-4983-4bf0-a223-ddbaedd1f845 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:06.238833 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2b59b-4983-4bf0-a223-ddbaedd1f845 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:06.277877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1493438-824a-48ed-a83b-d5ee460ecb3f None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:06.278170 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1493438-824a-48ed-a83b-d5ee460ecb3f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:06.278451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1493438-824a-48ed-a83b-d5ee460ecb3f None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:06.280103 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1160/2332] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 15 00:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:36:06.305790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dded1-e699-4fb2-982a-d02cf0800db4 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:06.306130 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dded1-e699-4fb2-982a-d02cf0800db4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:06.306343 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624dded1-e699-4fb2-982a-d02cf0800db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:06.351139 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-624dded1-e699-4fb2-982a-d02cf0800db4 None None] MFA Rules not processed for user `6d0ae1707c7041a0989889dbefeaf267`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:06.352293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-624dded1-e699-4fb2-982a-d02cf0800db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:06.406870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9f645-c173-46bc-a999-999afb795a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:06.408943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9f645-c173-46bc-a999-999afb795a1f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:06.409387 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9f645-c173-46bc-a999-999afb795a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:06.410273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9f645-c173-46bc-a999-999afb795a1f admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:06.411938 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9f645-c173-46bc-a999-999afb795a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:06.421238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9f645-c173-46bc-a999-999afb795a1f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:06.466121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1173/2333] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:36:06 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:06.468745 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9f645-c173-46bc-a999-999afb795a1f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:06.477270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a8c9f645-c173-46bc-a999-999afb795a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:06.492808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:06.505568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9f645-c173-46bc-a999-999afb795a1f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:06.521327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51cf4f-7080-44e4-9ad2-804f800a165b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:06.524454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51cf4f-7080-44e4-9ad2-804f800a165b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:06.524748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51cf4f-7080-44e4-9ad2-804f800a165b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:06.525032 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51cf4f-7080-44e4-9ad2-804f800a165b admin admin] PATH_INFO: `/v3/users/c481b4d79d694b3a90cd07b9ef37c37a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:06.529264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51cf4f-7080-44e4-9ad2-804f800a165b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c481b4d79d694b3a90cd07b9ef37c37a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:06.533376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1161/2334] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 15 00:36:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:36:06.537859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51cf4f-7080-44e4-9ad2-804f800a165b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:06.538011 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dded1-e699-4fb2-982a-d02cf0800db4 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:06.569500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624dded1-e699-4fb2-982a-d02cf0800db4 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:06.574838 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd0b00-ac0e-4268-b59f-cea139ce97b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:06.575526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0b00-ac0e-4268-b59f-cea139ce97b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:06.575953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0b00-ac0e-4268-b59f-cea139ce97b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:06.576237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd0b00-ac0e-4268-b59f-cea139ce97b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:06.577146 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd0b00-ac0e-4268-b59f-cea139ce97b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:06.579502 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd0b00-ac0e-4268-b59f-cea139ce97b6 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:06.598815 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1162/2335] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:06.604656 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd0b00-ac0e-4268-b59f-cea139ce97b6 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:06.632796 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd0b00-ac0e-4268-b59f-cea139ce97b6 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:06.638191 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4cbef-d0c3-4bfb-a7b3-d27190f54ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:06.638886 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4cbef-d0c3-4bfb-a7b3-d27190f54ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:06.639169 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4cbef-d0c3-4bfb-a7b3-d27190f54ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:06.639447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4cbef-d0c3-4bfb-a7b3-d27190f54ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:06.640288 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4cbef-d0c3-4bfb-a7b3-d27190f54ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:06.642401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4cbef-d0c3-4bfb-a7b3-d27190f54ea0 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:06.644838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ba51cf4f-7080-44e4-9ad2-804f800a165b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c481b4d79d694b3a90cd07b9ef37c37a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:06.660004 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ba51cf4f-7080-44e4-9ad2-804f800a165b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c481b4d79d694b3a90cd07b9ef37c37a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:06.660820 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1163/2336] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:06.664136 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ba51cf4f-7080-44e4-9ad2-804f800a165b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c481b4d79d694b3a90cd07b9ef37c37a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:06.665267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ba51cf4f-7080-44e4-9ad2-804f800a165b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c481b4d79d694b3a90cd07b9ef37c37a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:06.666023 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4cbef-d0c3-4bfb-a7b3-d27190f54ea0 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:06.671502 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-57c4cbef-d0c3-4bfb-a7b3-d27190f54ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:06.679902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-ba51cf4f-7080-44e4-9ad2-804f800a165b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c481b4d79d694b3a90cd07b9ef37c37a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:06.705550 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1174/2337] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:36:06 2022] DELETE /identity/v3/users/c481b4d79d694b3a90cd07b9ef37c37a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:06.706041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4cbef-d0c3-4bfb-a7b3-d27190f54ea0 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:06.711253 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ede6-2d5b-4eff-9211-329d949d993f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:06.711550 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ede6-2d5b-4eff-9211-329d949d993f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:06.711836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69ede6-2d5b-4eff-9211-329d949d993f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:06.745516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8e69ede6-2d5b-4eff-9211-329d949d993f None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:06.746750 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8e69ede6-2d5b-4eff-9211-329d949d993f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:06.818659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1175/2338] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:06.826268 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69ede6-2d5b-4eff-9211-329d949d993f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:06.827738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8e69ede6-2d5b-4eff-9211-329d949d993f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:06.875583 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71648646-d3e5-4d53-ad6e-6e00b17401c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:06.876575 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71648646-d3e5-4d53-ad6e-6e00b17401c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:06.876960 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71648646-d3e5-4d53-ad6e-6e00b17401c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:06.877302 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71648646-d3e5-4d53-ad6e-6e00b17401c7 admin admin] PATH_INFO: `/v3/projects/ccc0ab8c84c0468f81b6dada81c3cea2/users/6586c9aa3c984b9b963a2e2c583ef7bf/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:06.918490 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71648646-d3e5-4d53-ad6e-6e00b17401c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc0ab8c84c0468f81b6dada81c3cea2, user_id=6586c9aa3c984b9b963a2e2c583ef7bf, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:06.923881 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71648646-d3e5-4d53-ad6e-6e00b17401c7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:06.954027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1164/2339] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:36:06 2022] PUT /identity/v3/projects/ccc0ab8c84c0468f81b6dada81c3cea2/users/6586c9aa3c984b9b963a2e2c583ef7bf/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:06.959482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab6102-dce3-4d70-88c8-2e0e861fd939 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:06.959884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab6102-dce3-4d70-88c8-2e0e861fd939 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:06.960259 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab6102-dce3-4d70-88c8-2e0e861fd939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:06.966372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69ede6-2d5b-4eff-9211-329d949d993f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:07.008522 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:07.013910 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-3fab6102-dce3-4d70-88c8-2e0e861fd939 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:07.015459 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3fab6102-dce3-4d70-88c8-2e0e861fd939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:07.043611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cd3cd-fca3-4695-a276-b203b201e647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:07.045165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cd3cd-fca3-4695-a276-b203b201e647 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:07.045655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cd3cd-fca3-4695-a276-b203b201e647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:07.046110 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cd3cd-fca3-4695-a276-b203b201e647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:07.088455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:07.120892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1165/2340] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:36:07.125864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab6102-dce3-4d70-88c8-2e0e861fd939 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:07.128183 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3fab6102-dce3-4d70-88c8-2e0e861fd939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:07.181968 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cd3cd-fca3-4695-a276-b203b201e647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:07.184775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cd3cd-fca3-4695-a276-b203b201e647 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:07.196642 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1176/2341] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:07.197657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cd3cd-fca3-4695-a276-b203b201e647 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:07.199187 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-759cd3cd-fca3-4695-a276-b203b201e647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:07.214882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cd3cd-fca3-4695-a276-b203b201e647 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:07.220063 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9645b-b9bf-4380-adbe-ea7b499230b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:07.220791 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9645b-b9bf-4380-adbe-ea7b499230b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:07.221450 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9645b-b9bf-4380-adbe-ea7b499230b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:07.221821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9645b-b9bf-4380-adbe-ea7b499230b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:07.237214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9645b-b9bf-4380-adbe-ea7b499230b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:07.239036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9645b-b9bf-4380-adbe-ea7b499230b8 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:07.251867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1177/2342] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:07.267608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab6102-dce3-4d70-88c8-2e0e861fd939 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:07.286889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41018f57-6a8c-4ac5-a427-c118aa201c47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:07.288495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41018f57-6a8c-4ac5-a427-c118aa201c47 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:07.288829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41018f57-6a8c-4ac5-a427-c118aa201c47 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:07.289100 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41018f57-6a8c-4ac5-a427-c118aa201c47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:07.292692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-41018f57-6a8c-4ac5-a427-c118aa201c47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:07.306917 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41018f57-6a8c-4ac5-a427-c118aa201c47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:07.308808 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41018f57-6a8c-4ac5-a427-c118aa201c47 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:07.321771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1166/2343] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:07.540735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9645b-b9bf-4380-adbe-ea7b499230b8 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:07.542223 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-85a9645b-b9bf-4380-adbe-ea7b499230b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:07.577668 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9645b-b9bf-4380-adbe-ea7b499230b8 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:07.588701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12e5fd-92e2-41ae-a728-6b1b25d39564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:07.589710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12e5fd-92e2-41ae-a728-6b1b25d39564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:07.589997 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12e5fd-92e2-41ae-a728-6b1b25d39564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:07.590282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12e5fd-92e2-41ae-a728-6b1b25d39564 admin admin] PATH_INFO: `/v3/projects/729d992ed262479f8470e9a8151f804b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:07.592056 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12e5fd-92e2-41ae-a728-6b1b25d39564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=729d992ed262479f8470e9a8151f804b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:07.597080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12e5fd-92e2-41ae-a728-6b1b25d39564 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:07.665101 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7e12e5fd-92e2-41ae-a728-6b1b25d39564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729d992ed262479f8470e9a8151f804b', 'request_id': 'req-7e12e5fd-92e2-41ae-a728-6b1b25d39564'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:07.680068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7e12e5fd-92e2-41ae-a728-6b1b25d39564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729d992ed262479f8470e9a8151f804b', 'request_id': 'req-7e12e5fd-92e2-41ae-a728-6b1b25d39564'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:07.688852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7e12e5fd-92e2-41ae-a728-6b1b25d39564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729d992ed262479f8470e9a8151f804b', 'request_id': 'req-7e12e5fd-92e2-41ae-a728-6b1b25d39564'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:07.703186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7e12e5fd-92e2-41ae-a728-6b1b25d39564 admin admin] The token cache is being invalidate because project 729d992ed262479f8470e9a8151f804b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:36:07.703478 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7e12e5fd-92e2-41ae-a728-6b1b25d39564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:07.704127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7e12e5fd-92e2-41ae-a728-6b1b25d39564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:07.705744 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1178/2344] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:36:07 2022] DELETE /identity/v3/projects/729d992ed262479f8470e9a8151f804b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:07.710194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41018f57-6a8c-4ac5-a427-c118aa201c47 service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:07.726128 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41018f57-6a8c-4ac5-a427-c118aa201c47 service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:07.787210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39310520-046f-42de-8161-2d94cd4da033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:07.788119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39310520-046f-42de-8161-2d94cd4da033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:07.788402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39310520-046f-42de-8161-2d94cd4da033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:07.788678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39310520-046f-42de-8161-2d94cd4da033 admin admin] PATH_INFO: `/v3/users/cf8902dc4f0649be9658d5e32f2d02d9` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:07.790016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39310520-046f-42de-8161-2d94cd4da033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8902dc4f0649be9658d5e32f2d02d9)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:07.791963 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39310520-046f-42de-8161-2d94cd4da033 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:07.846024 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-39310520-046f-42de-8161-2d94cd4da033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8902dc4f0649be9658d5e32f2d02d9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:07.860911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-39310520-046f-42de-8161-2d94cd4da033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8902dc4f0649be9658d5e32f2d02d9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:07.862282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-39310520-046f-42de-8161-2d94cd4da033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8902dc4f0649be9658d5e32f2d02d9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:07.863870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-39310520-046f-42de-8161-2d94cd4da033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8902dc4f0649be9658d5e32f2d02d9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:07.880936 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:07.896054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-39310520-046f-42de-8161-2d94cd4da033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8902dc4f0649be9658d5e32f2d02d9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:07.912616 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1167/2345] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:36:07 2022] DELETE /identity/v3/users/cf8902dc4f0649be9658d5e32f2d02d9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:36:08.085053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05119a5-564f-40d2-bebc-a191b272b657 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:08.091053 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05119a5-564f-40d2-bebc-a191b272b657 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:08.091501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05119a5-564f-40d2-bebc-a191b272b657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:08.127726 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e05119a5-564f-40d2-bebc-a191b272b657 None None] MFA Rules not processed for user `6586c9aa3c984b9b963a2e2c583ef7bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:08.129591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e05119a5-564f-40d2-bebc-a191b272b657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:08.201005 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:08.253708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1179/2346] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:08.266557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39310520-046f-42de-8161-2d94cd4da033 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:08.268010 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-39310520-046f-42de-8161-2d94cd4da033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:08.311425 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05119a5-564f-40d2-bebc-a191b272b657 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:08.313314 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e05119a5-564f-40d2-bebc-a191b272b657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:08.368360 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39310520-046f-42de-8161-2d94cd4da033 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:08.374417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e030ca-7a3e-4d7f-b61f-de3142b6d54f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:08.375831 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e030ca-7a3e-4d7f-b61f-de3142b6d54f service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:08.390545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e030ca-7a3e-4d7f-b61f-de3142b6d54f service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:08.391186 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e030ca-7a3e-4d7f-b61f-de3142b6d54f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:08.408974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e030ca-7a3e-4d7f-b61f-de3142b6d54f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:08.410389 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05119a5-564f-40d2-bebc-a191b272b657 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:08.410554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e030ca-7a3e-4d7f-b61f-de3142b6d54f service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:08.416798 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14868ee-830e-4815-9733-478ad79fa0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:08.418105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14868ee-830e-4815-9733-478ad79fa0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:08.418455 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14868ee-830e-4815-9733-478ad79fa0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:08.418802 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14868ee-830e-4815-9733-478ad79fa0a6 admin admin] PATH_INFO: `/v3/users/302f6f50262b49aea0981928b74970e4` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:08.420291 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14868ee-830e-4815-9733-478ad79fa0a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=302f6f50262b49aea0981928b74970e4)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:08.423588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1168/2347] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:08.429681 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14868ee-830e-4815-9733-478ad79fa0a6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:08.502402 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a14868ee-830e-4815-9733-478ad79fa0a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302f6f50262b49aea0981928b74970e4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:08.512059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a14868ee-830e-4815-9733-478ad79fa0a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302f6f50262b49aea0981928b74970e4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:08.513248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a14868ee-830e-4815-9733-478ad79fa0a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302f6f50262b49aea0981928b74970e4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:08.514013 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a14868ee-830e-4815-9733-478ad79fa0a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302f6f50262b49aea0981928b74970e4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:08.528344 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a14868ee-830e-4815-9733-478ad79fa0a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302f6f50262b49aea0981928b74970e4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:08.544144 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1180/2348] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:36:08 2022] DELETE /identity/v3/users/302f6f50262b49aea0981928b74970e4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:08.548542 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b312ad-a233-48c7-836f-912bdc72fe15 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:08.548660 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b312ad-a233-48c7-836f-912bdc72fe15 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:08.548952 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b312ad-a233-48c7-836f-912bdc72fe15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:08.567380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-27b312ad-a233-48c7-836f-912bdc72fe15 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:08.568817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-27b312ad-a233-48c7-836f-912bdc72fe15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:08.586952 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14868ee-830e-4815-9733-478ad79fa0a6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:08.588992 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a14868ee-830e-4815-9733-478ad79fa0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:08.693632 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14868ee-830e-4815-9733-478ad79fa0a6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:08.700879 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf43c9-2c33-421e-b60f-e66bfdfb4f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:08.702407 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf43c9-2c33-421e-b60f-e66bfdfb4f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:08.702941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf43c9-2c33-421e-b60f-e66bfdfb4f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:08.703450 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf43c9-2c33-421e-b60f-e66bfdfb4f7d admin admin] PATH_INFO: `/v3/projects/f6ed1f357d024088858ccb87d8da248f` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:08.708360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf43c9-2c33-421e-b60f-e66bfdfb4f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ed1f357d024088858ccb87d8da248f)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:08.710655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf43c9-2c33-421e-b60f-e66bfdfb4f7d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:08.712990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:08.745436 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1169/2349] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:08.794506 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b312ad-a233-48c7-836f-912bdc72fe15 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:08.796192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-27b312ad-a233-48c7-836f-912bdc72fe15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:08.814936 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-36cf43c9-2c33-421e-b60f-e66bfdfb4f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ed1f357d024088858ccb87d8da248f', 'request_id': 'req-36cf43c9-2c33-421e-b60f-e66bfdfb4f7d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:08.829239 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-36cf43c9-2c33-421e-b60f-e66bfdfb4f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ed1f357d024088858ccb87d8da248f', 'request_id': 'req-36cf43c9-2c33-421e-b60f-e66bfdfb4f7d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:08.844563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-36cf43c9-2c33-421e-b60f-e66bfdfb4f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ed1f357d024088858ccb87d8da248f', 'request_id': 'req-36cf43c9-2c33-421e-b60f-e66bfdfb4f7d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:08.866515 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-36cf43c9-2c33-421e-b60f-e66bfdfb4f7d admin admin] The token cache is being invalidate because project f6ed1f357d024088858ccb87d8da248f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:36:08.866860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-36cf43c9-2c33-421e-b60f-e66bfdfb4f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:08.868361 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-36cf43c9-2c33-421e-b60f-e66bfdfb4f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:08.870672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1181/2350] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:36:08 2022] DELETE /identity/v3/projects/f6ed1f357d024088858ccb87d8da248f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:36:08.877400 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3a248-9cc3-4014-abcf-b3d7e037bf38 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:08.878421 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3a248-9cc3-4014-abcf-b3d7e037bf38 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:08.878883 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3a248-9cc3-4014-abcf-b3d7e037bf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:08.893846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b312ad-a233-48c7-836f-912bdc72fe15 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:08.912107 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e7e3a248-9cc3-4014-abcf-b3d7e037bf38 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:08.913612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e7e3a248-9cc3-4014-abcf-b3d7e037bf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:08.943701 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:08.960130 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b612496-2ebf-4355-85c5-13ca93a7f3c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:08.961196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b612496-2ebf-4355-85c5-13ca93a7f3c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:08.961714 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b612496-2ebf-4355-85c5-13ca93a7f3c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:08.962245 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b612496-2ebf-4355-85c5-13ca93a7f3c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:08.964466 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9b612496-2ebf-4355-85c5-13ca93a7f3c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:09.028697 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1182/2351] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:09.036483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52aef7-e23a-48f9-b027-b00f05e9cfd5 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:09.037687 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52aef7-e23a-48f9-b027-b00f05e9cfd5 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:09.038156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52aef7-e23a-48f9-b027-b00f05e9cfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:09.044697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b612496-2ebf-4355-85c5-13ca93a7f3c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:09.046473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b612496-2ebf-4355-85c5-13ca93a7f3c7 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:09.057166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1170/2352] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:09.076729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8b52aef7-e23a-48f9-b027-b00f05e9cfd5 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:09.078635 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8b52aef7-e23a-48f9-b027-b00f05e9cfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:09.089857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1183/2353] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:36:09.094446 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b612496-2ebf-4355-85c5-13ca93a7f3c7 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:09.105885 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b612496-2ebf-4355-85c5-13ca93a7f3c7 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:09.111441 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190ca38-f770-490e-9746-70b0b463c100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:09.112068 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190ca38-f770-490e-9746-70b0b463c100 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:09.112576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190ca38-f770-490e-9746-70b0b463c100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:09.112948 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190ca38-f770-490e-9746-70b0b463c100 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:09.114043 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190ca38-f770-490e-9746-70b0b463c100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:36:09.114365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190ca38-f770-490e-9746-70b0b463c100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:09.116127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190ca38-f770-490e-9746-70b0b463c100 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:09.133383 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1171/2354] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:36:09.136799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52aef7-e23a-48f9-b027-b00f05e9cfd5 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:09.147076 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52aef7-e23a-48f9-b027-b00f05e9cfd5 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:09.152820 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca23075-b213-4f9e-98e0-fffe3cfad168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:09.153747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca23075-b213-4f9e-98e0-fffe3cfad168 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:09.154043 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca23075-b213-4f9e-98e0-fffe3cfad168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:09.154324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca23075-b213-4f9e-98e0-fffe3cfad168 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:09.155040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca23075-b213-4f9e-98e0-fffe3cfad168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:09.156952 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca23075-b213-4f9e-98e0-fffe3cfad168 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:09.189874 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1184/2355] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:36:09 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:09.191028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190ca38-f770-490e-9746-70b0b463c100 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:09.203179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190ca38-f770-490e-9746-70b0b463c100 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:09.284330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae99b50-ff5e-4399-acbc-50dd99b63bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:09.285182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae99b50-ff5e-4399-acbc-50dd99b63bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:09.285698 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae99b50-ff5e-4399-acbc-50dd99b63bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:09.286441 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae99b50-ff5e-4399-acbc-50dd99b63bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:09.287140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae99b50-ff5e-4399-acbc-50dd99b63bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:09.289780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae99b50-ff5e-4399-acbc-50dd99b63bb1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:09.315398 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1172/2356] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:36:09 2022] POST /identity/v3/users => generated 281 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:36:09.320427 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca23075-b213-4f9e-98e0-fffe3cfad168 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:09.335504 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca23075-b213-4f9e-98e0-fffe3cfad168 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:09.341914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af5318-4c9f-4829-94d5-a29bfc29d444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:09.342558 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af5318-4c9f-4829-94d5-a29bfc29d444 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:09.342900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af5318-4c9f-4829-94d5-a29bfc29d444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:09.343195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af5318-4c9f-4829-94d5-a29bfc29d444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:09.344197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af5318-4c9f-4829-94d5-a29bfc29d444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:09.347587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af5318-4c9f-4829-94d5-a29bfc29d444 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:09.366250 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1185/2357] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:09.370793 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae99b50-ff5e-4399-acbc-50dd99b63bb1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:09.406682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae99b50-ff5e-4399-acbc-50dd99b63bb1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:09.425387 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4f8cb-6a5c-41f7-9257-f1204587b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:09.426390 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4f8cb-6a5c-41f7-9257-f1204587b9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:09.426684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4f8cb-6a5c-41f7-9257-f1204587b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:09.426966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4f8cb-6a5c-41f7-9257-f1204587b9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:09.427789 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4f8cb-6a5c-41f7-9257-f1204587b9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:09.432986 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4f8cb-6a5c-41f7-9257-f1204587b9a9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:09.462741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af5318-4c9f-4829-94d5-a29bfc29d444 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:09.462940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1173/2358] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:36:09.485805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af5318-4c9f-4829-94d5-a29bfc29d444 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:09.495199 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf3b38-9ffd-43fb-bd34-0289570595e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:09.497755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf3b38-9ffd-43fb-bd34-0289570595e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:09.497755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf3b38-9ffd-43fb-bd34-0289570595e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:09.498006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf3b38-9ffd-43fb-bd34-0289570595e8 admin admin] PATH_INFO: `/v3/projects/f0c2b30404b74848afa7798a2c524c18/users/44f1854fcf034302831aa3343a97ecc4/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:09.527985 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf3b38-9ffd-43fb-bd34-0289570595e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c2b30404b74848afa7798a2c524c18, user_id=44f1854fcf034302831aa3343a97ecc4, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:09.532531 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf3b38-9ffd-43fb-bd34-0289570595e8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:09.563112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1186/2359] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:36:09 2022] PUT /identity/v3/projects/f0c2b30404b74848afa7798a2c524c18/users/44f1854fcf034302831aa3343a97ecc4/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:09.565697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5777e9e-bee6-42f1-bed4-5c4f1a41f245 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:09.566168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5777e9e-bee6-42f1-bed4-5c4f1a41f245 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:09.566651 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5777e9e-bee6-42f1-bed4-5c4f1a41f245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:09.610961 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b5777e9e-bee6-42f1-bed4-5c4f1a41f245 None None] MFA Rules not processed for user `44f1854fcf034302831aa3343a97ecc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:09.612181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b5777e9e-bee6-42f1-bed4-5c4f1a41f245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:09.685362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:09.729773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1174/2360] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:09.759486 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf3b38-9ffd-43fb-bd34-0289570595e8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:09.761742 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-26bf3b38-9ffd-43fb-bd34-0289570595e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:09.806217 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5777e9e-bee6-42f1-bed4-5c4f1a41f245 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:09.808563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b5777e9e-bee6-42f1-bed4-5c4f1a41f245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:09.850902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:09.899775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf3b38-9ffd-43fb-bd34-0289570595e8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:09.905703 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5777e9e-bee6-42f1-bed4-5c4f1a41f245 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:09.908947 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:09.909876 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:09.910327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:09.910430 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72241656-188f-4d90-8725-dfccd05df66b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:09.910606 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e admin admin] PATH_INFO: `/v3/projects/d2b6527a723a4dedada56f282f32023e` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:09.911136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72241656-188f-4d90-8725-dfccd05df66b service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:09.911482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72241656-188f-4d90-8725-dfccd05df66b service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:09.911813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b6527a723a4dedada56f282f32023e)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:09.911921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72241656-188f-4d90-8725-dfccd05df66b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:09.913926 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:09.922101 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72241656-188f-4d90-8725-dfccd05df66b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:09.924300 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72241656-188f-4d90-8725-dfccd05df66b service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:09.936667 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1175/2361] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:36:09.938800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeada0a-0227-410a-bc58-6cee97e391a8 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:09.939093 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeada0a-0227-410a-bc58-6cee97e391a8 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:09.939505 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeada0a-0227-410a-bc58-6cee97e391a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:09.961914 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-edeada0a-0227-410a-bc58-6cee97e391a8 None None] MFA Rules not processed for user `6586c9aa3c984b9b963a2e2c583ef7bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:09.963146 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-edeada0a-0227-410a-bc58-6cee97e391a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:09.966988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b6527a723a4dedada56f282f32023e', 'request_id': 'req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:09.974658 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b6527a723a4dedada56f282f32023e', 'request_id': 'req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:09.981946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b6527a723a4dedada56f282f32023e', 'request_id': 'req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:09.996336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e admin admin] The token cache is being invalidate because project d2b6527a723a4dedada56f282f32023e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:36:09.996753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:09.997394 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:09.998965 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1187/2362] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:36:09 2022] DELETE /identity/v3/projects/d2b6527a723a4dedada56f282f32023e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:10.002264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:10.003644 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:10.020210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1176/2363] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:10.021631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba3f77-6cba-40c4-b37e-ccc4a652fe23 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:10.021919 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba3f77-6cba-40c4-b37e-ccc4a652fe23 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:10.022192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba3f77-6cba-40c4-b37e-ccc4a652fe23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:10.041960 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-50ba3f77-6cba-40c4-b37e-ccc4a652fe23 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:10.043185 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-50ba3f77-6cba-40c4-b37e-ccc4a652fe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:10.084605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cff7e-ea43-4070-9a89-25a66a6c0e6e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:10.089951 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d2b99-c170-4237-9814-433896e3ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:10.091455 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d2b99-c170-4237-9814-433896e3ce65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:10.091744 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d2b99-c170-4237-9814-433896e3ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:10.092221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d2b99-c170-4237-9814-433896e3ce65 admin admin] PATH_INFO: `/v3/users/44f1854fcf034302831aa3343a97ecc4` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:10.093224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d2b99-c170-4237-9814-433896e3ce65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44f1854fcf034302831aa3343a97ecc4)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:10.095202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d2b99-c170-4237-9814-433896e3ce65 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:10.121393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1177/2364] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:10.128145 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7d27f-fc13-41a4-b2a4-931d1d69153e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:10.128440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7d27f-fc13-41a4-b2a4-931d1d69153e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:10.129257 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7d27f-fc13-41a4-b2a4-931d1d69153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:10.148163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-13b7d27f-fc13-41a4-b2a4-931d1d69153e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:10.149276 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-13b7d27f-fc13-41a4-b2a4-931d1d69153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:10.153589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-755d2b99-c170-4237-9814-433896e3ce65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44f1854fcf034302831aa3343a97ecc4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:10.157391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1178/2365] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:10.162310 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7d27f-fc13-41a4-b2a4-931d1d69153e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:10.166877 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-755d2b99-c170-4237-9814-433896e3ce65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44f1854fcf034302831aa3343a97ecc4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:10.167502 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-755d2b99-c170-4237-9814-433896e3ce65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44f1854fcf034302831aa3343a97ecc4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:10.168403 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-755d2b99-c170-4237-9814-433896e3ce65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44f1854fcf034302831aa3343a97ecc4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:10.173850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:10.179005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7d27f-fc13-41a4-b2a4-931d1d69153e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:10.183911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19525bd-bafa-4da8-96e7-e6eace809a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:10.184573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19525bd-bafa-4da8-96e7-e6eace809a25 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:10.184860 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19525bd-bafa-4da8-96e7-e6eace809a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:10.185264 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19525bd-bafa-4da8-96e7-e6eace809a25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:10.186142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19525bd-bafa-4da8-96e7-e6eace809a25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:36:10.186494 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19525bd-bafa-4da8-96e7-e6eace809a25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:10.188975 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19525bd-bafa-4da8-96e7-e6eace809a25 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:10.190598 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-755d2b99-c170-4237-9814-433896e3ce65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44f1854fcf034302831aa3343a97ecc4'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:10.203612 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1179/2366] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:36:10.211101 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19525bd-bafa-4da8-96e7-e6eace809a25 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:10.213070 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1188/2367] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:36:09 2022] DELETE /identity/v3/users/44f1854fcf034302831aa3343a97ecc4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:10.213221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a19525bd-bafa-4da8-96e7-e6eace809a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:10.218313 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb03ce-5ba1-4a13-a7a8-932a0dd707ac None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:10.218607 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb03ce-5ba1-4a13-a7a8-932a0dd707ac None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:10.218885 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb03ce-5ba1-4a13-a7a8-932a0dd707ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:10.227198 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19525bd-bafa-4da8-96e7-e6eace809a25 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:10.240282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-13eb03ce-5ba1-4a13-a7a8-932a0dd707ac None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:10.241649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-13eb03ce-5ba1-4a13-a7a8-932a0dd707ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:10.252687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:10.323930 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1189/2368] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:10.335553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a6017-56e6-4e9d-a229-2441889556b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:10.336261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6017-56e6-4e9d-a229-2441889556b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:10.336533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6017-56e6-4e9d-a229-2441889556b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:10.336815 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a6017-56e6-4e9d-a229-2441889556b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:10.337560 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a6017-56e6-4e9d-a229-2441889556b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:10.338086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb03ce-5ba1-4a13-a7a8-932a0dd707ac None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:10.339675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a6017-56e6-4e9d-a229-2441889556b8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:10.340290 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-13eb03ce-5ba1-4a13-a7a8-932a0dd707ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:10.393955 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1180/2369] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:36:10 2022] POST /identity/v3/projects => generated 369 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:10.395451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a6017-56e6-4e9d-a229-2441889556b8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:10.424666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb03ce-5ba1-4a13-a7a8-932a0dd707ac None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:10.501029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a6017-56e6-4e9d-a229-2441889556b8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:10.501755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb71ac-b9d0-420d-800a-c49083975d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:10.502788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb71ac-b9d0-420d-800a-c49083975d8d service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:10.503294 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb71ac-b9d0-420d-800a-c49083975d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:10.503830 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb71ac-b9d0-420d-800a-c49083975d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:10.506200 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2e71c-9f0a-476f-9cdb-c9d443ac86f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:10.507057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2e71c-9f0a-476f-9cdb-c9d443ac86f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:10.507343 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2e71c-9f0a-476f-9cdb-c9d443ac86f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:10.507624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2e71c-9f0a-476f-9cdb-c9d443ac86f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:10.508945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2e71c-9f0a-476f-9cdb-c9d443ac86f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:10.511212 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2e71c-9f0a-476f-9cdb-c9d443ac86f3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:10.516292 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb71ac-b9d0-420d-800a-c49083975d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:10.518496 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb71ac-b9d0-420d-800a-c49083975d8d service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:10.532719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1190/2370] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:10.538060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1181/2371] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:36:10 2022] POST /identity/v3/users => generated 285 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:10.542621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb71ac-b9d0-420d-800a-c49083975d8d service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:10.555359 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb71ac-b9d0-420d-800a-c49083975d8d service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:10.561018 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363392e-4718-4ce3-b9df-c79982340df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:10.561801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363392e-4718-4ce3-b9df-c79982340df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:10.562166 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363392e-4718-4ce3-b9df-c79982340df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:10.562517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363392e-4718-4ce3-b9df-c79982340df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:10.563341 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363392e-4718-4ce3-b9df-c79982340df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:10.565019 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363392e-4718-4ce3-b9df-c79982340df1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:10.589399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1191/2372] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:10.598696 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2e71c-9f0a-476f-9cdb-c9d443ac86f3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:10.615736 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2e71c-9f0a-476f-9cdb-c9d443ac86f3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:10.623377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f8e3c-8afb-49c6-b1b3-43a9644e6ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:10.624207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f8e3c-8afb-49c6-b1b3-43a9644e6ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:10.624993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f8e3c-8afb-49c6-b1b3-43a9644e6ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:10.625598 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f8e3c-8afb-49c6-b1b3-43a9644e6ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:10.627475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f8e3c-8afb-49c6-b1b3-43a9644e6ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:10.630969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f8e3c-8afb-49c6-b1b3-43a9644e6ae4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:10.649172 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1182/2373] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:10.650949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363392e-4718-4ce3-b9df-c79982340df1 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:10.666387 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363392e-4718-4ce3-b9df-c79982340df1 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:10.678743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdc9ad-7389-438f-b03b-2fd7ae4dce92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:10.679587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdc9ad-7389-438f-b03b-2fd7ae4dce92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:10.679878 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdc9ad-7389-438f-b03b-2fd7ae4dce92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:10.680162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdc9ad-7389-438f-b03b-2fd7ae4dce92 admin admin] PATH_INFO: `/v3/projects/783c2657453743078dab87d792b67878/users/f0e6d622a93b44738ee7baf64d1d2481/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:10.723186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdc9ad-7389-438f-b03b-2fd7ae4dce92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=783c2657453743078dab87d792b67878, user_id=f0e6d622a93b44738ee7baf64d1d2481, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:10.731015 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdc9ad-7389-438f-b03b-2fd7ae4dce92 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:10.772405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:10.778302 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1192/2374] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:36:10 2022] PUT /identity/v3/projects/783c2657453743078dab87d792b67878/users/f0e6d622a93b44738ee7baf64d1d2481/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:10.791784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e903e8-c3f2-4708-9131-d7de4183c870 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:10.792105 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e903e8-c3f2-4708-9131-d7de4183c870 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:10.792874 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e903e8-c3f2-4708-9131-d7de4183c870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:10.869319 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-38e903e8-c3f2-4708-9131-d7de4183c870 None None] MFA Rules not processed for user `f0e6d622a93b44738ee7baf64d1d2481`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:10.869960 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-38e903e8-c3f2-4708-9131-d7de4183c870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:11.062918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdc9ad-7389-438f-b03b-2fd7ae4dce92 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:11.068114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-37fdc9ad-7389-438f-b03b-2fd7ae4dce92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:11.077819 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1183/2375] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:11.103637 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e903e8-c3f2-4708-9131-d7de4183c870 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:11.114777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-38e903e8-c3f2-4708-9131-d7de4183c870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:11.148175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:11.192714 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdc9ad-7389-438f-b03b-2fd7ae4dce92 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:11.202363 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37abea7-acbf-4e85-bec6-5e90016c62d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:11.203768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37abea7-acbf-4e85-bec6-5e90016c62d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:11.204352 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37abea7-acbf-4e85-bec6-5e90016c62d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:11.204891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37abea7-acbf-4e85-bec6-5e90016c62d0 admin admin] PATH_INFO: `/v3/projects/f0c2b30404b74848afa7798a2c524c18` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:11.207819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37abea7-acbf-4e85-bec6-5e90016c62d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c2b30404b74848afa7798a2c524c18)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:11.210448 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37abea7-acbf-4e85-bec6-5e90016c62d0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:11.275918 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e903e8-c3f2-4708-9131-d7de4183c870 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:11.289264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f37abea7-acbf-4e85-bec6-5e90016c62d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c2b30404b74848afa7798a2c524c18', 'request_id': 'req-f37abea7-acbf-4e85-bec6-5e90016c62d0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:11.302594 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f37abea7-acbf-4e85-bec6-5e90016c62d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c2b30404b74848afa7798a2c524c18', 'request_id': 'req-f37abea7-acbf-4e85-bec6-5e90016c62d0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:11.314494 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f37abea7-acbf-4e85-bec6-5e90016c62d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c2b30404b74848afa7798a2c524c18', 'request_id': 'req-f37abea7-acbf-4e85-bec6-5e90016c62d0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:11.357772 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f37abea7-acbf-4e85-bec6-5e90016c62d0 admin admin] The token cache is being invalidate because project f0c2b30404b74848afa7798a2c524c18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:36:11.361784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f37abea7-acbf-4e85-bec6-5e90016c62d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:11.362933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f37abea7-acbf-4e85-bec6-5e90016c62d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:11.381461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1193/2376] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:36:11 2022] DELETE /identity/v3/projects/f0c2b30404b74848afa7798a2c524c18 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:36:11.386813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36954df2-63aa-47f2-8405-a933a53d2f50 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:11.387389 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36954df2-63aa-47f2-8405-a933a53d2f50 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:11.387919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36954df2-63aa-47f2-8405-a933a53d2f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:11.399555 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9870665-ed9f-4f81-96d3-703929100189 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a239897b9a0644ef9d2e0e2e333232fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:11.400382 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9870665-ed9f-4f81-96d3-703929100189 service glance] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:11.400885 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9870665-ed9f-4f81-96d3-703929100189 service glance] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:11.400993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9870665-ed9f-4f81-96d3-703929100189 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:11.406482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a9870665-ed9f-4f81-96d3-703929100189 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:11.418586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-36954df2-63aa-47f2-8405-a933a53d2f50 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:11.420279 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-36954df2-63aa-47f2-8405-a933a53d2f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:11.525010 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9870665-ed9f-4f81-96d3-703929100189 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:11.526976 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9870665-ed9f-4f81-96d3-703929100189 service glance] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:11.539419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1184/2377] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:11 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:11.581527 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1194/2378] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:11.589399 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cefe3-5db6-444a-8992-334608d9e28e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:11.589704 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cefe3-5db6-444a-8992-334608d9e28e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:11.590138 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cefe3-5db6-444a-8992-334608d9e28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:11.611470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e09cefe3-5db6-444a-8992-334608d9e28e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:11.613127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e09cefe3-5db6-444a-8992-334608d9e28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:11.629705 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1185/2379] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:11.631391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36954df2-63aa-47f2-8405-a933a53d2f50 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:11.644375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36954df2-63aa-47f2-8405-a933a53d2f50 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:11.651850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d1897-18a7-42f1-8d3e-69838e976a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:11.652678 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d1897-18a7-42f1-8d3e-69838e976a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:11.653052 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d1897-18a7-42f1-8d3e-69838e976a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:11.653449 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d1897-18a7-42f1-8d3e-69838e976a49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:11.654264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d1897-18a7-42f1-8d3e-69838e976a49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:36:11.654658 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d1897-18a7-42f1-8d3e-69838e976a49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:11.656415 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d1897-18a7-42f1-8d3e-69838e976a49 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:11.670161 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1195/2380] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:36:11.674670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cefe3-5db6-444a-8992-334608d9e28e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:11.684972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cefe3-5db6-444a-8992-334608d9e28e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:11.690296 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280929c3-1817-44d5-b7f7-6281bd5f9515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:11.691020 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280929c3-1817-44d5-b7f7-6281bd5f9515 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:11.691363 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280929c3-1817-44d5-b7f7-6281bd5f9515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:11.691671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280929c3-1817-44d5-b7f7-6281bd5f9515 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:11.692392 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280929c3-1817-44d5-b7f7-6281bd5f9515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:11.694489 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280929c3-1817-44d5-b7f7-6281bd5f9515 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:11.723758 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1186/2381] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:36:11 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:11.727628 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d1897-18a7-42f1-8d3e-69838e976a49 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:11.739142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d1897-18a7-42f1-8d3e-69838e976a49 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:11.752647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:11.812682 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f90d38-609d-479b-a7b8-73763eff0dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:11.813582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f90d38-609d-479b-a7b8-73763eff0dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:11.813851 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f90d38-609d-479b-a7b8-73763eff0dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:11.814128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f90d38-609d-479b-a7b8-73763eff0dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:11.814914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f90d38-609d-479b-a7b8-73763eff0dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:11.816950 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f90d38-609d-479b-a7b8-73763eff0dc1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:11.842979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1196/2382] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:36:11 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:11.844030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280929c3-1817-44d5-b7f7-6281bd5f9515 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:11.863470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280929c3-1817-44d5-b7f7-6281bd5f9515 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:11.870701 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044aaa1-a7e9-4341-975a-bf532862e18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:11.871404 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044aaa1-a7e9-4341-975a-bf532862e18c admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:11.871696 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044aaa1-a7e9-4341-975a-bf532862e18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:11.871978 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044aaa1-a7e9-4341-975a-bf532862e18c admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:11.873166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044aaa1-a7e9-4341-975a-bf532862e18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:11.875946 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044aaa1-a7e9-4341-975a-bf532862e18c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:11.892491 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1187/2383] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:11.896841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f90d38-609d-479b-a7b8-73763eff0dc1 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:11.921695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f90d38-609d-479b-a7b8-73763eff0dc1 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:11.929024 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aec05a-f50b-4a2b-8dc2-f08b6cdddf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:11.930119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aec05a-f50b-4a2b-8dc2-f08b6cdddf8e admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:11.930701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aec05a-f50b-4a2b-8dc2-f08b6cdddf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:11.931101 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aec05a-f50b-4a2b-8dc2-f08b6cdddf8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:11.932050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aec05a-f50b-4a2b-8dc2-f08b6cdddf8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:11.933896 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aec05a-f50b-4a2b-8dc2-f08b6cdddf8e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:11.956612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1197/2384] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:11.957092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044aaa1-a7e9-4341-975a-bf532862e18c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:11.979768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044aaa1-a7e9-4341-975a-bf532862e18c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:11.990979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6e6bb-03b2-4ec3-9717-7a8edae46257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:11.992166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6e6bb-03b2-4ec3-9717-7a8edae46257 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:11.992412 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6e6bb-03b2-4ec3-9717-7a8edae46257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:11.992852 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6e6bb-03b2-4ec3-9717-7a8edae46257 admin admin] PATH_INFO: `/v3/projects/00275b52451243b3bda7e2f6365c6162/users/aa454b8ee83245079ab838eea0176829/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:12.022897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6e6bb-03b2-4ec3-9717-7a8edae46257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00275b52451243b3bda7e2f6365c6162, user_id=aa454b8ee83245079ab838eea0176829, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:12.025680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6e6bb-03b2-4ec3-9717-7a8edae46257 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:12.044434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1188/2385] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:36:11 2022] PUT /identity/v3/projects/00275b52451243b3bda7e2f6365c6162/users/aa454b8ee83245079ab838eea0176829/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:36:12.056543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d4596-ebc1-42bb-9452-b5138f2c5968 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:12.056863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d4596-ebc1-42bb-9452-b5138f2c5968 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:12.057238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d4596-ebc1-42bb-9452-b5138f2c5968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:12.132770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9e5d4596-ebc1-42bb-9452-b5138f2c5968 None None] MFA Rules not processed for user `aa454b8ee83245079ab838eea0176829`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:12.134434 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9e5d4596-ebc1-42bb-9452-b5138f2c5968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:12.290349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1198/2386] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:12.303063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6e6bb-03b2-4ec3-9717-7a8edae46257 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:12.305866 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-88a6e6bb-03b2-4ec3-9717-7a8edae46257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:12.329775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:12.426000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6e6bb-03b2-4ec3-9717-7a8edae46257 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:12.429996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632f8df-3424-4740-bf1e-6792d42dca88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:12.430662 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632f8df-3424-4740-bf1e-6792d42dca88 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:12.431071 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632f8df-3424-4740-bf1e-6792d42dca88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:12.431358 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632f8df-3424-4740-bf1e-6792d42dca88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:12.452041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632f8df-3424-4740-bf1e-6792d42dca88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:12.453534 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632f8df-3424-4740-bf1e-6792d42dca88 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:12.466960 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1189/2387] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:13.918253 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d4596-ebc1-42bb-9452-b5138f2c5968 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:13.919733 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9e5d4596-ebc1-42bb-9452-b5138f2c5968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:14.008786 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d4596-ebc1-42bb-9452-b5138f2c5968 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:14.013481 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc04232-a2cb-41fb-bb75-919d40f512b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:14.014404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc04232-a2cb-41fb-bb75-919d40f512b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:14.014688 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc04232-a2cb-41fb-bb75-919d40f512b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:14.014962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc04232-a2cb-41fb-bb75-919d40f512b3 admin admin] PATH_INFO: `/v3/users/b513f50c76d24e608eae5f0f3237c6aa` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:14.016145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc04232-a2cb-41fb-bb75-919d40f512b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b513f50c76d24e608eae5f0f3237c6aa)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:14.018351 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc04232-a2cb-41fb-bb75-919d40f512b3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:14.098706 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:14.142645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4dc04232-a2cb-41fb-bb75-919d40f512b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b513f50c76d24e608eae5f0f3237c6aa'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:14.156091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4dc04232-a2cb-41fb-bb75-919d40f512b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b513f50c76d24e608eae5f0f3237c6aa'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:14.156949 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4dc04232-a2cb-41fb-bb75-919d40f512b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b513f50c76d24e608eae5f0f3237c6aa'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:14.157648 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4dc04232-a2cb-41fb-bb75-919d40f512b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b513f50c76d24e608eae5f0f3237c6aa'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:14.180828 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4dc04232-a2cb-41fb-bb75-919d40f512b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b513f50c76d24e608eae5f0f3237c6aa'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:14.205971 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1199/2388] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:36:13 2022] DELETE /identity/v3/users/b513f50c76d24e608eae5f0f3237c6aa => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:14.207419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0c0e0-d425-4cf2-ade7-ca33a26f3efd None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:14.207832 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0c0e0-d425-4cf2-ade7-ca33a26f3efd None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:14.207981 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0c0e0-d425-4cf2-ade7-ca33a26f3efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:14.252657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4ae0c0e0-d425-4cf2-ade7-ca33a26f3efd None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:14.256161 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4ae0c0e0-d425-4cf2-ade7-ca33a26f3efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:14.338847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1190/2389] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:36:14.348800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc04232-a2cb-41fb-bb75-919d40f512b3 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:14.350358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4dc04232-a2cb-41fb-bb75-919d40f512b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:14.479610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc04232-a2cb-41fb-bb75-919d40f512b3 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:14.492288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df5a37-1f90-4767-ab88-e4739c2a8780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:14.493379 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df5a37-1f90-4767-ab88-e4739c2a8780 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:14.493379 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df5a37-1f90-4767-ab88-e4739c2a8780 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:14.493595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df5a37-1f90-4767-ab88-e4739c2a8780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:14.511896 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df5a37-1f90-4767-ab88-e4739c2a8780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:14.513800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df5a37-1f90-4767-ab88-e4739c2a8780 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:14.536507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1200/2390] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:14.949457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0c0e0-d425-4cf2-ade7-ca33a26f3efd None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:14.950942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4ae0c0e0-d425-4cf2-ade7-ca33a26f3efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:14.965484 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0c0e0-d425-4cf2-ade7-ca33a26f3efd None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:14.977854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdceb412-b76c-4aae-b8e0-25b2adc4427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:14.978875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdceb412-b76c-4aae-b8e0-25b2adc4427b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:14.979776 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdceb412-b76c-4aae-b8e0-25b2adc4427b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:14.980496 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdceb412-b76c-4aae-b8e0-25b2adc4427b admin admin] PATH_INFO: `/v3/projects/e82195f25244464bab177cbd13112a10` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:14.982049 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdceb412-b76c-4aae-b8e0-25b2adc4427b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e82195f25244464bab177cbd13112a10)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:14.984660 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdceb412-b76c-4aae-b8e0-25b2adc4427b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:15.092713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-cdceb412-b76c-4aae-b8e0-25b2adc4427b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e82195f25244464bab177cbd13112a10', 'request_id': 'req-cdceb412-b76c-4aae-b8e0-25b2adc4427b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:15.099937 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-cdceb412-b76c-4aae-b8e0-25b2adc4427b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e82195f25244464bab177cbd13112a10', 'request_id': 'req-cdceb412-b76c-4aae-b8e0-25b2adc4427b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:15.108306 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-cdceb412-b76c-4aae-b8e0-25b2adc4427b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e82195f25244464bab177cbd13112a10', 'request_id': 'req-cdceb412-b76c-4aae-b8e0-25b2adc4427b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:15.125405 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-cdceb412-b76c-4aae-b8e0-25b2adc4427b admin admin] The token cache is being invalidate because project e82195f25244464bab177cbd13112a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:36:15.125764 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-cdceb412-b76c-4aae-b8e0-25b2adc4427b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:15.126417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-cdceb412-b76c-4aae-b8e0-25b2adc4427b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:15.128139 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1191/2391] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:36:14 2022] DELETE /identity/v3/projects/e82195f25244464bab177cbd13112a10 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:15.133163 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ff274-8084-42c6-a9f1-069c1a71bc07 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:15.133785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ff274-8084-42c6-a9f1-069c1a71bc07 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:15.133785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ff274-8084-42c6-a9f1-069c1a71bc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:15.151986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d32ff274-8084-42c6-a9f1-069c1a71bc07 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:15.153444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d32ff274-8084-42c6-a9f1-069c1a71bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:15.230875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1201/2392] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:36:15.233762 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfdedf-5cb3-4985-8a83-b339feacb4a7 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:15.234858 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfdedf-5cb3-4985-8a83-b339feacb4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:15.235315 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfdedf-5cb3-4985-8a83-b339feacb4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:15.255795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-f8bfdedf-5cb3-4985-8a83-b339feacb4a7 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:15.257126 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f8bfdedf-5cb3-4985-8a83-b339feacb4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:15.265842 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1192/2393] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:15.270361 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ff274-8084-42c6-a9f1-069c1a71bc07 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:15.281197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ff274-8084-42c6-a9f1-069c1a71bc07 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:15.286746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db665d01-b50a-49b6-b669-93562c00eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:15.287536 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db665d01-b50a-49b6-b669-93562c00eb6a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:15.287939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db665d01-b50a-49b6-b669-93562c00eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:15.288404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db665d01-b50a-49b6-b669-93562c00eb6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:15.289240 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db665d01-b50a-49b6-b669-93562c00eb6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:36:15.289694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db665d01-b50a-49b6-b669-93562c00eb6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:15.291484 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db665d01-b50a-49b6-b669-93562c00eb6a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:15.307815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1202/2394] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:36:15.311654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfdedf-5cb3-4985-8a83-b339feacb4a7 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:15.321163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfdedf-5cb3-4985-8a83-b339feacb4a7 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:15.326021 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bfff6-a632-41aa-891a-89caf8c97c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:15.328222 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bfff6-a632-41aa-891a-89caf8c97c2d admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:15.328518 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bfff6-a632-41aa-891a-89caf8c97c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:15.329153 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bfff6-a632-41aa-891a-89caf8c97c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:15.330062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bfff6-a632-41aa-891a-89caf8c97c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:15.332218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bfff6-a632-41aa-891a-89caf8c97c2d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:15.375919 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1193/2395] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:36:15 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:15.377858 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db665d01-b50a-49b6-b669-93562c00eb6a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:15.388908 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db665d01-b50a-49b6-b669-93562c00eb6a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:15.432454 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:15.491825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66479520-a888-4d4d-b8c5-52161d715e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:15.492563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66479520-a888-4d4d-b8c5-52161d715e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:15.493455 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66479520-a888-4d4d-b8c5-52161d715e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:15.494258 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66479520-a888-4d4d-b8c5-52161d715e70 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:15.496318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66479520-a888-4d4d-b8c5-52161d715e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:15.499502 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66479520-a888-4d4d-b8c5-52161d715e70 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:15.526458 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1203/2396] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:36:15 2022] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:15.530465 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bfff6-a632-41aa-891a-89caf8c97c2d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:15.541745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bfff6-a632-41aa-891a-89caf8c97c2d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:15.549197 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7bcf9-05c6-4256-a40e-b24f5e34d13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:15.552621 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7bcf9-05c6-4256-a40e-b24f5e34d13d admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:15.552621 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7bcf9-05c6-4256-a40e-b24f5e34d13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:15.552621 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7bcf9-05c6-4256-a40e-b24f5e34d13d admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:15.552621 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7bcf9-05c6-4256-a40e-b24f5e34d13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:15.553089 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7bcf9-05c6-4256-a40e-b24f5e34d13d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:15.553918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66479520-a888-4d4d-b8c5-52161d715e70 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:15.555705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-66479520-a888-4d4d-b8c5-52161d715e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:15.558949 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:15.565726 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1194/2397] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:15.567873 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66479520-a888-4d4d-b8c5-52161d715e70 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:15.569828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7bcf9-05c6-4256-a40e-b24f5e34d13d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:15.576913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8721a-2eca-47a8-922c-107084586158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:15.577904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8721a-2eca-47a8-922c-107084586158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:15.578187 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8721a-2eca-47a8-922c-107084586158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:15.578464 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8721a-2eca-47a8-922c-107084586158 admin admin] PATH_INFO: `/v3/users/aa454b8ee83245079ab838eea0176829` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:15.579700 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8721a-2eca-47a8-922c-107084586158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa454b8ee83245079ab838eea0176829)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:15.581768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8721a-2eca-47a8-922c-107084586158 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:15.581883 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7bcf9-05c6-4256-a40e-b24f5e34d13d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:15.586771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ced9bf-3d8c-4b70-8e42-e06c97fc4bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:15.587455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ced9bf-3d8c-4b70-8e42-e06c97fc4bda admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:15.587743 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ced9bf-3d8c-4b70-8e42-e06c97fc4bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:15.588027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ced9bf-3d8c-4b70-8e42-e06c97fc4bda admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:15.588775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ced9bf-3d8c-4b70-8e42-e06c97fc4bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:15.590478 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ced9bf-3d8c-4b70-8e42-e06c97fc4bda admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:15.602471 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1195/2398] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:15.606295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ced9bf-3d8c-4b70-8e42-e06c97fc4bda admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:15.618259 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ced9bf-3d8c-4b70-8e42-e06c97fc4bda admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:15.623355 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a004d-e412-4c85-9f20-c246f4a1da47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:15.624252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a004d-e412-4c85-9f20-c246f4a1da47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:15.624543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a004d-e412-4c85-9f20-c246f4a1da47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:15.624826 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a004d-e412-4c85-9f20-c246f4a1da47 admin admin] PATH_INFO: `/v3/projects/4ba28fd3243549faa003ed7c0c46c761/users/07385504bd68454da616025cada3279d/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:15.634552 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-12f8721a-2eca-47a8-922c-107084586158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa454b8ee83245079ab838eea0176829'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:15.649393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-12f8721a-2eca-47a8-922c-107084586158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa454b8ee83245079ab838eea0176829'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:15.650040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-12f8721a-2eca-47a8-922c-107084586158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa454b8ee83245079ab838eea0176829'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:15.650704 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-12f8721a-2eca-47a8-922c-107084586158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa454b8ee83245079ab838eea0176829'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:15.651382 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a004d-e412-4c85-9f20-c246f4a1da47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba28fd3243549faa003ed7c0c46c761, user_id=07385504bd68454da616025cada3279d, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:15.654118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a004d-e412-4c85-9f20-c246f4a1da47 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:15.665755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-12f8721a-2eca-47a8-922c-107084586158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa454b8ee83245079ab838eea0176829'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:15.669277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1196/2399] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:36:15 2022] PUT /identity/v3/projects/4ba28fd3243549faa003ed7c0c46c761/users/07385504bd68454da616025cada3279d/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:36:15.679634 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe184a-a933-4fb2-b871-cf39399a2ca5 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:15.679925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe184a-a933-4fb2-b871-cf39399a2ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:15.680206 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe184a-a933-4fb2-b871-cf39399a2ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:15.691398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1204/2400] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:36:15 2022] DELETE /identity/v3/users/aa454b8ee83245079ab838eea0176829 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:15.692917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb27e92-968a-446d-bd10-0c09b72ab5ba None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:15.693311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb27e92-968a-446d-bd10-0c09b72ab5ba None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:15.693712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb27e92-968a-446d-bd10-0c09b72ab5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:15.710775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-62fe184a-a933-4fb2-b871-cf39399a2ca5 None None] MFA Rules not processed for user `07385504bd68454da616025cada3279d`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:15.712041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-62fe184a-a933-4fb2-b871-cf39399a2ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:15.722304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4fb27e92-968a-446d-bd10-0c09b72ab5ba None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:15.723633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4fb27e92-968a-446d-bd10-0c09b72ab5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:15.795467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1197/2401] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:36:15.807927 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe184a-a933-4fb2-b871-cf39399a2ca5 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:15.809778 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-62fe184a-a933-4fb2-b871-cf39399a2ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:15.830684 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1205/2402] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:15.846033 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb27e92-968a-446d-bd10-0c09b72ab5ba None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:15.847595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4fb27e92-968a-446d-bd10-0c09b72ab5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:15.902846 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:15.903647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe184a-a933-4fb2-b871-cf39399a2ca5 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:15.908677 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d5f2e-8eb3-454a-9177-6cd07a9ccdeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:15.909398 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d5f2e-8eb3-454a-9177-6cd07a9ccdeb service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:15.909881 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d5f2e-8eb3-454a-9177-6cd07a9ccdeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:15.910477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d5f2e-8eb3-454a-9177-6cd07a9ccdeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:15.922127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d5f2e-8eb3-454a-9177-6cd07a9ccdeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:15.923586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d5f2e-8eb3-454a-9177-6cd07a9ccdeb service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:15.935705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb27e92-968a-446d-bd10-0c09b72ab5ba None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:15.938223 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1198/2403] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:36:15.940493 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda08f33-8e42-40fe-b972-00f9f4436fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:15.941294 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08f33-8e42-40fe-b972-00f9f4436fde service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:15.941639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08f33-8e42-40fe-b972-00f9f4436fde service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:15.941918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda08f33-8e42-40fe-b972-00f9f4436fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:15.952620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda08f33-8e42-40fe-b972-00f9f4436fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:15.954255 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda08f33-8e42-40fe-b972-00f9f4436fde service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:15.964226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1206/2404] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:16.373445 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d5f2e-8eb3-454a-9177-6cd07a9ccdeb service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:16.375386 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-aa9d5f2e-8eb3-454a-9177-6cd07a9ccdeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:16.393310 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d5f2e-8eb3-454a-9177-6cd07a9ccdeb service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:16.398305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688c80c-b870-4e81-bf6a-09a822123af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:16.399174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688c80c-b870-4e81-bf6a-09a822123af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:16.399453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688c80c-b870-4e81-bf6a-09a822123af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:16.399720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688c80c-b870-4e81-bf6a-09a822123af8 admin admin] PATH_INFO: `/v3/projects/00275b52451243b3bda7e2f6365c6162` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:16.400918 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688c80c-b870-4e81-bf6a-09a822123af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00275b52451243b3bda7e2f6365c6162)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:16.402870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688c80c-b870-4e81-bf6a-09a822123af8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:16.450526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2688c80c-b870-4e81-bf6a-09a822123af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00275b52451243b3bda7e2f6365c6162', 'request_id': 'req-2688c80c-b870-4e81-bf6a-09a822123af8'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:16.452434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:16.457708 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2688c80c-b870-4e81-bf6a-09a822123af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00275b52451243b3bda7e2f6365c6162', 'request_id': 'req-2688c80c-b870-4e81-bf6a-09a822123af8'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:16.465435 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2688c80c-b870-4e81-bf6a-09a822123af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00275b52451243b3bda7e2f6365c6162', 'request_id': 'req-2688c80c-b870-4e81-bf6a-09a822123af8'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:16.479343 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2688c80c-b870-4e81-bf6a-09a822123af8 admin admin] The token cache is being invalidate because project 00275b52451243b3bda7e2f6365c6162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:36:16.479630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2688c80c-b870-4e81-bf6a-09a822123af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:16.480561 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2688c80c-b870-4e81-bf6a-09a822123af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:16.482171 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1199/2405] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:36:16 2022] DELETE /identity/v3/projects/00275b52451243b3bda7e2f6365c6162 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:25.560507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc9321-18e6-4c95-b9d2-2a6ea14abcdf None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:25.561084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc9321-18e6-4c95-b9d2-2a6ea14abcdf None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:25.561084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc9321-18e6-4c95-b9d2-2a6ea14abcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:25.579624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7afc9321-18e6-4c95-b9d2-2a6ea14abcdf None None] MFA Rules not processed for user `6486e63263a4417c93c5bc4c36bd925a`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:25.580838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7afc9321-18e6-4c95-b9d2-2a6ea14abcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:25.646938 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1207/2406] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:36:26.476398 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=6,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:29.485368 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688c80c-b870-4e81-bf6a-09a822123af8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:29.487939 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2688c80c-b870-4e81-bf6a-09a822123af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:29.562658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688c80c-b870-4e81-bf6a-09a822123af8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:29.571792 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da9807-260c-4f3f-a0ed-6343b7537a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:29.573251 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da9807-260c-4f3f-a0ed-6343b7537a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:29.573574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da9807-260c-4f3f-a0ed-6343b7537a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:29.573858 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da9807-260c-4f3f-a0ed-6343b7537a05 admin admin] PATH_INFO: `/v3/users/d8dbe8818517441d937d58904037e99d` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:29.575249 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da9807-260c-4f3f-a0ed-6343b7537a05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8dbe8818517441d937d58904037e99d)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:29.577472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da9807-260c-4f3f-a0ed-6343b7537a05 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:29.625919 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-28da9807-260c-4f3f-a0ed-6343b7537a05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8dbe8818517441d937d58904037e99d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:29.637069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-28da9807-260c-4f3f-a0ed-6343b7537a05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8dbe8818517441d937d58904037e99d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:29.638519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-28da9807-260c-4f3f-a0ed-6343b7537a05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8dbe8818517441d937d58904037e99d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:29.639802 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-28da9807-260c-4f3f-a0ed-6343b7537a05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8dbe8818517441d937d58904037e99d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:29.655476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-28da9807-260c-4f3f-a0ed-6343b7537a05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8dbe8818517441d937d58904037e99d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:29.668067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1200/2407] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:36:29 2022] DELETE /identity/v3/users/d8dbe8818517441d937d58904037e99d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:30.270080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc9321-18e6-4c95-b9d2-2a6ea14abcdf None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:30.290637 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc9321-18e6-4c95-b9d2-2a6ea14abcdf None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:30.376259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25865580-ac42-4a43-9a40-88b35e1d6d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:30.377149 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25865580-ac42-4a43-9a40-88b35e1d6d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:30.377470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25865580-ac42-4a43-9a40-88b35e1d6d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:30.377755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25865580-ac42-4a43-9a40-88b35e1d6d13 admin admin] PATH_INFO: `/v3/projects/f9114adee8b34094b529823e23aa8b6b` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:30.379011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25865580-ac42-4a43-9a40-88b35e1d6d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9114adee8b34094b529823e23aa8b6b)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:30.380938 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25865580-ac42-4a43-9a40-88b35e1d6d13 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:30.431991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-25865580-ac42-4a43-9a40-88b35e1d6d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9114adee8b34094b529823e23aa8b6b', 'request_id': 'req-25865580-ac42-4a43-9a40-88b35e1d6d13'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:30.441270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-25865580-ac42-4a43-9a40-88b35e1d6d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9114adee8b34094b529823e23aa8b6b', 'request_id': 'req-25865580-ac42-4a43-9a40-88b35e1d6d13'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:30.447785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-25865580-ac42-4a43-9a40-88b35e1d6d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9114adee8b34094b529823e23aa8b6b', 'request_id': 'req-25865580-ac42-4a43-9a40-88b35e1d6d13'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:30.460371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-25865580-ac42-4a43-9a40-88b35e1d6d13 admin admin] The token cache is being invalidate because project f9114adee8b34094b529823e23aa8b6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:36:30.460666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-25865580-ac42-4a43-9a40-88b35e1d6d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:30.461286 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-25865580-ac42-4a43-9a40-88b35e1d6d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:30.462907 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1208/2408] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:36:30 2022] DELETE /identity/v3/projects/f9114adee8b34094b529823e23aa8b6b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:30.467033 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da9807-260c-4f3f-a0ed-6343b7537a05 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:30.468441 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-28da9807-260c-4f3f-a0ed-6343b7537a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:30.481895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da9807-260c-4f3f-a0ed-6343b7537a05 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:30.547024 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e27b1-f7d7-489c-8336-83032eaf5ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:30.547915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e27b1-f7d7-489c-8336-83032eaf5ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:30.548194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e27b1-f7d7-489c-8336-83032eaf5ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:30.548473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e27b1-f7d7-489c-8336-83032eaf5ab0 admin admin] PATH_INFO: `/v3/users/98a9e6fe4aa84bf5a7c80ad13d44f1c1` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:30.549764 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e27b1-f7d7-489c-8336-83032eaf5ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a9e6fe4aa84bf5a7c80ad13d44f1c1)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:30.551814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e27b1-f7d7-489c-8336-83032eaf5ab0 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:30.573316 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:30.603025 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-718e27b1-f7d7-489c-8336-83032eaf5ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a9e6fe4aa84bf5a7c80ad13d44f1c1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:30.612470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-718e27b1-f7d7-489c-8336-83032eaf5ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a9e6fe4aa84bf5a7c80ad13d44f1c1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:30.613261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-718e27b1-f7d7-489c-8336-83032eaf5ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a9e6fe4aa84bf5a7c80ad13d44f1c1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:30.614093 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-718e27b1-f7d7-489c-8336-83032eaf5ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a9e6fe4aa84bf5a7c80ad13d44f1c1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:30.626391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-718e27b1-f7d7-489c-8336-83032eaf5ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a9e6fe4aa84bf5a7c80ad13d44f1c1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:30.640061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1201/2409] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:36:30 2022] DELETE /identity/v3/users/98a9e6fe4aa84bf5a7c80ad13d44f1c1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:30.831980 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25865580-ac42-4a43-9a40-88b35e1d6d13 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:30.834427 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-25865580-ac42-4a43-9a40-88b35e1d6d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:30.850838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25865580-ac42-4a43-9a40-88b35e1d6d13 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:30.863851 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:30.912509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e5f122-a195-4b6a-8e3a-64809837373a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:30.913641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5f122-a195-4b6a-8e3a-64809837373a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:30.913957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5f122-a195-4b6a-8e3a-64809837373a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:30.914312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5f122-a195-4b6a-8e3a-64809837373a admin admin] PATH_INFO: `/v3/projects/f4a4aa85d40d48de9dda8258716a0f69` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:30.919899 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5f122-a195-4b6a-8e3a-64809837373a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4a4aa85d40d48de9dda8258716a0f69)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:30.919899 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e5f122-a195-4b6a-8e3a-64809837373a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:30.988553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c5e5f122-a195-4b6a-8e3a-64809837373a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4a4aa85d40d48de9dda8258716a0f69', 'request_id': 'req-c5e5f122-a195-4b6a-8e3a-64809837373a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:30.995874 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c5e5f122-a195-4b6a-8e3a-64809837373a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4a4aa85d40d48de9dda8258716a0f69', 'request_id': 'req-c5e5f122-a195-4b6a-8e3a-64809837373a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:31.005092 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c5e5f122-a195-4b6a-8e3a-64809837373a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4a4aa85d40d48de9dda8258716a0f69', 'request_id': 'req-c5e5f122-a195-4b6a-8e3a-64809837373a'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:31.023429 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c5e5f122-a195-4b6a-8e3a-64809837373a admin admin] The token cache is being invalidate because project f4a4aa85d40d48de9dda8258716a0f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:36:31.023724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c5e5f122-a195-4b6a-8e3a-64809837373a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:31.024381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-c5e5f122-a195-4b6a-8e3a-64809837373a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:31.025977 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1209/2410] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:36:30 2022] DELETE /identity/v3/projects/f4a4aa85d40d48de9dda8258716a0f69 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:31.036767 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8e31f-908d-4693-9d4a-5338abec8d1f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:31.037087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8e31f-908d-4693-9d4a-5338abec8d1f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:31.037462 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8e31f-908d-4693-9d4a-5338abec8d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:31.056111 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-6ff8e31f-908d-4693-9d4a-5338abec8d1f None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:31.057325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6ff8e31f-908d-4693-9d4a-5338abec8d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:31.142082 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1202/2411] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:36:31.149807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce498-7f9f-4b62-b759-c142c7e37453 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:31.150099 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce498-7f9f-4b62-b759-c142c7e37453 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:31.150416 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce498-7f9f-4b62-b759-c142c7e37453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:31.173478 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b14ce498-7f9f-4b62-b759-c142c7e37453 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:31.175074 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b14ce498-7f9f-4b62-b759-c142c7e37453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:31.186755 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1210/2412] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:36:31.191072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8e31f-908d-4693-9d4a-5338abec8d1f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:31.201403 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8e31f-908d-4693-9d4a-5338abec8d1f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:31.206230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f979db-b07c-4b37-b728-fb7e6caefca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:31.206950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f979db-b07c-4b37-b728-fb7e6caefca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:31.207231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f979db-b07c-4b37-b728-fb7e6caefca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:31.207541 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f979db-b07c-4b37-b728-fb7e6caefca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:31.208313 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f979db-b07c-4b37-b728-fb7e6caefca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:36:31.208643 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f979db-b07c-4b37-b728-fb7e6caefca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:31.210313 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f979db-b07c-4b37-b728-fb7e6caefca6 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:31.222418 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1203/2413] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:36:31.226781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ce498-7f9f-4b62-b759-c142c7e37453 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:31.236643 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ce498-7f9f-4b62-b759-c142c7e37453 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:31.241862 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244160f-7a4f-4e4f-92fd-889e1be6970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:31.242527 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244160f-7a4f-4e4f-92fd-889e1be6970d admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:31.242815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244160f-7a4f-4e4f-92fd-889e1be6970d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:31.243093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244160f-7a4f-4e4f-92fd-889e1be6970d admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:31.243789 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244160f-7a4f-4e4f-92fd-889e1be6970d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:31.245731 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244160f-7a4f-4e4f-92fd-889e1be6970d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:31.274898 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1211/2414] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:36:31 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:36:31.279635 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f979db-b07c-4b37-b728-fb7e6caefca6 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:31.290292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f979db-b07c-4b37-b728-fb7e6caefca6 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:31.383480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac15e6-7f81-4413-90dd-8640bec12853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:31.384193 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac15e6-7f81-4413-90dd-8640bec12853 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:31.384573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac15e6-7f81-4413-90dd-8640bec12853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:31.384775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac15e6-7f81-4413-90dd-8640bec12853 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:31.387000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac15e6-7f81-4413-90dd-8640bec12853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:31.392543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac15e6-7f81-4413-90dd-8640bec12853 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:31.430361 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1204/2415] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:36:31 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:31.434623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244160f-7a4f-4e4f-92fd-889e1be6970d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:31.450961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244160f-7a4f-4e4f-92fd-889e1be6970d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:31.464489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384f086-65ed-43a6-a9bf-411b15ee39b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:31.465753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384f086-65ed-43a6-a9bf-411b15ee39b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:31.466217 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384f086-65ed-43a6-a9bf-411b15ee39b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:31.476019 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384f086-65ed-43a6-a9bf-411b15ee39b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:31.476261 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384f086-65ed-43a6-a9bf-411b15ee39b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:31.477894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384f086-65ed-43a6-a9bf-411b15ee39b9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:31.490010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1212/2416] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:31.494057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac15e6-7f81-4413-90dd-8640bec12853 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:31.504501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac15e6-7f81-4413-90dd-8640bec12853 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:31.509732 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ff252-1c42-473a-814a-ed7f08a9b202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:31.510466 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ff252-1c42-473a-814a-ed7f08a9b202 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:31.510813 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ff252-1c42-473a-814a-ed7f08a9b202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:31.511151 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ff252-1c42-473a-814a-ed7f08a9b202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:31.511950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ff252-1c42-473a-814a-ed7f08a9b202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:31.513636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ff252-1c42-473a-814a-ed7f08a9b202 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:31.524302 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1205/2417] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:31.528326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384f086-65ed-43a6-a9bf-411b15ee39b9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:31.538250 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384f086-65ed-43a6-a9bf-411b15ee39b9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:31.543076 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9923d8-a74a-4d6b-a928-f9946733a1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:31.543983 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9923d8-a74a-4d6b-a928-f9946733a1e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:31.544264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9923d8-a74a-4d6b-a928-f9946733a1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:31.544538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9923d8-a74a-4d6b-a928-f9946733a1e5 admin admin] PATH_INFO: `/v3/projects/1cbf0844603c4d75818f513f9a092e9e/users/2b20e950bcb54441ae9a6d9f3fb01613/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:31.561428 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9923d8-a74a-4d6b-a928-f9946733a1e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cbf0844603c4d75818f513f9a092e9e, user_id=2b20e950bcb54441ae9a6d9f3fb01613, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:31.565259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9923d8-a74a-4d6b-a928-f9946733a1e5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:31.580663 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1213/2418] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:36:31 2022] PUT /identity/v3/projects/1cbf0844603c4d75818f513f9a092e9e/users/2b20e950bcb54441ae9a6d9f3fb01613/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:36:31.591260 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd0c7b-c010-4997-85c3-13a6d32ec89b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:31.591744 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd0c7b-c010-4997-85c3-13a6d32ec89b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:31.591868 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd0c7b-c010-4997-85c3-13a6d32ec89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:31.598821 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:31.628395 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-83fd0c7b-c010-4997-85c3-13a6d32ec89b None None] MFA Rules not processed for user `2b20e950bcb54441ae9a6d9f3fb01613`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:31.629641 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-83fd0c7b-c010-4997-85c3-13a6d32ec89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:31.700591 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1206/2419] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:31.711705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9923d8-a74a-4d6b-a928-f9946733a1e5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:31.713586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6e9923d8-a74a-4d6b-a928-f9946733a1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:31.763722 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:31.782868 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9923d8-a74a-4d6b-a928-f9946733a1e5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:31.787427 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfedbf2-2b4c-4024-b6f9-7bdab8cac25a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:31.788132 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfedbf2-2b4c-4024-b6f9-7bdab8cac25a service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:31.788368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfedbf2-2b4c-4024-b6f9-7bdab8cac25a service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:31.788660 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfedbf2-2b4c-4024-b6f9-7bdab8cac25a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:31.798047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfedbf2-2b4c-4024-b6f9-7bdab8cac25a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:31.799522 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfedbf2-2b4c-4024-b6f9-7bdab8cac25a service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:31.808951 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1214/2420] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:41.612196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc563f9-2c6b-4c01-90cb-775c3f9a9f72 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:41.612758 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc563f9-2c6b-4c01-90cb-775c3f9a9f72 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:41.612879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc563f9-2c6b-4c01-90cb-775c3f9a9f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:41.632478 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-4cc563f9-2c6b-4c01-90cb-775c3f9a9f72 None None] MFA Rules not processed for user `21c54bf3ff584c709731d3624aa187a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:41.633745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-4cc563f9-2c6b-4c01-90cb-775c3f9a9f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:41.689152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1207/2421] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:41.804708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:42.235719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfedbf2-2b4c-4024-b6f9-7bdab8cac25a service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:42.300974 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfedbf2-2b4c-4024-b6f9-7bdab8cac25a service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:42.305596 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a206fed-8dd4-4761-9cf0-43e8a5d6a4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:42.306572 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a206fed-8dd4-4761-9cf0-43e8a5d6a4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:42.306858 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a206fed-8dd4-4761-9cf0-43e8a5d6a4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:42.307138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a206fed-8dd4-4761-9cf0-43e8a5d6a4c2 admin admin] PATH_INFO: `/v3/users/2b20e950bcb54441ae9a6d9f3fb01613` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:42.308322 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a206fed-8dd4-4761-9cf0-43e8a5d6a4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b20e950bcb54441ae9a6d9f3fb01613)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:42.310282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a206fed-8dd4-4761-9cf0-43e8a5d6a4c2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:42.355679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5a206fed-8dd4-4761-9cf0-43e8a5d6a4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b20e950bcb54441ae9a6d9f3fb01613'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:42.363588 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5a206fed-8dd4-4761-9cf0-43e8a5d6a4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b20e950bcb54441ae9a6d9f3fb01613'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:42.364608 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5a206fed-8dd4-4761-9cf0-43e8a5d6a4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b20e950bcb54441ae9a6d9f3fb01613'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:42.366315 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5a206fed-8dd4-4761-9cf0-43e8a5d6a4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b20e950bcb54441ae9a6d9f3fb01613'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:42.379067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5a206fed-8dd4-4761-9cf0-43e8a5d6a4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b20e950bcb54441ae9a6d9f3fb01613'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:42.393404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1215/2422] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:36:42 2022] DELETE /identity/v3/users/2b20e950bcb54441ae9a6d9f3fb01613 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:42.398167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e2b1a-2049-49c3-bada-d9787ddbe74f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:42.398568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e2b1a-2049-49c3-bada-d9787ddbe74f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:42.398951 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e2b1a-2049-49c3-bada-d9787ddbe74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:42.418069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c25e2b1a-2049-49c3-bada-d9787ddbe74f None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:42.419359 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c25e2b1a-2049-49c3-bada-d9787ddbe74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:42.487396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1208/2423] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:42.505463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a206fed-8dd4-4761-9cf0-43e8a5d6a4c2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:42.507028 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5a206fed-8dd4-4761-9cf0-43e8a5d6a4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:42.570378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a206fed-8dd4-4761-9cf0-43e8a5d6a4c2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:42.574079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475e5e1-9c22-4162-beaa-8fbf5b7daa00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:42.574723 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475e5e1-9c22-4162-beaa-8fbf5b7daa00 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:42.575009 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475e5e1-9c22-4162-beaa-8fbf5b7daa00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:42.575287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475e5e1-9c22-4162-beaa-8fbf5b7daa00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:42.584496 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475e5e1-9c22-4162-beaa-8fbf5b7daa00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:42.585965 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475e5e1-9c22-4162-beaa-8fbf5b7daa00 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:42.595775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1216/2424] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:42.973768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e2b1a-2049-49c3-bada-d9787ddbe74f None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:42.978262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c25e2b1a-2049-49c3-bada-d9787ddbe74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:42.996483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e2b1a-2049-49c3-bada-d9787ddbe74f None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:43.003038 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6134c-a699-4298-9701-bec90eb2da8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:43.003933 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6134c-a699-4298-9701-bec90eb2da8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:43.004210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6134c-a699-4298-9701-bec90eb2da8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:43.004484 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6134c-a699-4298-9701-bec90eb2da8b admin admin] PATH_INFO: `/v3/projects/1cbf0844603c4d75818f513f9a092e9e` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:43.006388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6134c-a699-4298-9701-bec90eb2da8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cbf0844603c4d75818f513f9a092e9e)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:43.008773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6134c-a699-4298-9701-bec90eb2da8b admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:43.049413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:43.060623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-63b6134c-a699-4298-9701-bec90eb2da8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cbf0844603c4d75818f513f9a092e9e', 'request_id': 'req-63b6134c-a699-4298-9701-bec90eb2da8b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:43.073174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-63b6134c-a699-4298-9701-bec90eb2da8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cbf0844603c4d75818f513f9a092e9e', 'request_id': 'req-63b6134c-a699-4298-9701-bec90eb2da8b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:43.082344 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-63b6134c-a699-4298-9701-bec90eb2da8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cbf0844603c4d75818f513f9a092e9e', 'request_id': 'req-63b6134c-a699-4298-9701-bec90eb2da8b'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:43.096204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-63b6134c-a699-4298-9701-bec90eb2da8b admin admin] The token cache is being invalidate because project 1cbf0844603c4d75818f513f9a092e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:36:43.096598 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-63b6134c-a699-4298-9701-bec90eb2da8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:43.097320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-63b6134c-a699-4298-9701-bec90eb2da8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:43.098946 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1209/2425] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:36:42 2022] DELETE /identity/v3/projects/1cbf0844603c4d75818f513f9a092e9e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:43.103917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb587ef4-749a-45df-81f8-2f7e142f6969 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:43.104411 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb587ef4-749a-45df-81f8-2f7e142f6969 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:43.104830 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb587ef4-749a-45df-81f8-2f7e142f6969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:43.122413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-cb587ef4-749a-45df-81f8-2f7e142f6969 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:43.123917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cb587ef4-749a-45df-81f8-2f7e142f6969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:43.144745 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:43.193049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1217/2426] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:36:43.202081 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed2311-6bbf-47e8-b3c6-2d13e55c2470 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:43.202367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed2311-6bbf-47e8-b3c6-2d13e55c2470 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:43.202643 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed2311-6bbf-47e8-b3c6-2d13e55c2470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:43.222359 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-7bed2311-6bbf-47e8-b3c6-2d13e55c2470 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:43.224312 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7bed2311-6bbf-47e8-b3c6-2d13e55c2470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:43.235638 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1210/2427] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:43.240208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb587ef4-749a-45df-81f8-2f7e142f6969 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:43.251005 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb587ef4-749a-45df-81f8-2f7e142f6969 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:43.257088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b6d98-c56e-41dc-90fc-4a41ae2d72a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:43.257844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b6d98-c56e-41dc-90fc-4a41ae2d72a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:43.258129 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b6d98-c56e-41dc-90fc-4a41ae2d72a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:43.258412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b6d98-c56e-41dc-90fc-4a41ae2d72a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:43.259181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b6d98-c56e-41dc-90fc-4a41ae2d72a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:36:43.259493 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b6d98-c56e-41dc-90fc-4a41ae2d72a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:43.261119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b6d98-c56e-41dc-90fc-4a41ae2d72a0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:43.274212 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1218/2428] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:36:43.278886 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed2311-6bbf-47e8-b3c6-2d13e55c2470 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:43.289865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed2311-6bbf-47e8-b3c6-2d13e55c2470 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:43.295157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a9a12-dcd3-457a-9fd5-067630a6be6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:43.295823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a9a12-dcd3-457a-9fd5-067630a6be6f admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:43.296106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a9a12-dcd3-457a-9fd5-067630a6be6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:43.296381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a9a12-dcd3-457a-9fd5-067630a6be6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:43.297076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a9a12-dcd3-457a-9fd5-067630a6be6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:43.299050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a9a12-dcd3-457a-9fd5-067630a6be6f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:43.339394 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1211/2429] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:36:43 2022] POST /identity/v3/projects => generated 397 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:43.345657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b6d98-c56e-41dc-90fc-4a41ae2d72a0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:43.358754 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b6d98-c56e-41dc-90fc-4a41ae2d72a0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:43.423760 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae137f2-1b76-4e3e-b62b-263bb998d0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:43.424446 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae137f2-1b76-4e3e-b62b-263bb998d0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:43.424783 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae137f2-1b76-4e3e-b62b-263bb998d0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:43.425034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae137f2-1b76-4e3e-b62b-263bb998d0c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:43.425748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae137f2-1b76-4e3e-b62b-263bb998d0c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:43.427663 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae137f2-1b76-4e3e-b62b-263bb998d0c2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:43.452181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1219/2430] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:36:43 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:36:43.453455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a9a12-dcd3-457a-9fd5-067630a6be6f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:43.463971 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a9a12-dcd3-457a-9fd5-067630a6be6f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:43.468800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6bd9f-fa4c-4f93-ae47-23873c7ee283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:43.469504 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6bd9f-fa4c-4f93-ae47-23873c7ee283 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:43.469795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6bd9f-fa4c-4f93-ae47-23873c7ee283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:43.470097 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6bd9f-fa4c-4f93-ae47-23873c7ee283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:43.470841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6bd9f-fa4c-4f93-ae47-23873c7ee283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:43.472509 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6bd9f-fa4c-4f93-ae47-23873c7ee283 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:43.484741 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1212/2431] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:43.489906 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae137f2-1b76-4e3e-b62b-263bb998d0c2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:43.503712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae137f2-1b76-4e3e-b62b-263bb998d0c2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:43.510795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f95feb-cc6c-4430-ba86-9e377b50ae6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:43.511733 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f95feb-cc6c-4430-ba86-9e377b50ae6f admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:43.512056 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f95feb-cc6c-4430-ba86-9e377b50ae6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:43.512398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f95feb-cc6c-4430-ba86-9e377b50ae6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:43.513483 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f95feb-cc6c-4430-ba86-9e377b50ae6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:43.515563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f95feb-cc6c-4430-ba86-9e377b50ae6f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:43.527217 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1220/2432] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:36:43.531668 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6bd9f-fa4c-4f93-ae47-23873c7ee283 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:43.543127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6bd9f-fa4c-4f93-ae47-23873c7ee283 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:43.548457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73b508-3e4e-4182-ae22-2980b37468a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:43.549396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73b508-3e4e-4182-ae22-2980b37468a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:43.549671 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73b508-3e4e-4182-ae22-2980b37468a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:43.549953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73b508-3e4e-4182-ae22-2980b37468a1 admin admin] PATH_INFO: `/v3/projects/01c06fd1ffd14af49d6c6829665e1002/users/a39eb98ddc144b3fbc817faeac969e5c/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:43.567887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73b508-3e4e-4182-ae22-2980b37468a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c06fd1ffd14af49d6c6829665e1002, user_id=a39eb98ddc144b3fbc817faeac969e5c, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:43.570619 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73b508-3e4e-4182-ae22-2980b37468a1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:43.586756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1213/2433] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:36:43 2022] PUT /identity/v3/projects/01c06fd1ffd14af49d6c6829665e1002/users/a39eb98ddc144b3fbc817faeac969e5c/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:43.597632 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d65746-bf8d-48ae-97da-f394316e235c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:43.597914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d65746-bf8d-48ae-97da-f394316e235c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:43.598185 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d65746-bf8d-48ae-97da-f394316e235c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:43.631829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e3d65746-bf8d-48ae-97da-f394316e235c None None] MFA Rules not processed for user `a39eb98ddc144b3fbc817faeac969e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:43.633055 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e3d65746-bf8d-48ae-97da-f394316e235c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:43.717177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1221/2434] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:43.729369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73b508-3e4e-4182-ae22-2980b37468a1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:43.731668 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fc73b508-3e4e-4182-ae22-2980b37468a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:43.795808 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73b508-3e4e-4182-ae22-2980b37468a1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:43.799826 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fa5df-5099-4df3-a844-e51ae5ec8f67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:43.800471 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fa5df-5099-4df3-a844-e51ae5ec8f67 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:43.800750 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fa5df-5099-4df3-a844-e51ae5ec8f67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:43.801028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fa5df-5099-4df3-a844-e51ae5ec8f67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:43.811884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fa5df-5099-4df3-a844-e51ae5ec8f67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:43.814176 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fa5df-5099-4df3-a844-e51ae5ec8f67 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:43.823946 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1214/2435] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:48.867730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d65746-bf8d-48ae-97da-f394316e235c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:48.889680 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:48.942655 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d65746-bf8d-48ae-97da-f394316e235c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:48.947348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2a656-d238-413c-96a6-f9e143f41b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:48.948358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2a656-d238-413c-96a6-f9e143f41b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:48.948641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2a656-d238-413c-96a6-f9e143f41b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:48.948921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2a656-d238-413c-96a6-f9e143f41b93 admin admin] PATH_INFO: `/v3/users/a39eb98ddc144b3fbc817faeac969e5c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:48.950328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2a656-d238-413c-96a6-f9e143f41b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a39eb98ddc144b3fbc817faeac969e5c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:48.952195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2a656-d238-413c-96a6-f9e143f41b93 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:48.999742 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1cc2a656-d238-413c-96a6-f9e143f41b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a39eb98ddc144b3fbc817faeac969e5c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:49.008077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1cc2a656-d238-413c-96a6-f9e143f41b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a39eb98ddc144b3fbc817faeac969e5c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:49.008777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1cc2a656-d238-413c-96a6-f9e143f41b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a39eb98ddc144b3fbc817faeac969e5c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:49.009442 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1cc2a656-d238-413c-96a6-f9e143f41b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a39eb98ddc144b3fbc817faeac969e5c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:49.022020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-1cc2a656-d238-413c-96a6-f9e143f41b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a39eb98ddc144b3fbc817faeac969e5c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:49.034720 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1222/2436] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:36:48 2022] DELETE /identity/v3/users/a39eb98ddc144b3fbc817faeac969e5c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:49.040135 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f2bab-2c8e-434a-bea4-819ee99df814 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:49.040636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f2bab-2c8e-434a-bea4-819ee99df814 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:49.040728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f2bab-2c8e-434a-bea4-819ee99df814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:49.058718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-0e6f2bab-2c8e-434a-bea4-819ee99df814 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:49.059937 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0e6f2bab-2c8e-434a-bea4-819ee99df814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:49.139590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1215/2437] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:36:49.149852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2a656-d238-413c-96a6-f9e143f41b93 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:49.151458 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1cc2a656-d238-413c-96a6-f9e143f41b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:49.214405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2a656-d238-413c-96a6-f9e143f41b93 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:49.220724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf1a22-f099-49ef-8b52-2e42c8fa15ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:49.221471 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf1a22-f099-49ef-8b52-2e42c8fa15ba service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:49.221762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf1a22-f099-49ef-8b52-2e42c8fa15ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:49.222040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf1a22-f099-49ef-8b52-2e42c8fa15ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:49.232918 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf1a22-f099-49ef-8b52-2e42c8fa15ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:49.234425 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf1a22-f099-49ef-8b52-2e42c8fa15ba service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:49.244307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1223/2438] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:36:49.723589 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f2bab-2c8e-434a-bea4-819ee99df814 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:49.726005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0e6f2bab-2c8e-434a-bea4-819ee99df814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:49.749940 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:49.766423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f2bab-2c8e-434a-bea4-819ee99df814 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:49.777870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d4916-2f5e-45d1-a51b-4615594724ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:49.779875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d4916-2f5e-45d1-a51b-4615594724ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:49.780486 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d4916-2f5e-45d1-a51b-4615594724ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:49.781222 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d4916-2f5e-45d1-a51b-4615594724ff admin admin] PATH_INFO: `/v3/projects/01c06fd1ffd14af49d6c6829665e1002` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:49.782798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d4916-2f5e-45d1-a51b-4615594724ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c06fd1ffd14af49d6c6829665e1002)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:49.788373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d4916-2f5e-45d1-a51b-4615594724ff admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:49.807521 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709fea0-28aa-46b5-980f-6649c6296214 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:49.808106 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709fea0-28aa-46b5-980f-6649c6296214 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:49.808635 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709fea0-28aa-46b5-980f-6649c6296214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:49.828879 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b709fea0-28aa-46b5-980f-6649c6296214 None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:36:49.830881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b709fea0-28aa-46b5-980f-6649c6296214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:49.862657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-810d4916-2f5e-45d1-a51b-4615594724ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c06fd1ffd14af49d6c6829665e1002', 'request_id': 'req-810d4916-2f5e-45d1-a51b-4615594724ff'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:49.868332 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-810d4916-2f5e-45d1-a51b-4615594724ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c06fd1ffd14af49d6c6829665e1002', 'request_id': 'req-810d4916-2f5e-45d1-a51b-4615594724ff'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:49.872014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:36:49.874922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-810d4916-2f5e-45d1-a51b-4615594724ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c06fd1ffd14af49d6c6829665e1002', 'request_id': 'req-810d4916-2f5e-45d1-a51b-4615594724ff'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:49.890672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-810d4916-2f5e-45d1-a51b-4615594724ff admin admin] The token cache is being invalidate because project 01c06fd1ffd14af49d6c6829665e1002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:36:49.890968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-810d4916-2f5e-45d1-a51b-4615594724ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:49.891600 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-810d4916-2f5e-45d1-a51b-4615594724ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:36:49.893204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1216/2439] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:36:49 2022] DELETE /identity/v3/projects/01c06fd1ffd14af49d6c6829665e1002 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:36:49.899103 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1224/2440] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 15 00:36:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:36:49.952022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d4916-2f5e-45d1-a51b-4615594724ff admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:36:49.953589 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-810d4916-2f5e-45d1-a51b-4615594724ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:36:50.036987 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d4916-2f5e-45d1-a51b-4615594724ff admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:36:50.043022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaaef0a-08ec-49ee-a6c9-8ac48a3f78e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:36:50.043715 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaef0a-08ec-49ee-a6c9-8ac48a3f78e5 service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:36:50.044674 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaef0a-08ec-49ee-a6c9-8ac48a3f78e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:36:50.044990 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaef0a-08ec-49ee-a6c9-8ac48a3f78e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:36:50.115507 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaaef0a-08ec-49ee-a6c9-8ac48a3f78e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:36:50.117048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaaef0a-08ec-49ee-a6c9-8ac48a3f78e5 service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:36:50.126540 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1217/2441] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:36:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:36:59.892030 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:00.122282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:01.654337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709fea0-28aa-46b5-980f-6649c6296214 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:01.655874 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b709fea0-28aa-46b5-980f-6649c6296214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:01.681886 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709fea0-28aa-46b5-980f-6649c6296214 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:01.753093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9781bf-e60c-4cb1-adde-dc8dbe303afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:01.754559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9781bf-e60c-4cb1-adde-dc8dbe303afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:01.755057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9781bf-e60c-4cb1-adde-dc8dbe303afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:01.755516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9781bf-e60c-4cb1-adde-dc8dbe303afa admin admin] PATH_INFO: `/v3/users/f0e6d622a93b44738ee7baf64d1d2481` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:01.756935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9781bf-e60c-4cb1-adde-dc8dbe303afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e6d622a93b44738ee7baf64d1d2481)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:01.759095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9781bf-e60c-4cb1-adde-dc8dbe303afa admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:01.813283 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d9781bf-e60c-4cb1-adde-dc8dbe303afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e6d622a93b44738ee7baf64d1d2481'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:01.822998 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d9781bf-e60c-4cb1-adde-dc8dbe303afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e6d622a93b44738ee7baf64d1d2481'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:01.823975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d9781bf-e60c-4cb1-adde-dc8dbe303afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e6d622a93b44738ee7baf64d1d2481'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:01.824342 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d9781bf-e60c-4cb1-adde-dc8dbe303afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e6d622a93b44738ee7baf64d1d2481'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:01.838312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5d9781bf-e60c-4cb1-adde-dc8dbe303afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e6d622a93b44738ee7baf64d1d2481'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:01.851508 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1225/2442] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:37:01 2022] DELETE /identity/v3/users/f0e6d622a93b44738ee7baf64d1d2481 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:37:01.856244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045151b-fc15-4d55-833a-2f8448fbe577 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:01.856891 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045151b-fc15-4d55-833a-2f8448fbe577 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:01.857131 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045151b-fc15-4d55-833a-2f8448fbe577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:01.889431 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-6045151b-fc15-4d55-833a-2f8448fbe577 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:01.893884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6045151b-fc15-4d55-833a-2f8448fbe577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:02.010669 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1218/2443] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:02.021551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9781bf-e60c-4cb1-adde-dc8dbe303afa admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:02.023211 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5d9781bf-e60c-4cb1-adde-dc8dbe303afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:02.100354 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9781bf-e60c-4cb1-adde-dc8dbe303afa admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:02.104054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ddd1f-3cdc-432a-85bf-965d2aa57e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:02.105006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ddd1f-3cdc-432a-85bf-965d2aa57e4d service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:02.105330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ddd1f-3cdc-432a-85bf-965d2aa57e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:02.105746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ddd1f-3cdc-432a-85bf-965d2aa57e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:02.117228 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ddd1f-3cdc-432a-85bf-965d2aa57e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:02.118587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ddd1f-3cdc-432a-85bf-965d2aa57e4d service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:02.129104 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1226/2444] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:37:02.566678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045151b-fc15-4d55-833a-2f8448fbe577 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:02.569296 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6045151b-fc15-4d55-833a-2f8448fbe577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:02.602374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045151b-fc15-4d55-833a-2f8448fbe577 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:02.630108 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1b480-c76b-41bc-b8a2-fa634d984b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:02.631023 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1b480-c76b-41bc-b8a2-fa634d984b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:02.631311 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1b480-c76b-41bc-b8a2-fa634d984b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:02.631592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1b480-c76b-41bc-b8a2-fa634d984b86 admin admin] PATH_INFO: `/v3/projects/783c2657453743078dab87d792b67878` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:02.636707 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1b480-c76b-41bc-b8a2-fa634d984b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=783c2657453743078dab87d792b67878)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:02.638678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1b480-c76b-41bc-b8a2-fa634d984b86 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:02.709521 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9aa1b480-c76b-41bc-b8a2-fa634d984b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783c2657453743078dab87d792b67878', 'request_id': 'req-9aa1b480-c76b-41bc-b8a2-fa634d984b86'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:02.717981 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9aa1b480-c76b-41bc-b8a2-fa634d984b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783c2657453743078dab87d792b67878', 'request_id': 'req-9aa1b480-c76b-41bc-b8a2-fa634d984b86'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:02.725009 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9aa1b480-c76b-41bc-b8a2-fa634d984b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783c2657453743078dab87d792b67878', 'request_id': 'req-9aa1b480-c76b-41bc-b8a2-fa634d984b86'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:02.742873 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9aa1b480-c76b-41bc-b8a2-fa634d984b86 admin admin] The token cache is being invalidate because project 783c2657453743078dab87d792b67878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:37:02.743171 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9aa1b480-c76b-41bc-b8a2-fa634d984b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:02.743860 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9aa1b480-c76b-41bc-b8a2-fa634d984b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:02.749866 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1219/2445] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:37:02 2022] DELETE /identity/v3/projects/783c2657453743078dab87d792b67878 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:37:02.752206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4592dd0-680d-4ecf-a3aa-7fcd06ddef80 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:02.752948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4592dd0-680d-4ecf-a3aa-7fcd06ddef80 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:02.754374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4592dd0-680d-4ecf-a3aa-7fcd06ddef80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:02.786482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c4592dd0-680d-4ecf-a3aa-7fcd06ddef80 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:02.788399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c4592dd0-680d-4ecf-a3aa-7fcd06ddef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:02.823893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:02.919694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1227/2446] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:02.925024 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931721a-c3b9-4d10-931d-b80474661eaf None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:02.926514 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931721a-c3b9-4d10-931d-b80474661eaf None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:02.926945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931721a-c3b9-4d10-931d-b80474661eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:02.956577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e931721a-c3b9-4d10-931d-b80474661eaf None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:02.963364 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e931721a-c3b9-4d10-931d-b80474661eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:02.990724 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1220/2447] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:02.995522 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4592dd0-680d-4ecf-a3aa-7fcd06ddef80 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:03.007611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4592dd0-680d-4ecf-a3aa-7fcd06ddef80 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:03.014345 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30043fb2-2238-40c0-ac0d-9d4d81277d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:03.015640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30043fb2-2238-40c0-ac0d-9d4d81277d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:03.016021 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30043fb2-2238-40c0-ac0d-9d4d81277d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:03.016397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30043fb2-2238-40c0-ac0d-9d4d81277d22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:03.017385 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30043fb2-2238-40c0-ac0d-9d4d81277d22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:37:03.017827 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30043fb2-2238-40c0-ac0d-9d4d81277d22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:03.020103 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30043fb2-2238-40c0-ac0d-9d4d81277d22 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:03.040304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1228/2448] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:37:03.040981 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931721a-c3b9-4d10-931d-b80474661eaf None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:03.052726 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931721a-c3b9-4d10-931d-b80474661eaf None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:03.071363 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62cd3f-0a07-45b6-9943-234135aad586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:03.072580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62cd3f-0a07-45b6-9943-234135aad586 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:03.073064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62cd3f-0a07-45b6-9943-234135aad586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:03.073610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62cd3f-0a07-45b6-9943-234135aad586 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:03.074607 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62cd3f-0a07-45b6-9943-234135aad586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:03.079298 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62cd3f-0a07-45b6-9943-234135aad586 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:03.139834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1221/2449] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:37:03 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:37:03.144042 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30043fb2-2238-40c0-ac0d-9d4d81277d22 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:03.155912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30043fb2-2238-40c0-ac0d-9d4d81277d22 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:03.257798 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335150b6-553f-4872-b94d-3772afe2b39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:03.258488 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335150b6-553f-4872-b94d-3772afe2b39f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:03.258773 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335150b6-553f-4872-b94d-3772afe2b39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:03.259052 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335150b6-553f-4872-b94d-3772afe2b39f admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:03.259760 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335150b6-553f-4872-b94d-3772afe2b39f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:03.261705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335150b6-553f-4872-b94d-3772afe2b39f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:03.286989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1229/2450] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:37:03 2022] POST /identity/v3/users => generated 285 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:37:03.292063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62cd3f-0a07-45b6-9943-234135aad586 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:03.305985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62cd3f-0a07-45b6-9943-234135aad586 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:03.312021 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d0ec8-f3a6-4f3f-8e66-59e48ad3f19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:03.312747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d0ec8-f3a6-4f3f-8e66-59e48ad3f19d admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:03.313114 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d0ec8-f3a6-4f3f-8e66-59e48ad3f19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:03.313424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d0ec8-f3a6-4f3f-8e66-59e48ad3f19d admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:03.314429 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d0ec8-f3a6-4f3f-8e66-59e48ad3f19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:03.316409 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d0ec8-f3a6-4f3f-8e66-59e48ad3f19d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:03.333638 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335150b6-553f-4872-b94d-3772afe2b39f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:03.340376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1222/2451] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:37:03.350915 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335150b6-553f-4872-b94d-3772afe2b39f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:03.356898 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f0c43-d57d-44bb-a1be-e7b902c4fbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:03.358437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f0c43-d57d-44bb-a1be-e7b902c4fbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:03.358950 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f0c43-d57d-44bb-a1be-e7b902c4fbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:03.359446 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f0c43-d57d-44bb-a1be-e7b902c4fbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:03.362498 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f0c43-d57d-44bb-a1be-e7b902c4fbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:03.362719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f0c43-d57d-44bb-a1be-e7b902c4fbc9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:03.392808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1230/2452] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:37:03.397089 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d0ec8-f3a6-4f3f-8e66-59e48ad3f19d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:03.412494 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d0ec8-f3a6-4f3f-8e66-59e48ad3f19d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:03.419253 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a550a8-2fc2-4246-bd4a-b9a73d128a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:03.420607 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a550a8-2fc2-4246-bd4a-b9a73d128a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:03.420824 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a550a8-2fc2-4246-bd4a-b9a73d128a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:03.421109 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a550a8-2fc2-4246-bd4a-b9a73d128a9c admin admin] PATH_INFO: `/v3/projects/1c30aa53c4a545fa8bdb84b3dd2025c5/users/3a5647f19ddb4875b9c8dcbdb41db3a6/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:03.450528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a550a8-2fc2-4246-bd4a-b9a73d128a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c30aa53c4a545fa8bdb84b3dd2025c5, user_id=3a5647f19ddb4875b9c8dcbdb41db3a6, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:03.454013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a550a8-2fc2-4246-bd4a-b9a73d128a9c admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:03.472506 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1223/2453] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:37:03 2022] PUT /identity/v3/projects/1c30aa53c4a545fa8bdb84b3dd2025c5/users/3a5647f19ddb4875b9c8dcbdb41db3a6/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:37:03.484131 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd55a6-ca92-43e9-97b0-0d0fe3de818c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:03.484492 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd55a6-ca92-43e9-97b0-0d0fe3de818c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:03.484836 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd55a6-ca92-43e9-97b0-0d0fe3de818c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:03.511405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3ccd55a6-ca92-43e9-97b0-0d0fe3de818c None None] MFA Rules not processed for user `3a5647f19ddb4875b9c8dcbdb41db3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:03.512625 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3ccd55a6-ca92-43e9-97b0-0d0fe3de818c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:03.581641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1231/2454] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:03.593012 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a550a8-2fc2-4246-bd4a-b9a73d128a9c admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:03.594837 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-61a550a8-2fc2-4246-bd4a-b9a73d128a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:03.617297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:03.657573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a550a8-2fc2-4246-bd4a-b9a73d128a9c admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:03.661857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5bc12-598e-4636-a417-b79d0c8abd1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a239897b9a0644ef9d2e0e2e333232fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:03.662512 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bc12-598e-4636-a417-b79d0c8abd1d service glance] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:03.662795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bc12-598e-4636-a417-b79d0c8abd1d service glance] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:03.663070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bc12-598e-4636-a417-b79d0c8abd1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:03.671889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5bc12-598e-4636-a417-b79d0c8abd1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:03.673272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5bc12-598e-4636-a417-b79d0c8abd1d service glance] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:03.682247 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1224/2455] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:37:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:37:03.969724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b1961-1549-4207-a3bf-cbcd00f3ce4e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:03.970252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b1961-1549-4207-a3bf-cbcd00f3ce4e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:03.970367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b1961-1549-4207-a3bf-cbcd00f3ce4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:03.991606 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a44b1961-1549-4207-a3bf-cbcd00f3ce4e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:03.992846 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a44b1961-1549-4207-a3bf-cbcd00f3ce4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:04.014183 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:04.154423 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1232/2456] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jun 15 00:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:37:04.178592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5bc12-598e-4636-a417-b79d0c8abd1d service glance] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:04.180052 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3bb5bc12-598e-4636-a417-b79d0c8abd1d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:04.324270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5bc12-598e-4636-a417-b79d0c8abd1d service glance] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:04.335132 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e1d77-08f0-4e84-993e-3bb16cb963de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:04.335898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e1d77-08f0-4e84-993e-3bb16cb963de service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:04.336454 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e1d77-08f0-4e84-993e-3bb16cb963de service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:04.336888 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e1d77-08f0-4e84-993e-3bb16cb963de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:04.348778 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e1d77-08f0-4e84-993e-3bb16cb963de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:04.350563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e1d77-08f0-4e84-993e-3bb16cb963de service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:04.363645 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1225/2457] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:37:07.811036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b1961-1549-4207-a3bf-cbcd00f3ce4e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:07.812497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a44b1961-1549-4207-a3bf-cbcd00f3ce4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:07.825421 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b1961-1549-4207-a3bf-cbcd00f3ce4e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:07.832089 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe7218-2fd2-40c4-8339-5c51d221ca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:07.833190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe7218-2fd2-40c4-8339-5c51d221ca61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:07.833524 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe7218-2fd2-40c4-8339-5c51d221ca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:07.833805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe7218-2fd2-40c4-8339-5c51d221ca61 admin admin] PATH_INFO: `/v3/users/07385504bd68454da616025cada3279d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:07.835117 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe7218-2fd2-40c4-8339-5c51d221ca61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07385504bd68454da616025cada3279d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:07.837098 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe7218-2fd2-40c4-8339-5c51d221ca61 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:07.906584 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-29fe7218-2fd2-40c4-8339-5c51d221ca61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07385504bd68454da616025cada3279d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:07.921814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-29fe7218-2fd2-40c4-8339-5c51d221ca61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07385504bd68454da616025cada3279d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:07.922801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-29fe7218-2fd2-40c4-8339-5c51d221ca61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07385504bd68454da616025cada3279d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:07.923783 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-29fe7218-2fd2-40c4-8339-5c51d221ca61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07385504bd68454da616025cada3279d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:07.946509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-29fe7218-2fd2-40c4-8339-5c51d221ca61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07385504bd68454da616025cada3279d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:07.969185 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1233/2458] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:37:07 2022] DELETE /identity/v3/users/07385504bd68454da616025cada3279d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:37:07.975397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343646a-dbea-46c3-a90b-2ae19193569b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:07.975993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343646a-dbea-46c3-a90b-2ae19193569b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:07.975993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343646a-dbea-46c3-a90b-2ae19193569b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:08.003235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-3343646a-dbea-46c3-a90b-2ae19193569b None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:08.005724 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3343646a-dbea-46c3-a90b-2ae19193569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:08.129948 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1226/2459] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:08.137316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe7218-2fd2-40c4-8339-5c51d221ca61 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:08.141222 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-29fe7218-2fd2-40c4-8339-5c51d221ca61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:08.252911 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe7218-2fd2-40c4-8339-5c51d221ca61 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:08.258639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cce4f4-4050-491a-bcb9-228644761e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:08.259623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cce4f4-4050-491a-bcb9-228644761e73 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:08.260012 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cce4f4-4050-491a-bcb9-228644761e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:08.260291 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cce4f4-4050-491a-bcb9-228644761e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:08.276049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cce4f4-4050-491a-bcb9-228644761e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:08.278139 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cce4f4-4050-491a-bcb9-228644761e73 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:08.292244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1234/2460] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:37:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:37:08.645007 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343646a-dbea-46c3-a90b-2ae19193569b None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:08.646936 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3343646a-dbea-46c3-a90b-2ae19193569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:08.668333 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343646a-dbea-46c3-a90b-2ae19193569b None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:08.675733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bf348-3694-412d-91dd-236b1c6083ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:08.677937 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf348-3694-412d-91dd-236b1c6083ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:08.678252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf348-3694-412d-91dd-236b1c6083ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:08.678615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf348-3694-412d-91dd-236b1c6083ad admin admin] PATH_INFO: `/v3/projects/4ba28fd3243549faa003ed7c0c46c761` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:08.680260 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bf348-3694-412d-91dd-236b1c6083ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ba28fd3243549faa003ed7c0c46c761)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:08.682971 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bf348-3694-412d-91dd-236b1c6083ad admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:08.761072 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:08.767563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5a1bf348-3694-412d-91dd-236b1c6083ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ba28fd3243549faa003ed7c0c46c761', 'request_id': 'req-5a1bf348-3694-412d-91dd-236b1c6083ad'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:08.774279 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5a1bf348-3694-412d-91dd-236b1c6083ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ba28fd3243549faa003ed7c0c46c761', 'request_id': 'req-5a1bf348-3694-412d-91dd-236b1c6083ad'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:08.781167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5a1bf348-3694-412d-91dd-236b1c6083ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ba28fd3243549faa003ed7c0c46c761', 'request_id': 'req-5a1bf348-3694-412d-91dd-236b1c6083ad'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:08.799079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5a1bf348-3694-412d-91dd-236b1c6083ad admin admin] The token cache is being invalidate because project 4ba28fd3243549faa003ed7c0c46c761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:37:08.799490 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5a1bf348-3694-412d-91dd-236b1c6083ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:08.800237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5a1bf348-3694-412d-91dd-236b1c6083ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:08.803473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1227/2461] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:37:08 2022] DELETE /identity/v3/projects/4ba28fd3243549faa003ed7c0c46c761 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:37:08.808607 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb637a8-9b69-470d-972d-230be6298cab None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:08.809217 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb637a8-9b69-470d-972d-230be6298cab None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:08.809713 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb637a8-9b69-470d-972d-230be6298cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:08.836020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8cb637a8-9b69-470d-972d-230be6298cab None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:08.842939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8cb637a8-9b69-470d-972d-230be6298cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:08.897261 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:08.940613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1235/2462] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:08.949244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb862beb-5add-4b88-b668-d081996c3fd1 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:08.949631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb862beb-5add-4b88-b668-d081996c3fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:08.950022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb862beb-5add-4b88-b668-d081996c3fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:08.968857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-cb862beb-5add-4b88-b668-d081996c3fd1 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:08.970207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-cb862beb-5add-4b88-b668-d081996c3fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:08.978300 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1228/2463] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:37:08.983572 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb637a8-9b69-470d-972d-230be6298cab None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:08.994724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb637a8-9b69-470d-972d-230be6298cab None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:08.999583 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a406fa-5932-4711-b6e6-e9ce65b73270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:09.000275 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a406fa-5932-4711-b6e6-e9ce65b73270 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:09.000601 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a406fa-5932-4711-b6e6-e9ce65b73270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:09.000922 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a406fa-5932-4711-b6e6-e9ce65b73270 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:09.001744 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a406fa-5932-4711-b6e6-e9ce65b73270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:37:09.002057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a406fa-5932-4711-b6e6-e9ce65b73270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:09.003666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a406fa-5932-4711-b6e6-e9ce65b73270 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:09.015929 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1236/2464] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:37:09.020769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb862beb-5add-4b88-b668-d081996c3fd1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:09.031293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb862beb-5add-4b88-b668-d081996c3fd1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:09.036693 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a32e2-6e84-4bc5-a9d1-05eeee0a36f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:09.037373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a32e2-6e84-4bc5-a9d1-05eeee0a36f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:09.037673 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a32e2-6e84-4bc5-a9d1-05eeee0a36f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:09.037952 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a32e2-6e84-4bc5-a9d1-05eeee0a36f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:09.038652 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a32e2-6e84-4bc5-a9d1-05eeee0a36f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:09.040623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a32e2-6e84-4bc5-a9d1-05eeee0a36f4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:09.072808 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1229/2465] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:37:09 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:37:09.077247 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a406fa-5932-4711-b6e6-e9ce65b73270 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:09.089830 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a406fa-5932-4711-b6e6-e9ce65b73270 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:09.100352 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef14f2e-d7de-4c7e-a490-9b313f5189d2 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:09.100823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef14f2e-d7de-4c7e-a490-9b313f5189d2 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:09.101268 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef14f2e-d7de-4c7e-a490-9b313f5189d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:09.123712 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5ef14f2e-d7de-4c7e-a490-9b313f5189d2 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:09.125038 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5ef14f2e-d7de-4c7e-a490-9b313f5189d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:09.192406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cd5db-8b71-4dd7-a865-5609876d7165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:09.193294 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cd5db-8b71-4dd7-a865-5609876d7165 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:09.193753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cd5db-8b71-4dd7-a865-5609876d7165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:09.194529 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cd5db-8b71-4dd7-a865-5609876d7165 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:09.195400 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cd5db-8b71-4dd7-a865-5609876d7165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:09.197549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cd5db-8b71-4dd7-a865-5609876d7165 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:09.210055 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1230/2466] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jun 15 00:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:09.222273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1237/2467] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:37:09 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:37:09.226337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef14f2e-d7de-4c7e-a490-9b313f5189d2 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:09.233717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cd5db-8b71-4dd7-a865-5609876d7165 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:09.236109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b96cd5db-8b71-4dd7-a865-5609876d7165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:09.237715 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef14f2e-d7de-4c7e-a490-9b313f5189d2 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:09.243018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579086e3-11ff-4e63-b977-e1ba6278176a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:09.243886 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579086e3-11ff-4e63-b977-e1ba6278176a admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:09.244184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579086e3-11ff-4e63-b977-e1ba6278176a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:09.244593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579086e3-11ff-4e63-b977-e1ba6278176a admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:09.245326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579086e3-11ff-4e63-b977-e1ba6278176a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:09.247050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579086e3-11ff-4e63-b977-e1ba6278176a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:09.261531 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1231/2468] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:37:09.265733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579086e3-11ff-4e63-b977-e1ba6278176a admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:09.284889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579086e3-11ff-4e63-b977-e1ba6278176a admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:09.291669 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9beaf-c46a-4a70-9b80-a39581706b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:09.292612 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9beaf-c46a-4a70-9b80-a39581706b98 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:09.293026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9beaf-c46a-4a70-9b80-a39581706b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:09.293269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9beaf-c46a-4a70-9b80-a39581706b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:09.294563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9beaf-c46a-4a70-9b80-a39581706b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:09.296819 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9beaf-c46a-4a70-9b80-a39581706b98 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:09.312493 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1232/2469] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:37:09.313576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9beaf-c46a-4a70-9b80-a39581706b98 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:09.325652 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9beaf-c46a-4a70-9b80-a39581706b98 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:09.326133 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cd5db-8b71-4dd7-a865-5609876d7165 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:09.333434 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e206e12-dc83-443f-a798-7b5d51e91d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:09.334158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e206e12-dc83-443f-a798-7b5d51e91d7a service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:09.334447 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e206e12-dc83-443f-a798-7b5d51e91d7a service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:09.334721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e206e12-dc83-443f-a798-7b5d51e91d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:09.338811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadc3fe-fd4c-452e-8b2a-50700cec07a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:09.339959 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadc3fe-fd4c-452e-8b2a-50700cec07a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:09.340627 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadc3fe-fd4c-452e-8b2a-50700cec07a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:09.341275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadc3fe-fd4c-452e-8b2a-50700cec07a4 admin admin] PATH_INFO: `/v3/projects/67cb5963999041a8a48327606802eb29/users/3cac8dcc34944ee396449e8ffb204f01/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:09.344516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e206e12-dc83-443f-a798-7b5d51e91d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:09.346324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e206e12-dc83-443f-a798-7b5d51e91d7a service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:09.356824 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1238/2470] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:37:09.367127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadc3fe-fd4c-452e-8b2a-50700cec07a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cb5963999041a8a48327606802eb29, user_id=3cac8dcc34944ee396449e8ffb204f01, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:09.371466 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadc3fe-fd4c-452e-8b2a-50700cec07a4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:09.393387 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1233/2471] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:37:09 2022] PUT /identity/v3/projects/67cb5963999041a8a48327606802eb29/users/3cac8dcc34944ee396449e8ffb204f01/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:37:09.399522 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b016f-235e-48f9-abde-84902bb3049c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:09.400029 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b016f-235e-48f9-abde-84902bb3049c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:09.400148 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b016f-235e-48f9-abde-84902bb3049c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:09.432807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1b9b016f-235e-48f9-abde-84902bb3049c None None] MFA Rules not processed for user `3cac8dcc34944ee396449e8ffb204f01`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:09.434711 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1b9b016f-235e-48f9-abde-84902bb3049c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:09.464412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:09.510903 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1239/2472] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:37:09.523569 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadc3fe-fd4c-452e-8b2a-50700cec07a4 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:09.526578 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-acadc3fe-fd4c-452e-8b2a-50700cec07a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:09.608141 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadc3fe-fd4c-452e-8b2a-50700cec07a4 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:09.612471 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd565705-6172-492f-8eab-533d19d9284a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:09.613129 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd565705-6172-492f-8eab-533d19d9284a service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:09.613450 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd565705-6172-492f-8eab-533d19d9284a service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:09.613729 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd565705-6172-492f-8eab-533d19d9284a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:09.625937 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd565705-6172-492f-8eab-533d19d9284a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:09.627964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd565705-6172-492f-8eab-533d19d9284a service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:09.633814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:09.641226 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1234/2473] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:37:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:37:11.030889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa92071-47d5-4e2c-a396-72fcd4c81c9c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:11.031538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa92071-47d5-4e2c-a396-72fcd4c81c9c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:11.031538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa92071-47d5-4e2c-a396-72fcd4c81c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:11.052022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7fa92071-47d5-4e2c-a396-72fcd4c81c9c None None] MFA Rules not processed for user `3cac8dcc34944ee396449e8ffb204f01`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:11.053232 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7fa92071-47d5-4e2c-a396-72fcd4c81c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:11.061067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1240/2474] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:12.406356 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4600b-b854-464e-9b9f-f45c944ac23d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:12.406995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4600b-b854-464e-9b9f-f45c944ac23d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:12.406995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4600b-b854-464e-9b9f-f45c944ac23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:12.453629 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d6f4600b-b854-464e-9b9f-f45c944ac23d None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:12.455333 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d6f4600b-b854-464e-9b9f-f45c944ac23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:12.562407 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1235/2475] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jun 15 00:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:12.597744 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa92071-47d5-4e2c-a396-72fcd4c81c9c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:12.679334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa92071-47d5-4e2c-a396-72fcd4c81c9c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:12.685802 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9a4d1-75ec-4b65-b482-cb994e793165 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:12.686677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9a4d1-75ec-4b65-b482-cb994e793165 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:12.686964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9a4d1-75ec-4b65-b482-cb994e793165 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:12.687242 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9a4d1-75ec-4b65-b482-cb994e793165 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:12.698082 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9a4d1-75ec-4b65-b482-cb994e793165 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:12.699131 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9a4d1-75ec-4b65-b482-cb994e793165 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:12.710430 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1241/2476] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:37:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:37:15.430654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e750b-4b9d-4845-889a-eff9cff81ff7 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:15.431287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e750b-4b9d-4845-889a-eff9cff81ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:15.431287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e750b-4b9d-4845-889a-eff9cff81ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:15.512421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9f8e750b-4b9d-4845-889a-eff9cff81ff7 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:15.514056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9f8e750b-4b9d-4845-889a-eff9cff81ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:15.570930 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1236/2477] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jun 15 00:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:15.612051 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9a4d1-75ec-4b65-b482-cb994e793165 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:15.664656 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9a4d1-75ec-4b65-b482-cb994e793165 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:15.671420 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823eb94a-8b5e-4e9d-b872-5beea7a9f265 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:15.672354 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eb94a-8b5e-4e9d-b872-5beea7a9f265 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:15.672639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eb94a-8b5e-4e9d-b872-5beea7a9f265 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:15.672939 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eb94a-8b5e-4e9d-b872-5beea7a9f265 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:15.682289 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823eb94a-8b5e-4e9d-b872-5beea7a9f265 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:15.683871 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823eb94a-8b5e-4e9d-b872-5beea7a9f265 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:15.694492 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1242/2478] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:37:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:37:19.639420 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010c367-ce79-4245-9448-d2acfa07eb62 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:19.639939 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010c367-ce79-4245-9448-d2acfa07eb62 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:19.640043 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010c367-ce79-4245-9448-d2acfa07eb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:19.663660 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-3010c367-ce79-4245-9448-d2acfa07eb62 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:19.665377 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3010c367-ce79-4245-9448-d2acfa07eb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:19.678504 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1237/2479] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jun 15 00:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:19.710769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823eb94a-8b5e-4e9d-b872-5beea7a9f265 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:19.723224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823eb94a-8b5e-4e9d-b872-5beea7a9f265 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:19.729891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34099c-1664-4aa3-88b4-8f490b01d3e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:19.730540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34099c-1664-4aa3-88b4-8f490b01d3e4 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:19.730811 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34099c-1664-4aa3-88b4-8f490b01d3e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:19.731087 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b34099c-1664-4aa3-88b4-8f490b01d3e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:19.740829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34099c-1664-4aa3-88b4-8f490b01d3e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:19.742516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b34099c-1664-4aa3-88b4-8f490b01d3e4 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:19.752520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1243/2480] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:37:24.048762 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0faf3a-95ee-4a52-b5d0-5323b73b4511 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:24.049728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0faf3a-95ee-4a52-b5d0-5323b73b4511 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:24.049728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0faf3a-95ee-4a52-b5d0-5323b73b4511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:24.075196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-da0faf3a-95ee-4a52-b5d0-5323b73b4511 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:24.076514 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-da0faf3a-95ee-4a52-b5d0-5323b73b4511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:24.086553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1238/2481] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jun 15 00:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:24.112628 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34099c-1664-4aa3-88b4-8f490b01d3e4 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:24.124018 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b34099c-1664-4aa3-88b4-8f490b01d3e4 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:24.130073 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71b116-7204-428b-a552-2f8c407facd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:24.130707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71b116-7204-428b-a552-2f8c407facd4 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:24.131009 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71b116-7204-428b-a552-2f8c407facd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:24.131278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71b116-7204-428b-a552-2f8c407facd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:24.141108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71b116-7204-428b-a552-2f8c407facd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:24.143002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71b116-7204-428b-a552-2f8c407facd4 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:24.153282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1244/2482] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:37:25.819110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040211c-39a9-477a-bcd9-62506d6f1d09 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:25.819564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040211c-39a9-477a-bcd9-62506d6f1d09 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:25.819656 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040211c-39a9-477a-bcd9-62506d6f1d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:25.839267 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a040211c-39a9-477a-bcd9-62506d6f1d09 None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:25.840555 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a040211c-39a9-477a-bcd9-62506d6f1d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:25.902254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:25.914297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1239/2483] 10.222.0.36 () {58 vars in 967 bytes} [Wed Jun 15 00:37:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:25.928048 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71b116-7204-428b-a552-2f8c407facd4 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:25.929646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2b71b116-7204-428b-a552-2f8c407facd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:25.966397 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:26.001208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71b116-7204-428b-a552-2f8c407facd4 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:26.006843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76d666-bd7b-4400-8434-6057de6fee3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:26.007494 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76d666-bd7b-4400-8434-6057de6fee3e service swift] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:26.007782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76d666-bd7b-4400-8434-6057de6fee3e service swift] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:26.008061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76d666-bd7b-4400-8434-6057de6fee3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:26.017224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76d666-bd7b-4400-8434-6057de6fee3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:26.018843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76d666-bd7b-4400-8434-6057de6fee3e service swift] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:26.026785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1245/2484] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:37:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:37:28.289538 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870b53f-d188-4acd-a65d-db961b9f2bad None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:28.290042 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870b53f-d188-4acd-a65d-db961b9f2bad None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:28.290319 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870b53f-d188-4acd-a65d-db961b9f2bad None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:28.291927 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1240/2485] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 15 00:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:37:28.300603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58410d-e20d-40d0-8f37-31047d32186f None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:28.301117 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58410d-e20d-40d0-8f37-31047d32186f None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:28.301215 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58410d-e20d-40d0-8f37-31047d32186f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:28.367499 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870b53f-d188-4acd-a65d-db961b9f2bad None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:28.370157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5870b53f-d188-4acd-a65d-db961b9f2bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:28.376553 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9c58410d-e20d-40d0-8f37-31047d32186f None None] MFA Rules not processed for user `24e6dd029a3d45f6aeb4da06db9753dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:28.377785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9c58410d-e20d-40d0-8f37-31047d32186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:28.390206 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870b53f-d188-4acd-a65d-db961b9f2bad None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:28.394793 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413f429-584a-4d40-8f71-bf42c520bafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:28.395678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413f429-584a-4d40-8f71-bf42c520bafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:28.395964 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413f429-584a-4d40-8f71-bf42c520bafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:28.396238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413f429-584a-4d40-8f71-bf42c520bafe admin admin] PATH_INFO: `/v3/users/6486e63263a4417c93c5bc4c36bd925a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:28.397554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413f429-584a-4d40-8f71-bf42c520bafe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6486e63263a4417c93c5bc4c36bd925a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:28.399473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413f429-584a-4d40-8f71-bf42c520bafe admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:28.449077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d413f429-584a-4d40-8f71-bf42c520bafe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6486e63263a4417c93c5bc4c36bd925a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:28.452035 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1246/2486] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 15 00:37:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:28.458254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d413f429-584a-4d40-8f71-bf42c520bafe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6486e63263a4417c93c5bc4c36bd925a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:28.459691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d413f429-584a-4d40-8f71-bf42c520bafe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6486e63263a4417c93c5bc4c36bd925a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:28.460233 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d413f429-584a-4d40-8f71-bf42c520bafe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6486e63263a4417c93c5bc4c36bd925a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:28.465039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58410d-e20d-40d0-8f37-31047d32186f None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:28.466656 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9c58410d-e20d-40d0-8f37-31047d32186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:28.476857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d413f429-584a-4d40-8f71-bf42c520bafe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6486e63263a4417c93c5bc4c36bd925a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:28.481787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58410d-e20d-40d0-8f37-31047d32186f None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:28.488295 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ccb65-c709-4367-becd-a184869f08db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e6dd029a3d45f6aeb4da06db9753dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:28.489072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ccb65-c709-4367-becd-a184869f08db service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:28.489452 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ccb65-c709-4367-becd-a184869f08db service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:28.490640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ccb65-c709-4367-becd-a184869f08db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:28.491784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a86ccb65-c709-4367-becd-a184869f08db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:28.492196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1241/2487] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:37:28 2022] DELETE /identity/v3/users/6486e63263a4417c93c5bc4c36bd925a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:37:28.504464 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ccb65-c709-4367-becd-a184869f08db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:28.506074 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ccb65-c709-4367-becd-a184869f08db service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:28.518287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1247/2488] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:37:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:37:28.775827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413f429-584a-4d40-8f71-bf42c520bafe admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:28.777374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d413f429-584a-4d40-8f71-bf42c520bafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:28.883746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413f429-584a-4d40-8f71-bf42c520bafe admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:28.889469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eeb305-dce8-44e1-9016-ce30843784d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:28.890319 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeb305-dce8-44e1-9016-ce30843784d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:28.890643 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeb305-dce8-44e1-9016-ce30843784d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:28.890923 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eeb305-dce8-44e1-9016-ce30843784d2 admin admin] PATH_INFO: `/v3/projects/c7c1e1acac3042be9dc5c4d8163b2ab8` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:28.892206 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eeb305-dce8-44e1-9016-ce30843784d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7c1e1acac3042be9dc5c4d8163b2ab8)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:28.894315 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eeb305-dce8-44e1-9016-ce30843784d2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:28.971938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a8eeb305-dce8-44e1-9016-ce30843784d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7c1e1acac3042be9dc5c4d8163b2ab8', 'request_id': 'req-a8eeb305-dce8-44e1-9016-ce30843784d2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:28.979399 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a8eeb305-dce8-44e1-9016-ce30843784d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7c1e1acac3042be9dc5c4d8163b2ab8', 'request_id': 'req-a8eeb305-dce8-44e1-9016-ce30843784d2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:28.985730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a8eeb305-dce8-44e1-9016-ce30843784d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7c1e1acac3042be9dc5c4d8163b2ab8', 'request_id': 'req-a8eeb305-dce8-44e1-9016-ce30843784d2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:28.990157 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:29.000478 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a8eeb305-dce8-44e1-9016-ce30843784d2 admin admin] The token cache is being invalidate because project c7c1e1acac3042be9dc5c4d8163b2ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:37:29.001240 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a8eeb305-dce8-44e1-9016-ce30843784d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:29.002785 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-a8eeb305-dce8-44e1-9016-ce30843784d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:29.004338 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1242/2489] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:37:28 2022] DELETE /identity/v3/projects/c7c1e1acac3042be9dc5c4d8163b2ab8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:37:37.217501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ccb65-c709-4367-becd-a184869f08db service placement] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:37.219886 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a86ccb65-c709-4367-becd-a184869f08db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:37.236501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ccb65-c709-4367-becd-a184869f08db service placement] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:37.296958 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:37.304267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b370a-80e1-44eb-ba94-3e4d250b4eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:37.305201 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b370a-80e1-44eb-ba94-3e4d250b4eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:37.305641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b370a-80e1-44eb-ba94-3e4d250b4eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:37.305926 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b370a-80e1-44eb-ba94-3e4d250b4eec admin admin] PATH_INFO: `/v3/users/3a5647f19ddb4875b9c8dcbdb41db3a6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:37.307122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b370a-80e1-44eb-ba94-3e4d250b4eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5647f19ddb4875b9c8dcbdb41db3a6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:37.309087 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b370a-80e1-44eb-ba94-3e4d250b4eec admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:37.358018 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5c6b370a-80e1-44eb-ba94-3e4d250b4eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5647f19ddb4875b9c8dcbdb41db3a6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:37.366274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5c6b370a-80e1-44eb-ba94-3e4d250b4eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5647f19ddb4875b9c8dcbdb41db3a6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:37.366895 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5c6b370a-80e1-44eb-ba94-3e4d250b4eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5647f19ddb4875b9c8dcbdb41db3a6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:37.367504 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5c6b370a-80e1-44eb-ba94-3e4d250b4eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5647f19ddb4875b9c8dcbdb41db3a6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:37.380381 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-5c6b370a-80e1-44eb-ba94-3e4d250b4eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5647f19ddb4875b9c8dcbdb41db3a6'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:37.393074 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1248/2490] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:37:37 2022] DELETE /identity/v3/users/3a5647f19ddb4875b9c8dcbdb41db3a6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:37:37.397822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2863e-72cf-4d72-867e-d0e3af29b25e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:37.398335 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2863e-72cf-4d72-867e-d0e3af29b25e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:37.398335 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2863e-72cf-4d72-867e-d0e3af29b25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:37.416555 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-42c2863e-72cf-4d72-867e-d0e3af29b25e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:37.417916 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-42c2863e-72cf-4d72-867e-d0e3af29b25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:37.478394 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1243/2491] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:37:37.488434 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b370a-80e1-44eb-ba94-3e4d250b4eec admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:37.490282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5c6b370a-80e1-44eb-ba94-3e4d250b4eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:37.584456 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b370a-80e1-44eb-ba94-3e4d250b4eec admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:37.588565 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e7ec1-f46b-494e-867f-59161d01b0c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:37.589165 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e7ec1-f46b-494e-867f-59161d01b0c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:37.589477 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e7ec1-f46b-494e-867f-59161d01b0c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:37.589775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e7ec1-f46b-494e-867f-59161d01b0c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:37.602892 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e7ec1-f46b-494e-867f-59161d01b0c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:37.604910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e7ec1-f46b-494e-867f-59161d01b0c3 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:37.625724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1249/2492] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:37:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:37:37.907438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2863e-72cf-4d72-867e-d0e3af29b25e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:37.909182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-42c2863e-72cf-4d72-867e-d0e3af29b25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:37.921632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2863e-72cf-4d72-867e-d0e3af29b25e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:37.927186 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98f743-b312-4146-9012-6765daf08939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:37.928880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98f743-b312-4146-9012-6765daf08939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:37.929658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98f743-b312-4146-9012-6765daf08939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:37.930043 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98f743-b312-4146-9012-6765daf08939 admin admin] PATH_INFO: `/v3/projects/1c30aa53c4a545fa8bdb84b3dd2025c5` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:37.932221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98f743-b312-4146-9012-6765daf08939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c30aa53c4a545fa8bdb84b3dd2025c5)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:37.935646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98f743-b312-4146-9012-6765daf08939 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:37.994326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db98f743-b312-4146-9012-6765daf08939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c30aa53c4a545fa8bdb84b3dd2025c5', 'request_id': 'req-db98f743-b312-4146-9012-6765daf08939'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:37.999910 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db98f743-b312-4146-9012-6765daf08939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c30aa53c4a545fa8bdb84b3dd2025c5', 'request_id': 'req-db98f743-b312-4146-9012-6765daf08939'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:38.006577 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db98f743-b312-4146-9012-6765daf08939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c30aa53c4a545fa8bdb84b3dd2025c5', 'request_id': 'req-db98f743-b312-4146-9012-6765daf08939'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:38.019977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db98f743-b312-4146-9012-6765daf08939 admin admin] The token cache is being invalidate because project 1c30aa53c4a545fa8bdb84b3dd2025c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:37:38.020265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db98f743-b312-4146-9012-6765daf08939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:38.020875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-db98f743-b312-4146-9012-6765daf08939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:38.022458 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1244/2493] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:37:37 2022] DELETE /identity/v3/projects/1c30aa53c4a545fa8bdb84b3dd2025c5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:37:38.027585 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079efcd6-2bb1-4cbf-9e86-0ab2b7f9e377 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:38.027854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079efcd6-2bb1-4cbf-9e86-0ab2b7f9e377 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:38.028129 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079efcd6-2bb1-4cbf-9e86-0ab2b7f9e377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:38.047021 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-079efcd6-2bb1-4cbf-9e86-0ab2b7f9e377 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:38.048276 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-079efcd6-2bb1-4cbf-9e86-0ab2b7f9e377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:38.103052 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:38.115273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1250/2494] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:37:38.123799 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942db3a-5b32-4f1c-b35d-e7001151f906 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:38.124103 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942db3a-5b32-4f1c-b35d-e7001151f906 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:38.124404 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942db3a-5b32-4f1c-b35d-e7001151f906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:38.144036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9942db3a-5b32-4f1c-b35d-e7001151f906 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:38.145277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9942db3a-5b32-4f1c-b35d-e7001151f906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:38.154526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1245/2495] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:38.160649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079efcd6-2bb1-4cbf-9e86-0ab2b7f9e377 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:38.173318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079efcd6-2bb1-4cbf-9e86-0ab2b7f9e377 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:38.179633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d50e6-1d51-4bb2-afa8-05a355ce8811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:38.180300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d50e6-1d51-4bb2-afa8-05a355ce8811 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:38.180592 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d50e6-1d51-4bb2-afa8-05a355ce8811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:38.180922 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d50e6-1d51-4bb2-afa8-05a355ce8811 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:38.181770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d50e6-1d51-4bb2-afa8-05a355ce8811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:37:38.182103 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d50e6-1d51-4bb2-afa8-05a355ce8811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:38.183725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d50e6-1d51-4bb2-afa8-05a355ce8811 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:38.199870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1251/2496] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:37:38.200954 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942db3a-5b32-4f1c-b35d-e7001151f906 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:38.210695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942db3a-5b32-4f1c-b35d-e7001151f906 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:38.216355 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477469d-517f-4143-90c7-446b18fd5cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:38.217048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477469d-517f-4143-90c7-446b18fd5cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:38.217320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477469d-517f-4143-90c7-446b18fd5cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:38.217636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477469d-517f-4143-90c7-446b18fd5cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:38.218341 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477469d-517f-4143-90c7-446b18fd5cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:38.220276 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477469d-517f-4143-90c7-446b18fd5cd6 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:38.250678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1246/2497] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:37:38 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:37:38.252368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d50e6-1d51-4bb2-afa8-05a355ce8811 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:38.263170 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d50e6-1d51-4bb2-afa8-05a355ce8811 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:38.326447 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf80a8-bb81-46a6-9acd-5bc5b62b6385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:38.327130 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf80a8-bb81-46a6-9acd-5bc5b62b6385 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:38.327413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf80a8-bb81-46a6-9acd-5bc5b62b6385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:38.327691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf80a8-bb81-46a6-9acd-5bc5b62b6385 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:38.328408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf80a8-bb81-46a6-9acd-5bc5b62b6385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:38.330378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf80a8-bb81-46a6-9acd-5bc5b62b6385 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:38.352185 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1252/2498] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:37:38 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:37:38.356653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477469d-517f-4143-90c7-446b18fd5cd6 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:38.370026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477469d-517f-4143-90c7-446b18fd5cd6 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:38.374864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2949fa-540e-42bc-9da5-22b2b65f8fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:38.375703 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2949fa-540e-42bc-9da5-22b2b65f8fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:38.376190 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2949fa-540e-42bc-9da5-22b2b65f8fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:38.376764 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2949fa-540e-42bc-9da5-22b2b65f8fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:38.377803 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2949fa-540e-42bc-9da5-22b2b65f8fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:38.379729 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2949fa-540e-42bc-9da5-22b2b65f8fc2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:38.392461 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1247/2499] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:37:38.396511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf80a8-bb81-46a6-9acd-5bc5b62b6385 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:38.406999 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf80a8-bb81-46a6-9acd-5bc5b62b6385 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:38.412175 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0acf6f-746c-482b-ae9b-a91b7f1e9ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:38.412860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0acf6f-746c-482b-ae9b-a91b7f1e9ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:38.413150 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0acf6f-746c-482b-ae9b-a91b7f1e9ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:38.413628 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0acf6f-746c-482b-ae9b-a91b7f1e9ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:38.414433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0acf6f-746c-482b-ae9b-a91b7f1e9ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:38.416064 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0acf6f-746c-482b-ae9b-a91b7f1e9ee4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:38.426746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1253/2500] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:37:38.431067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2949fa-540e-42bc-9da5-22b2b65f8fc2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:38.443794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2949fa-540e-42bc-9da5-22b2b65f8fc2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:38.449564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdae0b5-3cd6-4f52-9f21-2bc7c5565226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:38.450472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdae0b5-3cd6-4f52-9f21-2bc7c5565226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:38.450755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdae0b5-3cd6-4f52-9f21-2bc7c5565226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:38.451031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdae0b5-3cd6-4f52-9f21-2bc7c5565226 admin admin] PATH_INFO: `/v3/projects/f3137635b0864d4e8cd375fa96ab0bf7/users/03eead49238d46e98b114148a3a2f93c/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:38.467568 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdae0b5-3cd6-4f52-9f21-2bc7c5565226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3137635b0864d4e8cd375fa96ab0bf7, user_id=03eead49238d46e98b114148a3a2f93c, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:38.470453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdae0b5-3cd6-4f52-9f21-2bc7c5565226 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:38.484428 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1248/2501] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:37:38 2022] PUT /identity/v3/projects/f3137635b0864d4e8cd375fa96ab0bf7/users/03eead49238d46e98b114148a3a2f93c/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:37:38.489807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e2f42-0499-4677-a8e6-a63ba460d7e2 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:38.490133 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e2f42-0499-4677-a8e6-a63ba460d7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:38.490960 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e2f42-0499-4677-a8e6-a63ba460d7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:38.508663 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9e0e2f42-0499-4677-a8e6-a63ba460d7e2 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:38.509900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9e0e2f42-0499-4677-a8e6-a63ba460d7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:38.573066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1254/2502] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:37:38.582966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdae0b5-3cd6-4f52-9f21-2bc7c5565226 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:38.585092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3fdae0b5-3cd6-4f52-9f21-2bc7c5565226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:38.605066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:38.644056 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdae0b5-3cd6-4f52-9f21-2bc7c5565226 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:38.647977 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabce38d-a6e1-435b-8aaf-0b9410594275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:38.648628 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabce38d-a6e1-435b-8aaf-0b9410594275 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:38.648916 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabce38d-a6e1-435b-8aaf-0b9410594275 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:38.649196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabce38d-a6e1-435b-8aaf-0b9410594275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:38.658667 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabce38d-a6e1-435b-8aaf-0b9410594275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:38.660229 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabce38d-a6e1-435b-8aaf-0b9410594275 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:38.670411 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1249/2503] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:37:41.497829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea7859-2721-475e-907b-5c4ac1aa92db None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:41.498337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea7859-2721-475e-907b-5c4ac1aa92db None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:41.498435 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea7859-2721-475e-907b-5c4ac1aa92db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:41.516216 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0cea7859-2721-475e-907b-5c4ac1aa92db None None] MFA Rules not processed for user `6586c9aa3c984b9b963a2e2c583ef7bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:41.517490 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0cea7859-2721-475e-907b-5c4ac1aa92db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:41.581621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1255/2504] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:43.376467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ed77a-c01e-417f-a9b2-8108bc60bda3 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:43.377301 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ed77a-c01e-417f-a9b2-8108bc60bda3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:43.377786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ed77a-c01e-417f-a9b2-8108bc60bda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:43.426468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-275ed77a-c01e-417f-a9b2-8108bc60bda3 None None] MFA Rules not processed for user `03eead49238d46e98b114148a3a2f93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:43.427686 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-275ed77a-c01e-417f-a9b2-8108bc60bda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:43.501200 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1250/2505] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:43.506059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea7859-2721-475e-907b-5c4ac1aa92db None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:43.517682 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea7859-2721-475e-907b-5c4ac1aa92db None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:43.523385 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da4036-2862-4616-96df-87ddab09a546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:43.524121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da4036-2862-4616-96df-87ddab09a546 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:43.524470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da4036-2862-4616-96df-87ddab09a546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:43.524820 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da4036-2862-4616-96df-87ddab09a546 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:43.525645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da4036-2862-4616-96df-87ddab09a546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:43.527590 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da4036-2862-4616-96df-87ddab09a546 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:43.532857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:43.563817 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1256/2506] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:37:43 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:37:43.567870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ed77a-c01e-417f-a9b2-8108bc60bda3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:43.585640 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ed77a-c01e-417f-a9b2-8108bc60bda3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:43.646190 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476363f-5e77-4a52-87dc-8517405523c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:43.646869 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476363f-5e77-4a52-87dc-8517405523c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:43.647150 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476363f-5e77-4a52-87dc-8517405523c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:43.647424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476363f-5e77-4a52-87dc-8517405523c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:43.648117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476363f-5e77-4a52-87dc-8517405523c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:43.650099 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476363f-5e77-4a52-87dc-8517405523c3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:43.674686 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1251/2507] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:37:43 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:37:43.678725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da4036-2862-4616-96df-87ddab09a546 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:43.689720 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da4036-2862-4616-96df-87ddab09a546 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:43.696207 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e492d-685b-427d-8ca1-2bc727243702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:43.697192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e492d-685b-427d-8ca1-2bc727243702 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:43.697548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e492d-685b-427d-8ca1-2bc727243702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:43.697825 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e492d-685b-427d-8ca1-2bc727243702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:43.698740 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e492d-685b-427d-8ca1-2bc727243702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:43.700557 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e492d-685b-427d-8ca1-2bc727243702 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:43.715730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1257/2508] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:37:43.720002 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476363f-5e77-4a52-87dc-8517405523c3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:43.730593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476363f-5e77-4a52-87dc-8517405523c3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:43.735698 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f3b6a-3d76-4e6b-bb9d-1661cd0ad179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:43.736630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f3b6a-3d76-4e6b-bb9d-1661cd0ad179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:43.736915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f3b6a-3d76-4e6b-bb9d-1661cd0ad179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:43.737196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f3b6a-3d76-4e6b-bb9d-1661cd0ad179 admin admin] PATH_INFO: `/v3/projects/fb08dc21d0da4e13975081e42b297db1/users/c7a1198a49234c5eb5ed54a8ad0d8b2c/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:43.753369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f3b6a-3d76-4e6b-bb9d-1661cd0ad179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb08dc21d0da4e13975081e42b297db1, user_id=c7a1198a49234c5eb5ed54a8ad0d8b2c, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:43.756420 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f3b6a-3d76-4e6b-bb9d-1661cd0ad179 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:43.770952 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1252/2509] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:37:43 2022] PUT /identity/v3/projects/fb08dc21d0da4e13975081e42b297db1/users/c7a1198a49234c5eb5ed54a8ad0d8b2c/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:37:43.774956 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e492d-685b-427d-8ca1-2bc727243702 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:43.785000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e492d-685b-427d-8ca1-2bc727243702 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:43.843721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de10ab-d78b-4a0b-9e20-7fec1a432a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:43.844852 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de10ab-d78b-4a0b-9e20-7fec1a432a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:43.845137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de10ab-d78b-4a0b-9e20-7fec1a432a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:43.845410 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de10ab-d78b-4a0b-9e20-7fec1a432a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:43.846167 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de10ab-d78b-4a0b-9e20-7fec1a432a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:43.847779 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de10ab-d78b-4a0b-9e20-7fec1a432a8e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:43.858577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1258/2510] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:37:43.863231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f3b6a-3d76-4e6b-bb9d-1661cd0ad179 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:43.874063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f3b6a-3d76-4e6b-bb9d-1661cd0ad179 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:43.879257 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167ae34-57cf-40b1-9aba-094ecd1d5aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:43.880181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167ae34-57cf-40b1-9aba-094ecd1d5aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:43.880471 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167ae34-57cf-40b1-9aba-094ecd1d5aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:43.880756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167ae34-57cf-40b1-9aba-094ecd1d5aa4 admin admin] PATH_INFO: `/v3/projects/fb08dc21d0da4e13975081e42b297db1/users/c7a1198a49234c5eb5ed54a8ad0d8b2c/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:43.882877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167ae34-57cf-40b1-9aba-094ecd1d5aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb08dc21d0da4e13975081e42b297db1, user_id=c7a1198a49234c5eb5ed54a8ad0d8b2c, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:43.885578 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167ae34-57cf-40b1-9aba-094ecd1d5aa4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:43.892757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:43.898576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1253/2511] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:37:43 2022] PUT /identity/v3/projects/fb08dc21d0da4e13975081e42b297db1/users/c7a1198a49234c5eb5ed54a8ad0d8b2c/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:37:50.682391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789529fd-ed82-43f0-a0e1-232afe47c993 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:50.682910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789529fd-ed82-43f0-a0e1-232afe47c993 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:50.683024 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789529fd-ed82-43f0-a0e1-232afe47c993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:50.711671 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-789529fd-ed82-43f0-a0e1-232afe47c993 None None] MFA Rules not processed for user `c7a1198a49234c5eb5ed54a8ad0d8b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:50.712884 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-789529fd-ed82-43f0-a0e1-232afe47c993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:50.803104 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1259/2512] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:37:50.817524 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167ae34-57cf-40b1-9aba-094ecd1d5aa4 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:50.819398 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f167ae34-57cf-40b1-9aba-094ecd1d5aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:50.885246 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167ae34-57cf-40b1-9aba-094ecd1d5aa4 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:50.889032 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ba2f5-6b6e-472f-adec-f488ba2037cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a239897b9a0644ef9d2e0e2e333232fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:50.889723 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ba2f5-6b6e-472f-adec-f488ba2037cc service glance] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:50.890009 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ba2f5-6b6e-472f-adec-f488ba2037cc service glance] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:50.890357 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ba2f5-6b6e-472f-adec-f488ba2037cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:50.975592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ba2f5-6b6e-472f-adec-f488ba2037cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:50.977151 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ba2f5-6b6e-472f-adec-f488ba2037cc service glance] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:50.998288 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1254/2513] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:37:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:37:51.145613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf152bd-6396-41b2-b0ac-285639edc603 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:51.145964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf152bd-6396-41b2-b0ac-285639edc603 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:51.146262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf152bd-6396-41b2-b0ac-285639edc603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:51.168192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2cf152bd-6396-41b2-b0ac-285639edc603 None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:51.178423 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2cf152bd-6396-41b2-b0ac-285639edc603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:51.234679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:51.249771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1260/2514] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 15 00:37:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:51.274805 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ba2f5-6b6e-472f-adec-f488ba2037cc service glance] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:51.276329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3f9ba2f5-6b6e-472f-adec-f488ba2037cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:51.350242 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ba2f5-6b6e-472f-adec-f488ba2037cc service glance] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:51.355668 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc86e64-f471-424c-b0a9-d3b8fc29d24c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:51.356326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc86e64-f471-424c-b0a9-d3b8fc29d24c service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:51.356612 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc86e64-f471-424c-b0a9-d3b8fc29d24c service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:51.356891 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc86e64-f471-424c-b0a9-d3b8fc29d24c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:51.367936 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc86e64-f471-424c-b0a9-d3b8fc29d24c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:51.369708 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc86e64-f471-424c-b0a9-d3b8fc29d24c service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:51.378150 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1255/2515] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:37:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:37:51.893682 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aed21-dffe-4988-a876-d7b60c01ca4b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:51.894728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aed21-dffe-4988-a876-d7b60c01ca4b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:51.895299 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4aed21-dffe-4988-a876-d7b60c01ca4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:51.928312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9b4aed21-dffe-4988-a876-d7b60c01ca4b None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:51.930679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9b4aed21-dffe-4988-a876-d7b60c01ca4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:51.951285 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1261/2516] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 15 00:37:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:51.995887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc86e64-f471-424c-b0a9-d3b8fc29d24c service swift] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:52.013593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc86e64-f471-424c-b0a9-d3b8fc29d24c service swift] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:52.027013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce381d-bb5d-4cc4-bed0-47ee25276876 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:52.027751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce381d-bb5d-4cc4-bed0-47ee25276876 service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:52.028041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce381d-bb5d-4cc4-bed0-47ee25276876 service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:52.028346 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce381d-bb5d-4cc4-bed0-47ee25276876 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:52.051385 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce381d-bb5d-4cc4-bed0-47ee25276876 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:52.053406 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce381d-bb5d-4cc4-bed0-47ee25276876 service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:52.070800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1256/2517] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:37:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:37:53.191840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409fd6-28cf-4fa2-842e-7a6e8ecf9351 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:53.192766 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409fd6-28cf-4fa2-842e-7a6e8ecf9351 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:53.193738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409fd6-28cf-4fa2-842e-7a6e8ecf9351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:53.220224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-12409fd6-28cf-4fa2-842e-7a6e8ecf9351 None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:53.222492 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-12409fd6-28cf-4fa2-842e-7a6e8ecf9351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:53.245513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1262/2518] 10.222.0.36 () {58 vars in 967 bytes} [Wed Jun 15 00:37:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:53.258187 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce381d-bb5d-4cc4-bed0-47ee25276876 service swift] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:53.273457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce381d-bb5d-4cc4-bed0-47ee25276876 service swift] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:53.281597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae63d3-d85b-4699-99d7-eb64ae24380f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:53.282404 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae63d3-d85b-4699-99d7-eb64ae24380f service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:53.282754 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae63d3-d85b-4699-99d7-eb64ae24380f service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:53.283098 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae63d3-d85b-4699-99d7-eb64ae24380f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:53.307353 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae63d3-d85b-4699-99d7-eb64ae24380f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:53.309015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae63d3-d85b-4699-99d7-eb64ae24380f service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:53.320802 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1257/2519] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:37:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:37:53.640219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebfa87-01fe-4fea-993d-d539f5bbd94c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:53.640575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebfa87-01fe-4fea-993d-d539f5bbd94c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:53.641093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebfa87-01fe-4fea-993d-d539f5bbd94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:53.662514 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-44ebfa87-01fe-4fea-993d-d539f5bbd94c None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:53.664008 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-44ebfa87-01fe-4fea-993d-d539f5bbd94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:53.671719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1263/2520] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 15 00:37:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:53.776016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae63d3-d85b-4699-99d7-eb64ae24380f service swift] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:53.793826 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae63d3-d85b-4699-99d7-eb64ae24380f service swift] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:53.809792 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d1c9f-1a26-4a0d-a0c8-c6b5f34a9ec3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:53.810474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d1c9f-1a26-4a0d-a0c8-c6b5f34a9ec3 service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:53.810767 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d1c9f-1a26-4a0d-a0c8-c6b5f34a9ec3 service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:53.811054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d1c9f-1a26-4a0d-a0c8-c6b5f34a9ec3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:53.838372 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d1c9f-1a26-4a0d-a0c8-c6b5f34a9ec3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:53.840238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d1c9f-1a26-4a0d-a0c8-c6b5f34a9ec3 service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:53.868108 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1258/2521] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:37:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 00:37:54.495738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c5270-1ec1-403c-a5ca-ba782f1392fd None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:54.496676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c5270-1ec1-403c-a5ca-ba782f1392fd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:54.497170 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c5270-1ec1-403c-a5ca-ba782f1392fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:54.532587 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d91c5270-1ec1-403c-a5ca-ba782f1392fd None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:54.533990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d91c5270-1ec1-403c-a5ca-ba782f1392fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:54.552899 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1264/2522] 10.222.0.36 () {58 vars in 967 bytes} [Wed Jun 15 00:37:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:54.575948 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d1c9f-1a26-4a0d-a0c8-c6b5f34a9ec3 service swift] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:54.597624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:54.612146 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d1c9f-1a26-4a0d-a0c8-c6b5f34a9ec3 service swift] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:54.659289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642405d3-53bc-44ff-90ef-35dbe2559c7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:54.660005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642405d3-53bc-44ff-90ef-35dbe2559c7e service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:54.660294 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642405d3-53bc-44ff-90ef-35dbe2559c7e service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:54.660580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642405d3-53bc-44ff-90ef-35dbe2559c7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:54.696966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642405d3-53bc-44ff-90ef-35dbe2559c7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:54.698626 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642405d3-53bc-44ff-90ef-35dbe2559c7e service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:54.713025 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1259/2523] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:37:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:37:57.190944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c5270-1ec1-403c-a5ca-ba782f1392fd None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:57.193167 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d91c5270-1ec1-403c-a5ca-ba782f1392fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:57.283501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c5270-1ec1-403c-a5ca-ba782f1392fd None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:57.308624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458d581-7c4d-4187-a645-99fb74344a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:57.309851 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458d581-7c4d-4187-a645-99fb74344a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:57.310153 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458d581-7c4d-4187-a645-99fb74344a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:57.310467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458d581-7c4d-4187-a645-99fb74344a47 admin admin] PATH_INFO: `/v3/users/3cac8dcc34944ee396449e8ffb204f01` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:57.313762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458d581-7c4d-4187-a645-99fb74344a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cac8dcc34944ee396449e8ffb204f01)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:57.315705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458d581-7c4d-4187-a645-99fb74344a47 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:57.373925 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e458d581-7c4d-4187-a645-99fb74344a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cac8dcc34944ee396449e8ffb204f01'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:57.385276 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e458d581-7c4d-4187-a645-99fb74344a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cac8dcc34944ee396449e8ffb204f01'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:57.385942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e458d581-7c4d-4187-a645-99fb74344a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cac8dcc34944ee396449e8ffb204f01'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:57.386548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e458d581-7c4d-4187-a645-99fb74344a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cac8dcc34944ee396449e8ffb204f01'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:57.399175 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e458d581-7c4d-4187-a645-99fb74344a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cac8dcc34944ee396449e8ffb204f01'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:57.416860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1265/2524] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:37:57 2022] DELETE /identity/v3/users/3cac8dcc34944ee396449e8ffb204f01 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:37:57.421787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f987-f3ac-4343-88de-db935e67d6a6 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:57.422621 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f987-f3ac-4343-88de-db935e67d6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:57.423060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f987-f3ac-4343-88de-db935e67d6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:57.442100 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-5280f987-f3ac-4343-88de-db935e67d6a6 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:57.443534 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5280f987-f3ac-4343-88de-db935e67d6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:57.522037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1260/2525] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:57.528758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458d581-7c4d-4187-a645-99fb74344a47 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:57.532662 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e458d581-7c4d-4187-a645-99fb74344a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:57.605534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:57.617644 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458d581-7c4d-4187-a645-99fb74344a47 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:57.623070 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220b40e-b703-4143-8cfb-ac463672604f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:57.623902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220b40e-b703-4143-8cfb-ac463672604f service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:57.624228 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220b40e-b703-4143-8cfb-ac463672604f service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:57.625307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220b40e-b703-4143-8cfb-ac463672604f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:57.635771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220b40e-b703-4143-8cfb-ac463672604f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:57.637249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220b40e-b703-4143-8cfb-ac463672604f service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:57.655102 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1266/2526] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:37:58.000182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f987-f3ac-4343-88de-db935e67d6a6 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:58.001710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5280f987-f3ac-4343-88de-db935e67d6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:58.035471 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f987-f3ac-4343-88de-db935e67d6a6 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:58.057670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c09b1-e221-4d99-9649-c8de54b39896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:58.061181 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c09b1-e221-4d99-9649-c8de54b39896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:58.061865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c09b1-e221-4d99-9649-c8de54b39896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:58.073402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c09b1-e221-4d99-9649-c8de54b39896 admin admin] PATH_INFO: `/v3/projects/67cb5963999041a8a48327606802eb29` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:58.075113 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c09b1-e221-4d99-9649-c8de54b39896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67cb5963999041a8a48327606802eb29)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:58.081248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c09b1-e221-4d99-9649-c8de54b39896 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:58.166561 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dd6c09b1-e221-4d99-9649-c8de54b39896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67cb5963999041a8a48327606802eb29', 'request_id': 'req-dd6c09b1-e221-4d99-9649-c8de54b39896'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:58.197218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dd6c09b1-e221-4d99-9649-c8de54b39896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67cb5963999041a8a48327606802eb29', 'request_id': 'req-dd6c09b1-e221-4d99-9649-c8de54b39896'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:58.205099 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dd6c09b1-e221-4d99-9649-c8de54b39896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67cb5963999041a8a48327606802eb29', 'request_id': 'req-dd6c09b1-e221-4d99-9649-c8de54b39896'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:58.240237 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dd6c09b1-e221-4d99-9649-c8de54b39896 admin admin] The token cache is being invalidate because project 67cb5963999041a8a48327606802eb29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:37:58.240552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dd6c09b1-e221-4d99-9649-c8de54b39896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:58.241260 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-dd6c09b1-e221-4d99-9649-c8de54b39896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:37:58.256147 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1261/2527] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:37:57 2022] DELETE /identity/v3/projects/67cb5963999041a8a48327606802eb29 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:37:58.260953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee971223-e92e-4294-b2d4-5602359b7360 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:58.261478 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee971223-e92e-4294-b2d4-5602359b7360 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:58.261592 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee971223-e92e-4294-b2d4-5602359b7360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:58.284752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ee971223-e92e-4294-b2d4-5602359b7360 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:58.288027 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ee971223-e92e-4294-b2d4-5602359b7360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:58.353834 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1267/2528] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:58.361375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3be4a-dadd-43ad-bcb9-a29716efc9d5 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:58.361921 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3be4a-dadd-43ad-bcb9-a29716efc9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:58.362402 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3be4a-dadd-43ad-bcb9-a29716efc9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:58.391301 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9ff3be4a-dadd-43ad-bcb9-a29716efc9d5 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:58.395320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9ff3be4a-dadd-43ad-bcb9-a29716efc9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:58.403926 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1262/2529] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:58.408470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee971223-e92e-4294-b2d4-5602359b7360 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:58.420774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee971223-e92e-4294-b2d4-5602359b7360 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:58.426881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133ee04-1461-4528-8794-4537a4b5ae11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:58.427769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133ee04-1461-4528-8794-4537a4b5ae11 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:58.428211 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133ee04-1461-4528-8794-4537a4b5ae11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:58.428811 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133ee04-1461-4528-8794-4537a4b5ae11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:58.429747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133ee04-1461-4528-8794-4537a4b5ae11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:37:58.429989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133ee04-1461-4528-8794-4537a4b5ae11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:58.431590 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133ee04-1461-4528-8794-4537a4b5ae11 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:58.449444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1268/2530] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:37:58.450836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3be4a-dadd-43ad-bcb9-a29716efc9d5 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:58.463432 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3be4a-dadd-43ad-bcb9-a29716efc9d5 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:58.469325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9e50e-78e7-4825-bf87-ce1f278db159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:58.470026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9e50e-78e7-4825-bf87-ce1f278db159 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:58.470314 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9e50e-78e7-4825-bf87-ce1f278db159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:58.470593 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9e50e-78e7-4825-bf87-ce1f278db159 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:58.471299 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9e50e-78e7-4825-bf87-ce1f278db159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:58.473231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9e50e-78e7-4825-bf87-ce1f278db159 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:58.509556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1263/2531] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:37:58 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:37:58.511152 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133ee04-1461-4528-8794-4537a4b5ae11 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:58.521980 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133ee04-1461-4528-8794-4537a4b5ae11 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:58.590025 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d5a34-3a89-4b03-b7e7-47377996c9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:58.590841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d5a34-3a89-4b03-b7e7-47377996c9bc admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:58.591146 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d5a34-3a89-4b03-b7e7-47377996c9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:58.591425 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d5a34-3a89-4b03-b7e7-47377996c9bc admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:58.592156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d5a34-3a89-4b03-b7e7-47377996c9bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:58.594341 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d5a34-3a89-4b03-b7e7-47377996c9bc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:58.622207 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1269/2532] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:37:58 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:37:58.626328 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9e50e-78e7-4825-bf87-ce1f278db159 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:58.663714 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9e50e-78e7-4825-bf87-ce1f278db159 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:58.663714 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b2157-db1d-4f5c-99c4-6fd2b9ce9980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:58.663714 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b2157-db1d-4f5c-99c4-6fd2b9ce9980 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:58.663714 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b2157-db1d-4f5c-99c4-6fd2b9ce9980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:58.664757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b2157-db1d-4f5c-99c4-6fd2b9ce9980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:58.664757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b2157-db1d-4f5c-99c4-6fd2b9ce9980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:58.664757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b2157-db1d-4f5c-99c4-6fd2b9ce9980 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:58.710146 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1264/2533] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:37:58.710800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d5a34-3a89-4b03-b7e7-47377996c9bc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:58.710800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d5a34-3a89-4b03-b7e7-47377996c9bc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:58.710800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae51802-b6a1-474c-8565-c37218a78f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:58.720757 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae51802-b6a1-474c-8565-c37218a78f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:58.721485 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae51802-b6a1-474c-8565-c37218a78f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:58.722343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae51802-b6a1-474c-8565-c37218a78f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:58.725921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae51802-b6a1-474c-8565-c37218a78f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:58.760540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae51802-b6a1-474c-8565-c37218a78f42 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:58.788650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1270/2534] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:37:58.792690 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b2157-db1d-4f5c-99c4-6fd2b9ce9980 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:58.804472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b2157-db1d-4f5c-99c4-6fd2b9ce9980 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:58.810713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70dc3d-449d-483b-8027-14b0d7b62b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:58.811623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70dc3d-449d-483b-8027-14b0d7b62b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:58.811912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70dc3d-449d-483b-8027-14b0d7b62b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:58.812239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70dc3d-449d-483b-8027-14b0d7b62b4f admin admin] PATH_INFO: `/v3/projects/d9738745372244c794e3ae0d51cf821d/users/2792434810274d7aa795880b6294d445/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:58.839298 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70dc3d-449d-483b-8027-14b0d7b62b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9738745372244c794e3ae0d51cf821d, user_id=2792434810274d7aa795880b6294d445, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:58.842775 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70dc3d-449d-483b-8027-14b0d7b62b4f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:58.866724 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1265/2535] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:37:58 2022] PUT /identity/v3/projects/d9738745372244c794e3ae0d51cf821d/users/2792434810274d7aa795880b6294d445/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:37:58.878371 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f63e0d-60cb-480f-bb98-c8c8ba11227b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:58.878807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f63e0d-60cb-480f-bb98-c8c8ba11227b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:58.879331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f63e0d-60cb-480f-bb98-c8c8ba11227b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:58.928591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b4f63e0d-60cb-480f-bb98-c8c8ba11227b None None] MFA Rules not processed for user `2792434810274d7aa795880b6294d445`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:37:58.930294 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b4f63e0d-60cb-480f-bb98-c8c8ba11227b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:59.006942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:59.052664 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1271/2536] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:37:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:37:59.070012 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70dc3d-449d-483b-8027-14b0d7b62b4f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:37:59.072047 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5f70dc3d-449d-483b-8027-14b0d7b62b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:37:59.090064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:37:59.216996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70dc3d-449d-483b-8027-14b0d7b62b4f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:37:59.220957 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22171b6c-679e-4afd-8b76-8ec15a40acd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:37:59.221712 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22171b6c-679e-4afd-8b76-8ec15a40acd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:37:59.221993 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22171b6c-679e-4afd-8b76-8ec15a40acd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:37:59.222273 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22171b6c-679e-4afd-8b76-8ec15a40acd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:37:59.232720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22171b6c-679e-4afd-8b76-8ec15a40acd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:37:59.235559 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22171b6c-679e-4afd-8b76-8ec15a40acd7 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:37:59.245920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1266/2537] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:37:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:38:02.223080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3497ea1-112e-45ae-8d2a-2c004a1225eb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:02.223983 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3497ea1-112e-45ae-8d2a-2c004a1225eb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:02.224643 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3497ea1-112e-45ae-8d2a-2c004a1225eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:02.259332 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a3497ea1-112e-45ae-8d2a-2c004a1225eb None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:02.260808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a3497ea1-112e-45ae-8d2a-2c004a1225eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:02.327226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1272/2538] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jun 15 00:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:38:02.347885 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22171b6c-679e-4afd-8b76-8ec15a40acd7 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:02.349469 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-22171b6c-679e-4afd-8b76-8ec15a40acd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:02.466510 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22171b6c-679e-4afd-8b76-8ec15a40acd7 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:02.472609 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f104206-5713-479e-b6e4-6a6df5239180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:02.473266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104206-5713-479e-b6e4-6a6df5239180 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:02.473574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104206-5713-479e-b6e4-6a6df5239180 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:02.473885 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104206-5713-479e-b6e4-6a6df5239180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:02.482827 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f104206-5713-479e-b6e4-6a6df5239180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:02.484507 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f104206-5713-479e-b6e4-6a6df5239180 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:02.496431 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1267/2539] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:38:02.602563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a0b33-c2fc-45fb-a157-e0941ec86bef None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:02.602855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a0b33-c2fc-45fb-a157-e0941ec86bef None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:02.603445 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a0b33-c2fc-45fb-a157-e0941ec86bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:02.624554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b08a0b33-c2fc-45fb-a157-e0941ec86bef None None] MFA Rules not processed for user `03eead49238d46e98b114148a3a2f93c`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:02.625829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b08a0b33-c2fc-45fb-a157-e0941ec86bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:02.685917 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1273/2540] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:38:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:38:04.220173 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f104206-5713-479e-b6e4-6a6df5239180 service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:04.221897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8f104206-5713-479e-b6e4-6a6df5239180 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:04.287806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:38:04.294602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f104206-5713-479e-b6e4-6a6df5239180 service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:04.300107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d76d6-7ffe-4b63-9509-2d5d28de388e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e6dd029a3d45f6aeb4da06db9753dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:04.300754 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d76d6-7ffe-4b63-9509-2d5d28de388e service placement] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:04.301037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d76d6-7ffe-4b63-9509-2d5d28de388e service placement] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:04.301313 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d76d6-7ffe-4b63-9509-2d5d28de388e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:04.303227 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9b7d76d6-7ffe-4b63-9509-2d5d28de388e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:04.314753 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d76d6-7ffe-4b63-9509-2d5d28de388e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:04.316363 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d76d6-7ffe-4b63-9509-2d5d28de388e service placement] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:04.326949 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1268/2541] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:38:05.445840 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad639499-8c68-44e7-9088-6c49f8ac18d9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:05.446671 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad639499-8c68-44e7-9088-6c49f8ac18d9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:05.446984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad639499-8c68-44e7-9088-6c49f8ac18d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:05.501691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ad639499-8c68-44e7-9088-6c49f8ac18d9 None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:05.502993 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ad639499-8c68-44e7-9088-6c49f8ac18d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:05.565518 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f8c2-38a3-4f03-b847-51b67d83f557 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:05.566064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f8c2-38a3-4f03-b847-51b67d83f557 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:05.566064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f8c2-38a3-4f03-b847-51b67d83f557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:05.573278 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1274/2542] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 15 00:38:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:38:05.586195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad639499-8c68-44e7-9088-6c49f8ac18d9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:05.587591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ad639499-8c68-44e7-9088-6c49f8ac18d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:05.589972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-0b71f8c2-38a3-4f03-b847-51b67d83f557 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:05.591424 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0b71f8c2-38a3-4f03-b847-51b67d83f557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:05.591883 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:38:05.602230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1269/2543] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jun 15 00:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:38:05.627464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f8c2-38a3-4f03-b847-51b67d83f557 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:05.647853 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f8c2-38a3-4f03-b847-51b67d83f557 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:05.654773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a079e6-2232-4dba-b60b-a28e8436e88d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:05.655865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a079e6-2232-4dba-b60b-a28e8436e88d service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:05.656339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a079e6-2232-4dba-b60b-a28e8436e88d service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:05.656995 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a079e6-2232-4dba-b60b-a28e8436e88d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:05.666010 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a079e6-2232-4dba-b60b-a28e8436e88d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:05.668137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a079e6-2232-4dba-b60b-a28e8436e88d service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:05.695063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1270/2544] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:38:05.704349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad639499-8c68-44e7-9088-6c49f8ac18d9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:05.709742 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a6be3-7c22-436a-8920-77baa2405907 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:05.710623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a6be3-7c22-436a-8920-77baa2405907 service swift] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:05.710986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a6be3-7c22-436a-8920-77baa2405907 service swift] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:05.711338 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a6be3-7c22-436a-8920-77baa2405907 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:05.721142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a6be3-7c22-436a-8920-77baa2405907 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:05.722837 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a6be3-7c22-436a-8920-77baa2405907 service swift] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:05.731786 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1275/2545] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:38:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 15 00:38:09.654344 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a079e6-2232-4dba-b60b-a28e8436e88d service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:09.666164 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a079e6-2232-4dba-b60b-a28e8436e88d service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:09.672495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59157a93-b973-4d4b-9880-135b81e0d0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:09.673562 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59157a93-b973-4d4b-9880-135b81e0d0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:09.673918 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59157a93-b973-4d4b-9880-135b81e0d0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:09.674269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59157a93-b973-4d4b-9880-135b81e0d0e9 admin admin] PATH_INFO: `/v3/users/2792434810274d7aa795880b6294d445` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:09.675696 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59157a93-b973-4d4b-9880-135b81e0d0e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2792434810274d7aa795880b6294d445)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:09.677804 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59157a93-b973-4d4b-9880-135b81e0d0e9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:09.730211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-59157a93-b973-4d4b-9880-135b81e0d0e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2792434810274d7aa795880b6294d445'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:38:09.739625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-59157a93-b973-4d4b-9880-135b81e0d0e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2792434810274d7aa795880b6294d445'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:38:09.740387 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-59157a93-b973-4d4b-9880-135b81e0d0e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2792434810274d7aa795880b6294d445'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:38:09.741406 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-59157a93-b973-4d4b-9880-135b81e0d0e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2792434810274d7aa795880b6294d445'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:38:09.763491 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-59157a93-b973-4d4b-9880-135b81e0d0e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2792434810274d7aa795880b6294d445'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:38:09.782300 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1271/2546] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:38:09 2022] DELETE /identity/v3/users/2792434810274d7aa795880b6294d445 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:38:09.786660 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9071f7d-a912-4637-85a1-a4d371df20f4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:09.787200 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9071f7d-a912-4637-85a1-a4d371df20f4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:09.787305 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9071f7d-a912-4637-85a1-a4d371df20f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:09.809983 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c9071f7d-a912-4637-85a1-a4d371df20f4 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:09.811226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c9071f7d-a912-4637-85a1-a4d371df20f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:09.875979 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1276/2547] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:38:09.886326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59157a93-b973-4d4b-9880-135b81e0d0e9 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:09.887845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-59157a93-b973-4d4b-9880-135b81e0d0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:09.966683 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59157a93-b973-4d4b-9880-135b81e0d0e9 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:09.973771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52624170-2f93-49bc-9397-a83fcde4a881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:09.974543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52624170-2f93-49bc-9397-a83fcde4a881 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:09.974890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52624170-2f93-49bc-9397-a83fcde4a881 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:09.975227 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52624170-2f93-49bc-9397-a83fcde4a881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:09.987618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52624170-2f93-49bc-9397-a83fcde4a881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:09.989007 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52624170-2f93-49bc-9397-a83fcde4a881 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:10.002734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1272/2548] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:38:10.337835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9071f7d-a912-4637-85a1-a4d371df20f4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:10.339246 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c9071f7d-a912-4637-85a1-a4d371df20f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:10.371926 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9071f7d-a912-4637-85a1-a4d371df20f4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:10.376591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a839ac4-fb36-419c-b158-991e7d90bf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:10.377595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a839ac4-fb36-419c-b158-991e7d90bf67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:10.377817 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a839ac4-fb36-419c-b158-991e7d90bf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:10.378097 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a839ac4-fb36-419c-b158-991e7d90bf67 admin admin] PATH_INFO: `/v3/projects/d9738745372244c794e3ae0d51cf821d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:10.379318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a839ac4-fb36-419c-b158-991e7d90bf67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9738745372244c794e3ae0d51cf821d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:10.381218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a839ac4-fb36-419c-b158-991e7d90bf67 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:10.435957 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4a839ac4-fb36-419c-b158-991e7d90bf67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9738745372244c794e3ae0d51cf821d', 'request_id': 'req-4a839ac4-fb36-419c-b158-991e7d90bf67'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:38:10.443086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4a839ac4-fb36-419c-b158-991e7d90bf67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9738745372244c794e3ae0d51cf821d', 'request_id': 'req-4a839ac4-fb36-419c-b158-991e7d90bf67'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:38:10.449994 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4a839ac4-fb36-419c-b158-991e7d90bf67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9738745372244c794e3ae0d51cf821d', 'request_id': 'req-4a839ac4-fb36-419c-b158-991e7d90bf67'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:38:10.459140 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:38:10.467279 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4a839ac4-fb36-419c-b158-991e7d90bf67 admin admin] The token cache is being invalidate because project d9738745372244c794e3ae0d51cf821d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:38:10.467997 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4a839ac4-fb36-419c-b158-991e7d90bf67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:38:10.468710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4a839ac4-fb36-419c-b158-991e7d90bf67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:38:10.473432 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1277/2549] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:38:10 2022] DELETE /identity/v3/projects/d9738745372244c794e3ae0d51cf821d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:38:17.897374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3343923-ff14-4e89-8de4-91b5bc2905ca None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:17.897983 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3343923-ff14-4e89-8de4-91b5bc2905ca None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:17.897983 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3343923-ff14-4e89-8de4-91b5bc2905ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:17.915808 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a3343923-ff14-4e89-8de4-91b5bc2905ca None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:17.917048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a3343923-ff14-4e89-8de4-91b5bc2905ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:17.959560 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:38:17.986673 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1273/2550] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jun 15 00:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:38:18.007296 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a839ac4-fb36-419c-b158-991e7d90bf67 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:18.009103 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4a839ac4-fb36-419c-b158-991e7d90bf67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:18.085871 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a839ac4-fb36-419c-b158-991e7d90bf67 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:18.091412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f1fcd-c1eb-474a-bbe9-397a350ab6fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:18.092068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f1fcd-c1eb-474a-bbe9-397a350ab6fb service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:18.092352 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f1fcd-c1eb-474a-bbe9-397a350ab6fb service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:18.092641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f1fcd-c1eb-474a-bbe9-397a350ab6fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:18.100747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f1fcd-c1eb-474a-bbe9-397a350ab6fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:18.102365 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f1fcd-c1eb-474a-bbe9-397a350ab6fb service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:18.112079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1278/2551] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:38:21.382551 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df8c27-c426-42d3-b0a1-266a111aa0d7 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:21.383089 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df8c27-c426-42d3-b0a1-266a111aa0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:21.383089 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df8c27-c426-42d3-b0a1-266a111aa0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:21.406697 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b9df8c27-c426-42d3-b0a1-266a111aa0d7 None None] MFA Rules not processed for user `21c54bf3ff584c709731d3624aa187a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:21.408452 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b9df8c27-c426-42d3-b0a1-266a111aa0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:21.470661 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1274/2552] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:38:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:38:23.157998 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8827425-c486-4fa1-9f30-713de9721b37 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:23.158740 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8827425-c486-4fa1-9f30-713de9721b37 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:23.159194 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8827425-c486-4fa1-9f30-713de9721b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:23.182905 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-a8827425-c486-4fa1-9f30-713de9721b37 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:23.184904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a8827425-c486-4fa1-9f30-713de9721b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:23.193261 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1279/2553] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jun 15 00:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:38:23.336274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df8c27-c426-42d3-b0a1-266a111aa0d7 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:23.337842 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b9df8c27-c426-42d3-b0a1-266a111aa0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:23.358205 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df8c27-c426-42d3-b0a1-266a111aa0d7 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:23.364100 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a898a3c-0ee2-4a7e-be4e-bd26b1de5e7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:23.364745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a898a3c-0ee2-4a7e-be4e-bd26b1de5e7e service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:23.365036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a898a3c-0ee2-4a7e-be4e-bd26b1de5e7e service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:23.365311 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a898a3c-0ee2-4a7e-be4e-bd26b1de5e7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:23.373876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a898a3c-0ee2-4a7e-be4e-bd26b1de5e7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:23.375458 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a898a3c-0ee2-4a7e-be4e-bd26b1de5e7e service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:23.384984 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1275/2554] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:38:29.397200 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb1cf-2232-4f72-8427-35ce0ee676f4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:29.397685 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb1cf-2232-4f72-8427-35ce0ee676f4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:29.398095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb1cf-2232-4f72-8427-35ce0ee676f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:29.418275 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-615eb1cf-2232-4f72-8427-35ce0ee676f4 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:38:29.419770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-615eb1cf-2232-4f72-8427-35ce0ee676f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:29.429820 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1280/2555] 10.222.0.39 () {58 vars in 1016 bytes} [Wed Jun 15 00:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:38:29.451810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a898a3c-0ee2-4a7e-be4e-bd26b1de5e7e service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:29.463193 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a898a3c-0ee2-4a7e-be4e-bd26b1de5e7e service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:29.469137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96631b4-9c46-4cdc-a0ff-38081f012d94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:29.469906 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96631b4-9c46-4cdc-a0ff-38081f012d94 service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:29.470265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96631b4-9c46-4cdc-a0ff-38081f012d94 service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:29.470626 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96631b4-9c46-4cdc-a0ff-38081f012d94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:29.480492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96631b4-9c46-4cdc-a0ff-38081f012d94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:29.482131 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96631b4-9c46-4cdc-a0ff-38081f012d94 service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:29.492266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1276/2556] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:38:32.758611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eb1cf-2232-4f72-8427-35ce0ee676f4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:32.760200 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-615eb1cf-2232-4f72-8427-35ce0ee676f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:32.821388 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eb1cf-2232-4f72-8427-35ce0ee676f4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:32.825009 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7ec0b-bf9e-4387-a76e-a6b320e5bb08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:32.825710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7ec0b-bf9e-4387-a76e-a6b320e5bb08 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:32.826000 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7ec0b-bf9e-4387-a76e-a6b320e5bb08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:32.826282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7ec0b-bf9e-4387-a76e-a6b320e5bb08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:32.828109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-27a7ec0b-bf9e-4387-a76e-a6b320e5bb08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:32.892842 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7ec0b-bf9e-4387-a76e-a6b320e5bb08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:32.894417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7ec0b-bf9e-4387-a76e-a6b320e5bb08 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:32.904867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1281/2557] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:38:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:38:39.487838 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=44 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:38:42.900549 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=91 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:38:59.784795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96631b4-9c46-4cdc-a0ff-38081f012d94 service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:38:59.786308 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c96631b4-9c46-4cdc-a0ff-38081f012d94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:38:59.799397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96631b4-9c46-4cdc-a0ff-38081f012d94 service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:38:59.804336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5ecc5-8169-45d5-8e9a-45f78436b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:38:59.805214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5ecc5-8169-45d5-8e9a-45f78436b9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:38:59.805530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5ecc5-8169-45d5-8e9a-45f78436b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:38:59.805807 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5ecc5-8169-45d5-8e9a-45f78436b9b5 admin admin] PATH_INFO: `/v3/users/6586c9aa3c984b9b963a2e2c583ef7bf` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:38:59.807026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5ecc5-8169-45d5-8e9a-45f78436b9b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6586c9aa3c984b9b963a2e2c583ef7bf)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:38:59.808943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5ecc5-8169-45d5-8e9a-45f78436b9b5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:38:59.856428 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-72a5ecc5-8169-45d5-8e9a-45f78436b9b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6586c9aa3c984b9b963a2e2c583ef7bf'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:38:59.864744 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-72a5ecc5-8169-45d5-8e9a-45f78436b9b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6586c9aa3c984b9b963a2e2c583ef7bf'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:38:59.865485 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-72a5ecc5-8169-45d5-8e9a-45f78436b9b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6586c9aa3c984b9b963a2e2c583ef7bf'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:38:59.866087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-72a5ecc5-8169-45d5-8e9a-45f78436b9b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6586c9aa3c984b9b963a2e2c583ef7bf'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:38:59.877681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-72a5ecc5-8169-45d5-8e9a-45f78436b9b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6586c9aa3c984b9b963a2e2c583ef7bf'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:38:59.890606 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1277/2558] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:38:59 2022] DELETE /identity/v3/users/6586c9aa3c984b9b963a2e2c583ef7bf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:39:00.071538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7ec0b-bf9e-4387-a76e-a6b320e5bb08 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:39:00.082502 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7ec0b-bf9e-4387-a76e-a6b320e5bb08 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:39:00.157542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9121a-ebb9-406f-8250-ba47fa84a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:39:00.158315 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9121a-ebb9-406f-8250-ba47fa84a813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:00.158597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9121a-ebb9-406f-8250-ba47fa84a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:00.158870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9121a-ebb9-406f-8250-ba47fa84a813 admin admin] PATH_INFO: `/v3/projects/ccc0ab8c84c0468f81b6dada81c3cea2` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:00.160190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9121a-ebb9-406f-8250-ba47fa84a813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc0ab8c84c0468f81b6dada81c3cea2)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:39:00.162119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9121a-ebb9-406f-8250-ba47fa84a813 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:39:00.220413 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-eae9121a-ebb9-406f-8250-ba47fa84a813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc0ab8c84c0468f81b6dada81c3cea2', 'request_id': 'req-eae9121a-ebb9-406f-8250-ba47fa84a813'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:39:00.226384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-eae9121a-ebb9-406f-8250-ba47fa84a813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc0ab8c84c0468f81b6dada81c3cea2', 'request_id': 'req-eae9121a-ebb9-406f-8250-ba47fa84a813'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:39:00.232926 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-eae9121a-ebb9-406f-8250-ba47fa84a813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc0ab8c84c0468f81b6dada81c3cea2', 'request_id': 'req-eae9121a-ebb9-406f-8250-ba47fa84a813'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:39:00.245984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-eae9121a-ebb9-406f-8250-ba47fa84a813 admin admin] The token cache is being invalidate because project ccc0ab8c84c0468f81b6dada81c3cea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:39:00.246272 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-eae9121a-ebb9-406f-8250-ba47fa84a813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:39:00.246915 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-eae9121a-ebb9-406f-8250-ba47fa84a813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:39:00.248542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1282/2559] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:39:00 2022] DELETE /identity/v3/projects/ccc0ab8c84c0468f81b6dada81c3cea2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:39:09.886987 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:39:10.243143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:39:32.700210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5ecc5-8169-45d5-8e9a-45f78436b9b5 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:39:32.701770 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-72a5ecc5-8169-45d5-8e9a-45f78436b9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:39:32.715337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5ecc5-8169-45d5-8e9a-45f78436b9b5 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:39:32.781579 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543451ec-20ae-495d-bc5b-2de82dbc6131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:39:32.782676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543451ec-20ae-495d-bc5b-2de82dbc6131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:32.782989 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543451ec-20ae-495d-bc5b-2de82dbc6131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:32.783267 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543451ec-20ae-495d-bc5b-2de82dbc6131 admin admin] PATH_INFO: `/v3/users/21c54bf3ff584c709731d3624aa187a4` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:32.784468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543451ec-20ae-495d-bc5b-2de82dbc6131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c54bf3ff584c709731d3624aa187a4)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:39:32.786482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543451ec-20ae-495d-bc5b-2de82dbc6131 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:39:32.834516 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-543451ec-20ae-495d-bc5b-2de82dbc6131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c54bf3ff584c709731d3624aa187a4'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:39:32.842467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-543451ec-20ae-495d-bc5b-2de82dbc6131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c54bf3ff584c709731d3624aa187a4'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:39:32.843036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-543451ec-20ae-495d-bc5b-2de82dbc6131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c54bf3ff584c709731d3624aa187a4'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:39:32.843657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-543451ec-20ae-495d-bc5b-2de82dbc6131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c54bf3ff584c709731d3624aa187a4'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:39:32.856106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-543451ec-20ae-495d-bc5b-2de82dbc6131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c54bf3ff584c709731d3624aa187a4'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:39:32.868411 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1278/2560] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:39:32 2022] DELETE /identity/v3/users/21c54bf3ff584c709731d3624aa187a4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:39:33.049024 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9121a-ebb9-406f-8250-ba47fa84a813 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:39:33.050578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-eae9121a-ebb9-406f-8250-ba47fa84a813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:39:33.064143 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9121a-ebb9-406f-8250-ba47fa84a813 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:39:33.127270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470543ef-d3b4-43e9-baf5-89ebd4f7b129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:39:33.128108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470543ef-d3b4-43e9-baf5-89ebd4f7b129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:33.128399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470543ef-d3b4-43e9-baf5-89ebd4f7b129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:33.128672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470543ef-d3b4-43e9-baf5-89ebd4f7b129 admin admin] PATH_INFO: `/v3/projects/8a97ae7800f0422cadeb9b69a018df12` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:33.129944 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470543ef-d3b4-43e9-baf5-89ebd4f7b129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a97ae7800f0422cadeb9b69a018df12)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:39:33.131888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470543ef-d3b4-43e9-baf5-89ebd4f7b129 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:39:33.180061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-470543ef-d3b4-43e9-baf5-89ebd4f7b129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a97ae7800f0422cadeb9b69a018df12', 'request_id': 'req-470543ef-d3b4-43e9-baf5-89ebd4f7b129'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:39:33.185456 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-470543ef-d3b4-43e9-baf5-89ebd4f7b129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a97ae7800f0422cadeb9b69a018df12', 'request_id': 'req-470543ef-d3b4-43e9-baf5-89ebd4f7b129'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:39:33.191476 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-470543ef-d3b4-43e9-baf5-89ebd4f7b129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a97ae7800f0422cadeb9b69a018df12', 'request_id': 'req-470543ef-d3b4-43e9-baf5-89ebd4f7b129'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:39:33.207240 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-470543ef-d3b4-43e9-baf5-89ebd4f7b129 admin admin] The token cache is being invalidate because project 8a97ae7800f0422cadeb9b69a018df12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:39:33.207537 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-470543ef-d3b4-43e9-baf5-89ebd4f7b129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:39:33.208186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-470543ef-d3b4-43e9-baf5-89ebd4f7b129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:39:33.209875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1283/2561] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:39:33 2022] DELETE /identity/v3/projects/8a97ae7800f0422cadeb9b69a018df12 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:39:33.216765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ba185-111c-4d30-9717-aa93370979f5 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:33.217180 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ba185-111c-4d30-9717-aa93370979f5 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:33.217641 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ba185-111c-4d30-9717-aa93370979f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:33.241561 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-cb9ba185-111c-4d30-9717-aa93370979f5 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:39:33.242771 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-cb9ba185-111c-4d30-9717-aa93370979f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:39:33.314065 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1279/2562] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:39:33.322379 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335ffc5-240e-4c79-ae54-1f5db67be759 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:33.322769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335ffc5-240e-4c79-ae54-1f5db67be759 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:33.323057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335ffc5-240e-4c79-ae54-1f5db67be759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:33.342985 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-3335ffc5-240e-4c79-ae54-1f5db67be759 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:39:33.344182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3335ffc5-240e-4c79-ae54-1f5db67be759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:39:33.353893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1284/2563] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:39:33.358221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ba185-111c-4d30-9717-aa93370979f5 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:39:33.368195 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ba185-111c-4d30-9717-aa93370979f5 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:39:33.373269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9e6bb-13ee-4268-b16c-1d7fbf6cf138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:39:33.373942 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9e6bb-13ee-4268-b16c-1d7fbf6cf138 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:33.374247 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9e6bb-13ee-4268-b16c-1d7fbf6cf138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:33.374625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9e6bb-13ee-4268-b16c-1d7fbf6cf138 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:33.375362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9e6bb-13ee-4268-b16c-1d7fbf6cf138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:39:33.375670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9e6bb-13ee-4268-b16c-1d7fbf6cf138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:39:33.377338 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9e6bb-13ee-4268-b16c-1d7fbf6cf138 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:39:33.388967 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1280/2564] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:39:33.393321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335ffc5-240e-4c79-ae54-1f5db67be759 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:39:33.403242 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335ffc5-240e-4c79-ae54-1f5db67be759 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:39:33.409263 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269ba67-b794-4600-8729-ec9b6972dae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:39:33.409948 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269ba67-b794-4600-8729-ec9b6972dae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:33.410231 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269ba67-b794-4600-8729-ec9b6972dae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:33.410533 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269ba67-b794-4600-8729-ec9b6972dae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:33.411251 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269ba67-b794-4600-8729-ec9b6972dae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:39:33.413147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269ba67-b794-4600-8729-ec9b6972dae2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:39:33.445698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1285/2565] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:39:33 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:39:33.449753 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9e6bb-13ee-4268-b16c-1d7fbf6cf138 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:39:33.460442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9e6bb-13ee-4268-b16c-1d7fbf6cf138 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:39:33.464784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:39:33.521773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63d0f1-86c5-43b0-842f-d93449d80de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:39:33.522454 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63d0f1-86c5-43b0-842f-d93449d80de1 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:33.522744 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63d0f1-86c5-43b0-842f-d93449d80de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:33.523026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63d0f1-86c5-43b0-842f-d93449d80de1 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:33.523747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63d0f1-86c5-43b0-842f-d93449d80de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:39:33.525680 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63d0f1-86c5-43b0-842f-d93449d80de1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:39:33.548741 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1281/2566] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:39:33 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:39:33.553223 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269ba67-b794-4600-8729-ec9b6972dae2 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:39:33.564150 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269ba67-b794-4600-8729-ec9b6972dae2 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:39:33.569672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f894c-a4cd-4b87-a2c8-3c76d901da91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:39:33.570349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f894c-a4cd-4b87-a2c8-3c76d901da91 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:33.570656 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f894c-a4cd-4b87-a2c8-3c76d901da91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:33.570919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f894c-a4cd-4b87-a2c8-3c76d901da91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:33.571657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f894c-a4cd-4b87-a2c8-3c76d901da91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:39:33.573269 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f894c-a4cd-4b87-a2c8-3c76d901da91 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:39:33.584360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1286/2567] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:39:33.588599 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63d0f1-86c5-43b0-842f-d93449d80de1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:39:33.599254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63d0f1-86c5-43b0-842f-d93449d80de1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:39:33.605558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c4d12-e4ab-484c-8ef2-91715ad8a474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:39:33.606240 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c4d12-e4ab-484c-8ef2-91715ad8a474 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:33.606525 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c4d12-e4ab-484c-8ef2-91715ad8a474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:33.606803 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c4d12-e4ab-484c-8ef2-91715ad8a474 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:33.607552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c4d12-e4ab-484c-8ef2-91715ad8a474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:39:33.609239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c4d12-e4ab-484c-8ef2-91715ad8a474 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:39:33.619522 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1282/2568] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:39:33.623777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f894c-a4cd-4b87-a2c8-3c76d901da91 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:39:33.634031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f894c-a4cd-4b87-a2c8-3c76d901da91 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:39:33.639771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd7d0f-6464-49d0-9c87-9f18034c6123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:39:33.640679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd7d0f-6464-49d0-9c87-9f18034c6123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:33.640972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd7d0f-6464-49d0-9c87-9f18034c6123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:33.641253 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd7d0f-6464-49d0-9c87-9f18034c6123 admin admin] PATH_INFO: `/v3/projects/9f07873934b14857900273fa86646e8b/users/b68e09c886b540f2940af15c10fd28c9/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:33.656089 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd7d0f-6464-49d0-9c87-9f18034c6123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f07873934b14857900273fa86646e8b, user_id=b68e09c886b540f2940af15c10fd28c9, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:39:33.658792 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd7d0f-6464-49d0-9c87-9f18034c6123 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:39:33.673800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1287/2569] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:39:33 2022] PUT /identity/v3/projects/9f07873934b14857900273fa86646e8b/users/b68e09c886b540f2940af15c10fd28c9/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:39:33.678906 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43b327-8f7a-4f3a-8a93-faed0335684a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:33.679202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43b327-8f7a-4f3a-8a93-faed0335684a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:33.679487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43b327-8f7a-4f3a-8a93-faed0335684a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:33.697814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-af43b327-8f7a-4f3a-8a93-faed0335684a None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:39:33.699020 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-af43b327-8f7a-4f3a-8a93-faed0335684a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:39:33.759351 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1283/2570] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:39:33.768998 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd7d0f-6464-49d0-9c87-9f18034c6123 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:39:33.770844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-75bd7d0f-6464-49d0-9c87-9f18034c6123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:39:33.802147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:39:33.829905 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd7d0f-6464-49d0-9c87-9f18034c6123 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:39:33.833821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3dd11-0073-449e-9937-36cd9df207b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:39:33.834462 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3dd11-0073-449e-9937-36cd9df207b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:33.834753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3dd11-0073-449e-9937-36cd9df207b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:33.835036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3dd11-0073-449e-9937-36cd9df207b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:33.844890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3dd11-0073-449e-9937-36cd9df207b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:39:33.846374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3dd11-0073-449e-9937-36cd9df207b6 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:39:33.856274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1288/2571] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:39:38.125044 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d9fe0-023e-471f-a87d-16c98159c77b None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:38.125681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d9fe0-023e-471f-a87d-16c98159c77b None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:38.125812 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d9fe0-023e-471f-a87d-16c98159c77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:38.157000 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-7a6d9fe0-023e-471f-a87d-16c98159c77b None None] MFA Rules not processed for user `b68e09c886b540f2940af15c10fd28c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:39:38.158845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7a6d9fe0-023e-471f-a87d-16c98159c77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:39:38.249051 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1284/2572] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:39:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:39:38.261338 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3dd11-0073-449e-9937-36cd9df207b6 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:39:38.262885 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d2f3dd11-0073-449e-9937-36cd9df207b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:39:38.345673 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3dd11-0073-449e-9937-36cd9df207b6 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:39:38.352079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0b36f-b015-4481-b664-f610f0e1fe2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:39:38.352746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0b36f-b015-4481-b664-f610f0e1fe2b service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:38.353037 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0b36f-b015-4481-b664-f610f0e1fe2b service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:38.353319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0b36f-b015-4481-b664-f610f0e1fe2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:38.363266 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0b36f-b015-4481-b664-f610f0e1fe2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:39:38.364908 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0b36f-b015-4481-b664-f610f0e1fe2b service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:39:38.377763 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1289/2573] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:39:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:39:39.901887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdc9d9-a298-4bd5-adba-f95591662a4c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:39.902479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdc9d9-a298-4bd5-adba-f95591662a4c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:39.902972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cdc9d9-a298-4bd5-adba-f95591662a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:39.921755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-c0cdc9d9-a298-4bd5-adba-f95591662a4c None None] MFA Rules not processed for user `33d4efb515524324a8442438b3a9c7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:39:39.922917 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c0cdc9d9-a298-4bd5-adba-f95591662a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:39:39.932515 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:39:39.984538 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1285/2574] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:39:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:39:40.106833 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84dd06-e4fe-4303-9b61-cb7f9c5ae56c None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:40.107448 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84dd06-e4fe-4303-9b61-cb7f9c5ae56c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:40.107690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84dd06-e4fe-4303-9b61-cb7f9c5ae56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:40.126603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8c84dd06-e4fe-4303-9b61-cb7f9c5ae56c None None] MFA Rules not processed for user `b68e09c886b540f2940af15c10fd28c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:39:40.127875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8c84dd06-e4fe-4303-9b61-cb7f9c5ae56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:39:40.135910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1290/2575] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:39:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:39:49.973979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=18 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:39:50.121574 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=51 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:39:54.260974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdc9d9-a298-4bd5-adba-f95591662a4c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:39:54.262644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c0cdc9d9-a298-4bd5-adba-f95591662a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:39:54.276380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cdc9d9-a298-4bd5-adba-f95591662a4c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:39:54.280966 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ac106-935e-47f2-b0bb-61bc65c828ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:39:54.281650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ac106-935e-47f2-b0bb-61bc65c828ef service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:39:54.281933 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ac106-935e-47f2-b0bb-61bc65c828ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:39:54.282212 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ac106-935e-47f2-b0bb-61bc65c828ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:39:54.284292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-688ac106-935e-47f2-b0bb-61bc65c828ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:39:54.297904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ac106-935e-47f2-b0bb-61bc65c828ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:39:54.299279 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ac106-935e-47f2-b0bb-61bc65c828ef service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:39:54.310115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1286/2576] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:39:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:04.305639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=6 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:05.612040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84dd06-e4fe-4303-9b61-cb7f9c5ae56c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:05.623902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84dd06-e4fe-4303-9b61-cb7f9c5ae56c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:05.629736 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a869d01-183b-4b58-bc3a-7e1c090c9928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:05.631022 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869d01-183b-4b58-bc3a-7e1c090c9928 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:05.631534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869d01-183b-4b58-bc3a-7e1c090c9928 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:05.632042 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869d01-183b-4b58-bc3a-7e1c090c9928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:05.634220 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9a869d01-183b-4b58-bc3a-7e1c090c9928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:05.646149 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a869d01-183b-4b58-bc3a-7e1c090c9928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:05.648059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a869d01-183b-4b58-bc3a-7e1c090c9928 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:05.658374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1291/2577] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:07.935054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ac106-935e-47f2-b0bb-61bc65c828ef service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:07.936467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-688ac106-935e-47f2-b0bb-61bc65c828ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:07.993492 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ac106-935e-47f2-b0bb-61bc65c828ef service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:07.997770 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f590c4f-6e38-4b57-b151-40fe7aa96a3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:07.998414 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f590c4f-6e38-4b57-b151-40fe7aa96a3b service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:07.998705 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f590c4f-6e38-4b57-b151-40fe7aa96a3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:07.998985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f590c4f-6e38-4b57-b151-40fe7aa96a3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:08.000911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5f590c4f-6e38-4b57-b151-40fe7aa96a3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:08.015321 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f590c4f-6e38-4b57-b151-40fe7aa96a3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:08.016767 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f590c4f-6e38-4b57-b151-40fe7aa96a3b service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:08.027998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1287/2578] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:12.991202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf844c40-773e-409e-909f-30cdab6fdae4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:12.991646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf844c40-773e-409e-909f-30cdab6fdae4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:12.991752 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf844c40-773e-409e-909f-30cdab6fdae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:13.010034 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-cf844c40-773e-409e-909f-30cdab6fdae4 None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:13.011216 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cf844c40-773e-409e-909f-30cdab6fdae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:13.069887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1292/2579] 10.222.0.36 () {58 vars in 967 bytes} [Wed Jun 15 00:40:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:13.106519 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f590c4f-6e38-4b57-b151-40fe7aa96a3b service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:13.108266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5f590c4f-6e38-4b57-b151-40fe7aa96a3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:13.179118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f590c4f-6e38-4b57-b151-40fe7aa96a3b service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:13.184573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11857f37-e69f-4baa-ab1b-e5d3d4bc8a83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:13.185222 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11857f37-e69f-4baa-ab1b-e5d3d4bc8a83 service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:13.185540 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11857f37-e69f-4baa-ab1b-e5d3d4bc8a83 service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:13.185821 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11857f37-e69f-4baa-ab1b-e5d3d4bc8a83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:13.194204 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11857f37-e69f-4baa-ab1b-e5d3d4bc8a83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:13.195808 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11857f37-e69f-4baa-ab1b-e5d3d4bc8a83 service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:13.203996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1288/2580] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:40:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:40:19.985361 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf844c40-773e-409e-909f-30cdab6fdae4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:19.987044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cf844c40-773e-409e-909f-30cdab6fdae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:20.001967 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf844c40-773e-409e-909f-30cdab6fdae4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:20.006646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cfe9e-2065-4bc5-9c9f-92f750d0d346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:20.007524 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cfe9e-2065-4bc5-9c9f-92f750d0d346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:20.007806 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cfe9e-2065-4bc5-9c9f-92f750d0d346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:20.008078 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cfe9e-2065-4bc5-9c9f-92f750d0d346 admin admin] PATH_INFO: `/v3/users/03eead49238d46e98b114148a3a2f93c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:20.009684 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cfe9e-2065-4bc5-9c9f-92f750d0d346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03eead49238d46e98b114148a3a2f93c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:20.011598 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cfe9e-2065-4bc5-9c9f-92f750d0d346 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:20.059378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8b4cfe9e-2065-4bc5-9c9f-92f750d0d346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03eead49238d46e98b114148a3a2f93c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.067046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8b4cfe9e-2065-4bc5-9c9f-92f750d0d346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03eead49238d46e98b114148a3a2f93c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.067789 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8b4cfe9e-2065-4bc5-9c9f-92f750d0d346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03eead49238d46e98b114148a3a2f93c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.068535 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8b4cfe9e-2065-4bc5-9c9f-92f750d0d346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03eead49238d46e98b114148a3a2f93c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.081412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8b4cfe9e-2065-4bc5-9c9f-92f750d0d346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03eead49238d46e98b114148a3a2f93c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.094379 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1293/2581] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:40:19 2022] DELETE /identity/v3/users/03eead49238d46e98b114148a3a2f93c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:20.277104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11857f37-e69f-4baa-ab1b-e5d3d4bc8a83 service swift] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:20.293899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11857f37-e69f-4baa-ab1b-e5d3d4bc8a83 service swift] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:20.354602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2482f-64bc-4791-85f7-eeac06034815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:20.355566 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2482f-64bc-4791-85f7-eeac06034815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:20.355876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2482f-64bc-4791-85f7-eeac06034815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:20.356161 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2482f-64bc-4791-85f7-eeac06034815 admin admin] PATH_INFO: `/v3/projects/f3137635b0864d4e8cd375fa96ab0bf7` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:20.357443 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2482f-64bc-4791-85f7-eeac06034815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3137635b0864d4e8cd375fa96ab0bf7)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:20.359536 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2482f-64bc-4791-85f7-eeac06034815 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:20.400436 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:20.412561 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d9a2482f-64bc-4791-85f7-eeac06034815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3137635b0864d4e8cd375fa96ab0bf7', 'request_id': 'req-d9a2482f-64bc-4791-85f7-eeac06034815'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.418732 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d9a2482f-64bc-4791-85f7-eeac06034815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3137635b0864d4e8cd375fa96ab0bf7', 'request_id': 'req-d9a2482f-64bc-4791-85f7-eeac06034815'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.425199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d9a2482f-64bc-4791-85f7-eeac06034815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3137635b0864d4e8cd375fa96ab0bf7', 'request_id': 'req-d9a2482f-64bc-4791-85f7-eeac06034815'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.441928 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d9a2482f-64bc-4791-85f7-eeac06034815 admin admin] The token cache is being invalidate because project f3137635b0864d4e8cd375fa96ab0bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:40:20.442286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d9a2482f-64bc-4791-85f7-eeac06034815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.443360 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d9a2482f-64bc-4791-85f7-eeac06034815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.445891 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1289/2582] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:40:20 2022] DELETE /identity/v3/projects/f3137635b0864d4e8cd375fa96ab0bf7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:20.451673 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cfe9e-2065-4bc5-9c9f-92f750d0d346 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:20.453311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8b4cfe9e-2065-4bc5-9c9f-92f750d0d346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:20.468176 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cfe9e-2065-4bc5-9c9f-92f750d0d346 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:20.529009 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0152a-23ff-467a-b2ed-b0400cfe4ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:20.530016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0152a-23ff-467a-b2ed-b0400cfe4ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:20.530297 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0152a-23ff-467a-b2ed-b0400cfe4ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:20.530570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0152a-23ff-467a-b2ed-b0400cfe4ed5 admin admin] PATH_INFO: `/v3/users/c7a1198a49234c5eb5ed54a8ad0d8b2c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:20.531756 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0152a-23ff-467a-b2ed-b0400cfe4ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7a1198a49234c5eb5ed54a8ad0d8b2c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:20.533805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0152a-23ff-467a-b2ed-b0400cfe4ed5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:20.538546 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:20.584786 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-13f0152a-23ff-467a-b2ed-b0400cfe4ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7a1198a49234c5eb5ed54a8ad0d8b2c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.593709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-13f0152a-23ff-467a-b2ed-b0400cfe4ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7a1198a49234c5eb5ed54a8ad0d8b2c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.594353 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-13f0152a-23ff-467a-b2ed-b0400cfe4ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7a1198a49234c5eb5ed54a8ad0d8b2c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.594945 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-13f0152a-23ff-467a-b2ed-b0400cfe4ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7a1198a49234c5eb5ed54a8ad0d8b2c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.608364 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-13f0152a-23ff-467a-b2ed-b0400cfe4ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7a1198a49234c5eb5ed54a8ad0d8b2c'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.620894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1294/2583] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:40:20 2022] DELETE /identity/v3/users/c7a1198a49234c5eb5ed54a8ad0d8b2c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:20.795748 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2482f-64bc-4791-85f7-eeac06034815 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:20.797286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d9a2482f-64bc-4791-85f7-eeac06034815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:20.812841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2482f-64bc-4791-85f7-eeac06034815 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:20.870648 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafc322-75ea-48e5-a4b3-1654adb8a90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:20.871530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafc322-75ea-48e5-a4b3-1654adb8a90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:20.871812 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafc322-75ea-48e5-a4b3-1654adb8a90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:20.872086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafc322-75ea-48e5-a4b3-1654adb8a90e admin admin] PATH_INFO: `/v3/projects/fb08dc21d0da4e13975081e42b297db1` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:20.873264 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafc322-75ea-48e5-a4b3-1654adb8a90e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb08dc21d0da4e13975081e42b297db1)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:20.875209 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafc322-75ea-48e5-a4b3-1654adb8a90e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:20.938329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6fafc322-75ea-48e5-a4b3-1654adb8a90e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb08dc21d0da4e13975081e42b297db1', 'request_id': 'req-6fafc322-75ea-48e5-a4b3-1654adb8a90e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.944994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6fafc322-75ea-48e5-a4b3-1654adb8a90e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb08dc21d0da4e13975081e42b297db1', 'request_id': 'req-6fafc322-75ea-48e5-a4b3-1654adb8a90e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.951154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6fafc322-75ea-48e5-a4b3-1654adb8a90e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb08dc21d0da4e13975081e42b297db1', 'request_id': 'req-6fafc322-75ea-48e5-a4b3-1654adb8a90e'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.965681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6fafc322-75ea-48e5-a4b3-1654adb8a90e admin admin] The token cache is being invalidate because project fb08dc21d0da4e13975081e42b297db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:40:20.965968 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6fafc322-75ea-48e5-a4b3-1654adb8a90e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.966645 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6fafc322-75ea-48e5-a4b3-1654adb8a90e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:20.968264 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1290/2584] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:40:20 2022] DELETE /identity/v3/projects/fb08dc21d0da4e13975081e42b297db1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:30.617368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=24,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:30.962500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:DELETE=12,keystone:SELECT=62,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:46.977181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666953e-3f4e-4f0f-b2a8-3de233cbd438 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:46.977707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666953e-3f4e-4f0f-b2a8-3de233cbd438 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:46.977707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666953e-3f4e-4f0f-b2a8-3de233cbd438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:46.994576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1666953e-3f4e-4f0f-b2a8-3de233cbd438 None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:46.995753 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1666953e-3f4e-4f0f-b2a8-3de233cbd438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:47.053690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1295/2585] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 15 00:40:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:47.065899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafc322-75ea-48e5-a4b3-1654adb8a90e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:47.067564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6fafc322-75ea-48e5-a4b3-1654adb8a90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:47.144745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafc322-75ea-48e5-a4b3-1654adb8a90e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:47.150526 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62390cb-b7b9-4307-ae4f-b649ea181db9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:47.151193 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62390cb-b7b9-4307-ae4f-b649ea181db9 service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:47.151479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62390cb-b7b9-4307-ae4f-b649ea181db9 service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:47.151758 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62390cb-b7b9-4307-ae4f-b649ea181db9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:47.163509 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62390cb-b7b9-4307-ae4f-b649ea181db9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:47.165174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62390cb-b7b9-4307-ae4f-b649ea181db9 service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:47.174277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1291/2586] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:40:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:40:49.278977 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666953e-3f4e-4f0f-b2a8-3de233cbd438 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:49.283427 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1666953e-3f4e-4f0f-b2a8-3de233cbd438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:49.332307 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62390cb-b7b9-4307-ae4f-b649ea181db9 service swift] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:49.334063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c62390cb-b7b9-4307-ae4f-b649ea181db9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:49.378761 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666953e-3f4e-4f0f-b2a8-3de233cbd438 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:49.386167 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ab9af-3df3-413e-b282-6069d2d1e9c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:49.387069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ab9af-3df3-413e-b282-6069d2d1e9c0 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:49.387561 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ab9af-3df3-413e-b282-6069d2d1e9c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:49.388173 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ab9af-3df3-413e-b282-6069d2d1e9c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:49.390848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-265ab9af-3df3-413e-b282-6069d2d1e9c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:49.406614 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ab9af-3df3-413e-b282-6069d2d1e9c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:49.408582 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ab9af-3df3-413e-b282-6069d2d1e9c0 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:49.414254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62390cb-b7b9-4307-ae4f-b649ea181db9 service swift] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:49.418569 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d304a4-c628-4652-a43a-cd4c769e950b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:49.419239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d304a4-c628-4652-a43a-cd4c769e950b service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:49.419527 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d304a4-c628-4652-a43a-cd4c769e950b service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:49.419811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d304a4-c628-4652-a43a-cd4c769e950b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:49.423118 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1296/2587] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:49.425419 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a4d304a4-c628-4652-a43a-cd4c769e950b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:49.503021 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d304a4-c628-4652-a43a-cd4c769e950b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:49.504919 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d304a4-c628-4652-a43a-cd4c769e950b service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:49.517083 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1292/2588] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:40:53.216978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ab9af-3df3-413e-b282-6069d2d1e9c0 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:53.220170 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-265ab9af-3df3-413e-b282-6069d2d1e9c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:53.312558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d304a4-c628-4652-a43a-cd4c769e950b service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:53.314437 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a4d304a4-c628-4652-a43a-cd4c769e950b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:53.339095 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d304a4-c628-4652-a43a-cd4c769e950b service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:53.344330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f783b0-a719-4a9d-b967-83a940716c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:53.345421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f783b0-a719-4a9d-b967-83a940716c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:53.345777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f783b0-a719-4a9d-b967-83a940716c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:53.346130 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f783b0-a719-4a9d-b967-83a940716c75 admin admin] PATH_INFO: `/v3/users/33d4efb515524324a8442438b3a9c7aa` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:53.347477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f783b0-a719-4a9d-b967-83a940716c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d4efb515524324a8442438b3a9c7aa)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:53.350045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f783b0-a719-4a9d-b967-83a940716c75 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:53.403300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ab9af-3df3-413e-b282-6069d2d1e9c0 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:53.414018 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb62763-3df6-40c6-b83a-98fb9f2634df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e6dd029a3d45f6aeb4da06db9753dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:53.414517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb62763-3df6-40c6-b83a-98fb9f2634df service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:53.414870 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb62763-3df6-40c6-b83a-98fb9f2634df service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:53.415245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb62763-3df6-40c6-b83a-98fb9f2634df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:53.417244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9bb62763-3df6-40c6-b83a-98fb9f2634df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:53.418711 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:53.430428 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d0f783b0-a719-4a9d-b967-83a940716c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d4efb515524324a8442438b3a9c7aa'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:53.439537 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb62763-3df6-40c6-b83a-98fb9f2634df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:53.441686 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d0f783b0-a719-4a9d-b967-83a940716c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d4efb515524324a8442438b3a9c7aa'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:53.441883 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb62763-3df6-40c6-b83a-98fb9f2634df service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:53.442675 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d0f783b0-a719-4a9d-b967-83a940716c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d4efb515524324a8442438b3a9c7aa'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:53.443573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d0f783b0-a719-4a9d-b967-83a940716c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d4efb515524324a8442438b3a9c7aa'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:53.464115 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-d0f783b0-a719-4a9d-b967-83a940716c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d4efb515524324a8442438b3a9c7aa'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:53.473248 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1297/2589] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:53.477625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1293/2590] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:40:53 2022] DELETE /identity/v3/users/33d4efb515524324a8442438b3a9c7aa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:40:53.739071 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb62763-3df6-40c6-b83a-98fb9f2634df service placement] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:53.751017 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb62763-3df6-40c6-b83a-98fb9f2634df service placement] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:53.797904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:53.851044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f755a-5fd4-42f2-ae71-718e8c63a515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:53.852093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f755a-5fd4-42f2-ae71-718e8c63a515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:53.852471 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f755a-5fd4-42f2-ae71-718e8c63a515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:53.852853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f755a-5fd4-42f2-ae71-718e8c63a515 admin admin] PATH_INFO: `/v3/projects/ef23c93ed3e3457eab50e12c4260feaf` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:53.855854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f755a-5fd4-42f2-ae71-718e8c63a515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef23c93ed3e3457eab50e12c4260feaf)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:53.857875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f755a-5fd4-42f2-ae71-718e8c63a515 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:53.920558 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-648f755a-5fd4-42f2-ae71-718e8c63a515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef23c93ed3e3457eab50e12c4260feaf', 'request_id': 'req-648f755a-5fd4-42f2-ae71-718e8c63a515'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:53.930568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-648f755a-5fd4-42f2-ae71-718e8c63a515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef23c93ed3e3457eab50e12c4260feaf', 'request_id': 'req-648f755a-5fd4-42f2-ae71-718e8c63a515'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:53.938054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-648f755a-5fd4-42f2-ae71-718e8c63a515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef23c93ed3e3457eab50e12c4260feaf', 'request_id': 'req-648f755a-5fd4-42f2-ae71-718e8c63a515'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:53.954695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-648f755a-5fd4-42f2-ae71-718e8c63a515 admin admin] The token cache is being invalidate because project ef23c93ed3e3457eab50e12c4260feaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:40:53.955126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-648f755a-5fd4-42f2-ae71-718e8c63a515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:53.956015 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-648f755a-5fd4-42f2-ae71-718e8c63a515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:40:53.958098 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1298/2591] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:40:53 2022] DELETE /identity/v3/projects/ef23c93ed3e3457eab50e12c4260feaf => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:53.962963 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9a82b-c073-4e62-abb2-40ad74d38342 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:53.963264 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9a82b-c073-4e62-abb2-40ad74d38342 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:53.963573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9a82b-c073-4e62-abb2-40ad74d38342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:53.985514 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9bd9a82b-c073-4e62-abb2-40ad74d38342 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:53.985514 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9bd9a82b-c073-4e62-abb2-40ad74d38342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:54.061729 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1294/2592] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:54.064897 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd98b7-68fa-4d15-bad0-fce7abb485c9 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.065189 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd98b7-68fa-4d15-bad0-fce7abb485c9 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.066095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd98b7-68fa-4d15-bad0-fce7abb485c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.086911 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d6bd98b7-68fa-4d15-bad0-fce7abb485c9 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:54.088180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d6bd98b7-68fa-4d15-bad0-fce7abb485c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:54.098970 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1299/2593] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:54.103594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9a82b-c073-4e62-abb2-40ad74d38342 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:54.113996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9a82b-c073-4e62-abb2-40ad74d38342 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:54.120337 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e3b3e-55fe-4b3a-8e91-099ea48f7bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:54.121214 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e3b3e-55fe-4b3a-8e91-099ea48f7bff admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.121709 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e3b3e-55fe-4b3a-8e91-099ea48f7bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.122130 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e3b3e-55fe-4b3a-8e91-099ea48f7bff admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.123013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e3b3e-55fe-4b3a-8e91-099ea48f7bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:40:54.123491 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e3b3e-55fe-4b3a-8e91-099ea48f7bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:54.125740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e3b3e-55fe-4b3a-8e91-099ea48f7bff admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:54.139067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1295/2594] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:40:54.143698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd98b7-68fa-4d15-bad0-fce7abb485c9 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:54.154218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd98b7-68fa-4d15-bad0-fce7abb485c9 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:54.159213 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b21dd-51d9-4c02-9646-8dcfa25959f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:54.160114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b21dd-51d9-4c02-9646-8dcfa25959f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.160564 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b21dd-51d9-4c02-9646-8dcfa25959f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.160981 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b21dd-51d9-4c02-9646-8dcfa25959f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.161758 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b21dd-51d9-4c02-9646-8dcfa25959f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:54.163665 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b21dd-51d9-4c02-9646-8dcfa25959f8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:54.200861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1300/2595] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:40:54 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:40:54.205161 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e3b3e-55fe-4b3a-8e91-099ea48f7bff admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:54.216511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e3b3e-55fe-4b3a-8e91-099ea48f7bff admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:54.288475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fea61-e83d-4755-85ea-af3c914e7d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:54.289191 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fea61-e83d-4755-85ea-af3c914e7d62 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.289509 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fea61-e83d-4755-85ea-af3c914e7d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.289785 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fea61-e83d-4755-85ea-af3c914e7d62 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.290496 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fea61-e83d-4755-85ea-af3c914e7d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:54.293457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fea61-e83d-4755-85ea-af3c914e7d62 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:54.324368 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1296/2596] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:40:54 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:40:54.325708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b21dd-51d9-4c02-9646-8dcfa25959f8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:54.340923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b21dd-51d9-4c02-9646-8dcfa25959f8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:54.348945 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb66e84-a542-4962-873c-61f7811739fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:54.350320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb66e84-a542-4962-873c-61f7811739fc admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.350609 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb66e84-a542-4962-873c-61f7811739fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.350883 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb66e84-a542-4962-873c-61f7811739fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.351628 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb66e84-a542-4962-873c-61f7811739fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:54.353265 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb66e84-a542-4962-873c-61f7811739fc admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:54.369385 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1301/2597] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:54.370750 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fea61-e83d-4755-85ea-af3c914e7d62 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:54.383479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fea61-e83d-4755-85ea-af3c914e7d62 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:54.389060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e033b-9a82-41fc-abe5-4da97f97d2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:54.389793 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e033b-9a82-41fc-abe5-4da97f97d2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.390070 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e033b-9a82-41fc-abe5-4da97f97d2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.390364 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e033b-9a82-41fc-abe5-4da97f97d2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.391622 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e033b-9a82-41fc-abe5-4da97f97d2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:54.393309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e033b-9a82-41fc-abe5-4da97f97d2d3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:54.409170 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1297/2598] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:40:54.414099 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb66e84-a542-4962-873c-61f7811739fc admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:54.427841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb66e84-a542-4962-873c-61f7811739fc admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:54.433794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ef18e-1cc2-4ab6-a7c2-85fba1118e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:54.436317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ef18e-1cc2-4ab6-a7c2-85fba1118e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.436317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ef18e-1cc2-4ab6-a7c2-85fba1118e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.436317 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ef18e-1cc2-4ab6-a7c2-85fba1118e42 admin admin] PATH_INFO: `/v3/projects/5c7cdfbe4c724715a184f8856d05319d/users/0500f97ac6d34fb489a4e1702fdae9cd/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.457635 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ef18e-1cc2-4ab6-a7c2-85fba1118e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7cdfbe4c724715a184f8856d05319d, user_id=0500f97ac6d34fb489a4e1702fdae9cd, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:54.460370 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ef18e-1cc2-4ab6-a7c2-85fba1118e42 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:54.476016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1302/2599] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:40:54 2022] PUT /identity/v3/projects/5c7cdfbe4c724715a184f8856d05319d/users/0500f97ac6d34fb489a4e1702fdae9cd/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:40:54.481325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb326ff-f4da-48e9-b9a7-1527395ed0ef None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.482024 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb326ff-f4da-48e9-b9a7-1527395ed0ef None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.482211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb326ff-f4da-48e9-b9a7-1527395ed0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.506325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-fdb326ff-f4da-48e9-b9a7-1527395ed0ef None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:54.517401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-fdb326ff-f4da-48e9-b9a7-1527395ed0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:54.524091 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:54.587289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1298/2600] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:54.595095 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ef18e-1cc2-4ab6-a7c2-85fba1118e42 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:54.596890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6b0ef18e-1cc2-4ab6-a7c2-85fba1118e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:54.664384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:40:54.671086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ef18e-1cc2-4ab6-a7c2-85fba1118e42 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:40:54.676463 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a32888-e4c5-475c-831f-1289a2106df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:40:54.677321 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a32888-e4c5-475c-831f-1289a2106df6 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:54.677873 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a32888-e4c5-475c-831f-1289a2106df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:54.678310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a32888-e4c5-475c-831f-1289a2106df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:54.688787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a32888-e4c5-475c-831f-1289a2106df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:40:54.690859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a32888-e4c5-475c-831f-1289a2106df6 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:40:54.701180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1303/2601] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:40:59.818767 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40439f2c-61ae-4393-9126-6b5836bb769f None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:40:59.819253 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40439f2c-61ae-4393-9126-6b5836bb769f None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:40:59.819356 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40439f2c-61ae-4393-9126-6b5836bb769f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:40:59.846753 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-40439f2c-61ae-4393-9126-6b5836bb769f None None] MFA Rules not processed for user `0500f97ac6d34fb489a4e1702fdae9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:40:59.848048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-40439f2c-61ae-4393-9126-6b5836bb769f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:40:59.915170 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1299/2602] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:40:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:40:59.930076 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a32888-e4c5-475c-831f-1289a2106df6 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:40:59.931488 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b4a32888-e4c5-475c-831f-1289a2106df6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:00.005507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a32888-e4c5-475c-831f-1289a2106df6 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:00.011608 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffefe95-2d04-4bd4-894f-48e14b3979ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:00.012490 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefe95-2d04-4bd4-894f-48e14b3979ef service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:00.012893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefe95-2d04-4bd4-894f-48e14b3979ef service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:00.013182 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefe95-2d04-4bd4-894f-48e14b3979ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:00.021848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffefe95-2d04-4bd4-894f-48e14b3979ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:00.023482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffefe95-2d04-4bd4-894f-48e14b3979ef service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:00.032728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1304/2603] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:40:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:01.355911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61b669-b9f8-4a6e-86e4-c5641140c319 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:01.356884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61b669-b9f8-4a6e-86e4-c5641140c319 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:01.357596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61b669-b9f8-4a6e-86e4-c5641140c319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:01.382904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8c61b669-b9f8-4a6e-86e4-c5641140c319 None None] MFA Rules not processed for user `0500f97ac6d34fb489a4e1702fdae9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:01.385602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8c61b669-b9f8-4a6e-86e4-c5641140c319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:01.401559 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1300/2604] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:41:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:01.787969 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffefe95-2d04-4bd4-894f-48e14b3979ef service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:01.809158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffefe95-2d04-4bd4-894f-48e14b3979ef service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:01.814359 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98508b0-297d-4bec-868a-568199659aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:01.815442 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98508b0-297d-4bec-868a-568199659aad service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:01.816950 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98508b0-297d-4bec-868a-568199659aad service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:01.817651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98508b0-297d-4bec-868a-568199659aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:01.820884 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a98508b0-297d-4bec-868a-568199659aad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:01.834871 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98508b0-297d-4bec-868a-568199659aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:01.837049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98508b0-297d-4bec-868a-568199659aad service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:01.851295 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1305/2605] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:02.228061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61b669-b9f8-4a6e-86e4-c5641140c319 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:02.229725 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8c61b669-b9f8-4a6e-86e4-c5641140c319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:02.309215 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61b669-b9f8-4a6e-86e4-c5641140c319 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:02.314349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98d6ff-1140-4aa3-a97a-1731bc908d78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e6dd029a3d45f6aeb4da06db9753dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:02.315023 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98d6ff-1140-4aa3-a97a-1731bc908d78 service placement] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:02.315306 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98d6ff-1140-4aa3-a97a-1731bc908d78 service placement] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:02.315586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98d6ff-1140-4aa3-a97a-1731bc908d78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:02.317472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-db98d6ff-1140-4aa3-a97a-1731bc908d78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:02.329807 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98d6ff-1140-4aa3-a97a-1731bc908d78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:02.331340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98d6ff-1140-4aa3-a97a-1731bc908d78 service placement] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:02.342219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1301/2606] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:03.309504 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed1793-7f3b-4cb5-b799-70dbc9fe981c None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:03.310202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed1793-7f3b-4cb5-b799-70dbc9fe981c None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:03.310202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed1793-7f3b-4cb5-b799-70dbc9fe981c None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:03.313672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1306/2607] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 15 00:41:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:41:03.324443 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfce330-eb3b-4777-9879-ea62815fc513 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:03.324953 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfce330-eb3b-4777-9879-ea62815fc513 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:03.325060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfce330-eb3b-4777-9879-ea62815fc513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:03.375986 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-0dfce330-eb3b-4777-9879-ea62815fc513 None None] MFA Rules not processed for user `6d0ae1707c7041a0989889dbefeaf267`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:03.377262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-0dfce330-eb3b-4777-9879-ea62815fc513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:03.387489 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1302/2608] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 15 00:41:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:03.400565 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed1793-7f3b-4cb5-b799-70dbc9fe981c None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:03.402607 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-64ed1793-7f3b-4cb5-b799-70dbc9fe981c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:03.488374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed1793-7f3b-4cb5-b799-70dbc9fe981c None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:03.491906 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad5f5e-4343-4e1e-9b13-c66ca4ca360a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a239897b9a0644ef9d2e0e2e333232fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:03.492618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad5f5e-4343-4e1e-9b13-c66ca4ca360a service glance] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:03.492909 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad5f5e-4343-4e1e-9b13-c66ca4ca360a service glance] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:03.493190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad5f5e-4343-4e1e-9b13-c66ca4ca360a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:03.503322 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad5f5e-4343-4e1e-9b13-c66ca4ca360a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:03.504804 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad5f5e-4343-4e1e-9b13-c66ca4ca360a service glance] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:03.515919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1307/2609] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:03.601088 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db7a9b-e5bb-4429-aa6c-d9c81ae12b93 None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:03.601418 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db7a9b-e5bb-4429-aa6c-d9c81ae12b93 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:03.601710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db7a9b-e5bb-4429-aa6c-d9c81ae12b93 None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:03.603129 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1303/2610] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 15 00:41:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:41:03.609366 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89e5a0-e0ea-416b-ab08-fa058b91f524 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:03.609897 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89e5a0-e0ea-416b-ab08-fa058b91f524 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:03.610332 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89e5a0-e0ea-416b-ab08-fa058b91f524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:03.630414 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-1f89e5a0-e0ea-416b-ab08-fa058b91f524 None None] MFA Rules not processed for user `46c398ec4dcc438895f054f616fc9e41`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:03.631660 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1f89e5a0-e0ea-416b-ab08-fa058b91f524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:03.638934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1308/2611] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 15 00:41:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:03.651092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db7a9b-e5bb-4429-aa6c-d9c81ae12b93 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:03.664559 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db7a9b-e5bb-4429-aa6c-d9c81ae12b93 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:03.668699 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3f4f5-2690-4a25-8242-22d9e4361634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:03.669386 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3f4f5-2690-4a25-8242-22d9e4361634 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:03.669847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3f4f5-2690-4a25-8242-22d9e4361634 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:03.670134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3f4f5-2690-4a25-8242-22d9e4361634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:03.680326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3f4f5-2690-4a25-8242-22d9e4361634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:03.681899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3f4f5-2690-4a25-8242-22d9e4361634 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:03.686403 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:03.693059 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1304/2612] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:41:03.792322 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca956874-6710-4ba5-99f1-d13596b5d4df None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:03.792618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca956874-6710-4ba5-99f1-d13596b5d4df None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:03.792898 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca956874-6710-4ba5-99f1-d13596b5d4df None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:03.794359 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1309/2613] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 15 00:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:41:03.800258 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17450206-df09-4307-8f10-0d0d427a0270 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:03.800569 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17450206-df09-4307-8f10-0d0d427a0270 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:03.800847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17450206-df09-4307-8f10-0d0d427a0270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:03.819447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-17450206-df09-4307-8f10-0d0d427a0270 None None] MFA Rules not processed for user `6d0ae1707c7041a0989889dbefeaf267`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:03.820649 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-17450206-df09-4307-8f10-0d0d427a0270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:03.831915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1305/2614] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 15 00:41:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:41:03.842453 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca956874-6710-4ba5-99f1-d13596b5d4df None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:03.855719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca956874-6710-4ba5-99f1-d13596b5d4df None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:03.860020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c9edc-2a17-4452-9ac1-0be4da0e01bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:03.860787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c9edc-2a17-4452-9ac1-0be4da0e01bd service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:03.861075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c9edc-2a17-4452-9ac1-0be4da0e01bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:03.861375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c9edc-2a17-4452-9ac1-0be4da0e01bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:03.872641 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c9edc-2a17-4452-9ac1-0be4da0e01bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:03.874141 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c9edc-2a17-4452-9ac1-0be4da0e01bd service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:03.886270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1310/2615] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:07.533908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610329e4-d627-4cbb-a8ec-b2a84388565a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:07.534413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610329e4-d627-4cbb-a8ec-b2a84388565a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:07.534520 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610329e4-d627-4cbb-a8ec-b2a84388565a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:07.553442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-610329e4-d627-4cbb-a8ec-b2a84388565a None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:07.554640 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-610329e4-d627-4cbb-a8ec-b2a84388565a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:07.615598 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1306/2616] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 15 00:41:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:07.630014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c9edc-2a17-4452-9ac1-0be4da0e01bd service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:07.631583 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-046c9edc-2a17-4452-9ac1-0be4da0e01bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:07.659612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=100 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:07.701774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c9edc-2a17-4452-9ac1-0be4da0e01bd service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:07.707478 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92985e29-8b58-4246-bd7a-31f5ac4b1a33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:07.708121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92985e29-8b58-4246-bd7a-31f5ac4b1a33 service swift] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:07.708401 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92985e29-8b58-4246-bd7a-31f5ac4b1a33 service swift] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:07.708677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92985e29-8b58-4246-bd7a-31f5ac4b1a33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:07.716844 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92985e29-8b58-4246-bd7a-31f5ac4b1a33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:07.718455 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92985e29-8b58-4246-bd7a-31f5ac4b1a33 service swift] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:07.726611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1311/2617] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:41:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:41:17.608382 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=29 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:17.723340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=21 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:21.308694 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610329e4-d627-4cbb-a8ec-b2a84388565a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:21.310166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-610329e4-d627-4cbb-a8ec-b2a84388565a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:21.326875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610329e4-d627-4cbb-a8ec-b2a84388565a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:21.333311 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a24a6-dea5-41bf-b0af-cb90295543ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:21.334010 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a24a6-dea5-41bf-b0af-cb90295543ee service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:21.334281 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a24a6-dea5-41bf-b0af-cb90295543ee service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:21.334631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a24a6-dea5-41bf-b0af-cb90295543ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:21.336448 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e54a24a6-dea5-41bf-b0af-cb90295543ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:21.349084 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a24a6-dea5-41bf-b0af-cb90295543ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:21.351185 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a24a6-dea5-41bf-b0af-cb90295543ee service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:21.363238 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1307/2618] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:41:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:41:23.795401 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b67a7-3f82-4919-a46f-a0bf3d6333ff None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:23.795876 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b67a7-3f82-4919-a46f-a0bf3d6333ff None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:23.795989 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b67a7-3f82-4919-a46f-a0bf3d6333ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:23.814721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4c3b67a7-3f82-4919-a46f-a0bf3d6333ff None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:41:23.816007 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4c3b67a7-3f82-4919-a46f-a0bf3d6333ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:41:23.824597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1312/2619] 10.222.0.36 () {58 vars in 967 bytes} [Wed Jun 15 00:41:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:41:23.846724 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a24a6-dea5-41bf-b0af-cb90295543ee service nova] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:41:23.859254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a24a6-dea5-41bf-b0af-cb90295543ee service nova] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:41:23.869809 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20288dde-7e28-4626-8b66-67a16fe2fe62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:41:23.870477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20288dde-7e28-4626-8b66-67a16fe2fe62 service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:41:23.870766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20288dde-7e28-4626-8b66-67a16fe2fe62 service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:41:23.871045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20288dde-7e28-4626-8b66-67a16fe2fe62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:41:23.879740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20288dde-7e28-4626-8b66-67a16fe2fe62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:41:23.881316 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20288dde-7e28-4626-8b66-67a16fe2fe62 service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:41:23.889711 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1308/2620] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:41:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:41:33.809573 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:41:33.886301 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=12 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:03.467059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b67a7-3f82-4919-a46f-a0bf3d6333ff None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:03.483909 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b67a7-3f82-4919-a46f-a0bf3d6333ff None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:03.506810 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996769fd-6812-4059-ba9b-3e71d25c36c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:03.508805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996769fd-6812-4059-ba9b-3e71d25c36c8 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:03.510471 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996769fd-6812-4059-ba9b-3e71d25c36c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:03.511178 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996769fd-6812-4059-ba9b-3e71d25c36c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:03.515121 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-996769fd-6812-4059-ba9b-3e71d25c36c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:03.538475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996769fd-6812-4059-ba9b-3e71d25c36c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:03.540380 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996769fd-6812-4059-ba9b-3e71d25c36c8 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:03.565698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1313/2621] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:04.463389 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627268e-177e-4a67-8cce-e16d9be81eca None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:04.463985 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627268e-177e-4a67-8cce-e16d9be81eca None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:04.464235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2627268e-177e-4a67-8cce-e16d9be81eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:04.484335 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2627268e-177e-4a67-8cce-e16d9be81eca None None] MFA Rules not processed for user `0500f97ac6d34fb489a4e1702fdae9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:04.485713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2627268e-177e-4a67-8cce-e16d9be81eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:04.493266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1309/2622] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:42:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:04.801179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996769fd-6812-4059-ba9b-3e71d25c36c8 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:42:04.802816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-996769fd-6812-4059-ba9b-3e71d25c36c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:04.817147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996769fd-6812-4059-ba9b-3e71d25c36c8 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:42:04.822403 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586c99a-68fb-4d57-847d-b6eae009f097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:42:04.823329 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c99a-68fb-4d57-847d-b6eae009f097 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:04.823614 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c99a-68fb-4d57-847d-b6eae009f097 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:04.823885 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c99a-68fb-4d57-847d-b6eae009f097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:04.825978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0586c99a-68fb-4d57-847d-b6eae009f097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:04.840516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586c99a-68fb-4d57-847d-b6eae009f097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:42:04.842069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0586c99a-68fb-4d57-847d-b6eae009f097 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:42:04.856538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1314/2623] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:42:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:42:07.228914 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f51e9-f0d6-49ca-a044-c829200549e1 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:42:07.229496 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f51e9-f0d6-49ca-a044-c829200549e1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:42:07.229603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f51e9-f0d6-49ca-a044-c829200549e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:42:07.255185 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-868f51e9-f0d6-49ca-a044-c829200549e1 None None] MFA Rules not processed for user `b68e09c886b540f2940af15c10fd28c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:42:07.256411 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-868f51e9-f0d6-49ca-a044-c829200549e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:42:07.317378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1310/2624] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:42:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:42:14.848781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=12 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:42:17.310930 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=28 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:06.861513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f33d40-3454-4248-b1aa-b4e6ffc34964 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:06.862050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f33d40-3454-4248-b1aa-b4e6ffc34964 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:06.862150 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f33d40-3454-4248-b1aa-b4e6ffc34964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:06.879644 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-10f33d40-3454-4248-b1aa-b4e6ffc34964 None None] MFA Rules not processed for user `0500f97ac6d34fb489a4e1702fdae9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:43:06.880843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-10f33d40-3454-4248-b1aa-b4e6ffc34964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:06.887702 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1315/2625] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:43:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:43:07.978976 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f51e9-f0d6-49ca-a044-c829200549e1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:07.991682 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f51e9-f0d6-49ca-a044-c829200549e1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:07.997281 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8a16-718c-473a-bba8-8c1f60944213 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e6dd029a3d45f6aeb4da06db9753dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:07.998299 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8a16-718c-473a-bba8-8c1f60944213 service placement] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:07.998581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8a16-718c-473a-bba8-8c1f60944213 service placement] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:07.998859 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8a16-718c-473a-bba8-8c1f60944213 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:08.000721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-104e8a16-718c-473a-bba8-8c1f60944213 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:08.013261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e8a16-718c-473a-bba8-8c1f60944213 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:08.014893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e8a16-718c-473a-bba8-8c1f60944213 service placement] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:08.025376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1311/2626] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:43:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:43:16.875373 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:18.021033 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=6 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:18.321158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e742c67-16d2-4ee0-aa43-0b52b4c90989 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:18.321678 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e742c67-16d2-4ee0-aa43-0b52b4c90989 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:18.321778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e742c67-16d2-4ee0-aa43-0b52b4c90989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:18.339197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-9e742c67-16d2-4ee0-aa43-0b52b4c90989 None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:43:18.340376 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9e742c67-16d2-4ee0-aa43-0b52b4c90989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:18.347665 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1316/2627] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 15 00:43:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:43:18.395233 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8a16-718c-473a-bba8-8c1f60944213 service placement] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:18.407015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8a16-718c-473a-bba8-8c1f60944213 service placement] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:18.412360 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508790a-82ed-4c14-bf50-b923f9680323 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:18.413002 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508790a-82ed-4c14-bf50-b923f9680323 service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:18.413289 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508790a-82ed-4c14-bf50-b923f9680323 service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:18.413603 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508790a-82ed-4c14-bf50-b923f9680323 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:18.422138 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508790a-82ed-4c14-bf50-b923f9680323 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:18.423729 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508790a-82ed-4c14-bf50-b923f9680323 service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:18.432320 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1312/2628] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:43:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:43:28.334181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:28.428811 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=6 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:34.113900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ea5ab-e037-4e11-bff3-4df32bfc2ca7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:34.114400 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ea5ab-e037-4e11-bff3-4df32bfc2ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:34.114521 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ea5ab-e037-4e11-bff3-4df32bfc2ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:34.141119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-748ea5ab-e037-4e11-bff3-4df32bfc2ca7 None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:43:34.143019 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-748ea5ab-e037-4e11-bff3-4df32bfc2ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:34.152332 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1317/2629] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Jun 15 00:43:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:43:34.164345 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508790a-82ed-4c14-bf50-b923f9680323 service swift] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:34.175711 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508790a-82ed-4c14-bf50-b923f9680323 service swift] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:34.181541 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f7720-193c-4148-aab8-032654c359b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:34.182184 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f7720-193c-4148-aab8-032654c359b5 service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:34.182474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f7720-193c-4148-aab8-032654c359b5 service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:34.182747 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f7720-193c-4148-aab8-032654c359b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:34.192005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f7720-193c-4148-aab8-032654c359b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:34.193765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f7720-193c-4148-aab8-032654c359b5 service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:34.202506 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1313/2630] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:43:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:43:44.132891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:44.199160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=6 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:47.428180 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612779-4364-4de0-a696-1c3387542a34 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:47.428680 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612779-4364-4de0-a696-1c3387542a34 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:47.428806 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612779-4364-4de0-a696-1c3387542a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:47.447241 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-97612779-4364-4de0-a696-1c3387542a34 None None] MFA Rules not processed for user `54123f8a9de7428bb7e34557aea23ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:43:47.448442 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-97612779-4364-4de0-a696-1c3387542a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:43:47.455812 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1318/2631] 10.222.0.36 () {58 vars in 967 bytes} [Wed Jun 15 00:43:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:43:47.468031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f7720-193c-4148-aab8-032654c359b5 service swift] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:43:47.479218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f7720-193c-4148-aab8-032654c359b5 service swift] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:43:47.484305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca4e50-f386-4153-bb55-991d9ff4ebd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff27c57c1d1b4f4ab1a030995db2e63a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:43:47.484970 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca4e50-f386-4153-bb55-991d9ff4ebd8 service swift] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:43:47.485258 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca4e50-f386-4153-bb55-991d9ff4ebd8 service swift] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:43:47.485553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca4e50-f386-4153-bb55-991d9ff4ebd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:43:47.494095 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca4e50-f386-4153-bb55-991d9ff4ebd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:43:47.495684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca4e50-f386-4153-bb55-991d9ff4ebd8 service swift] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:43:47.503915 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1314/2632] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Jun 15 00:43:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 15 00:43:57.442218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:43:57.500733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=6 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:07.929086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a4fea-cb8d-4b7b-ad46-a1261197440d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:07.929545 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a4fea-cb8d-4b7b-ad46-a1261197440d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:07.929545 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a4fea-cb8d-4b7b-ad46-a1261197440d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:07.953824 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-408a4fea-cb8d-4b7b-ad46-a1261197440d None None] MFA Rules not processed for user `0500f97ac6d34fb489a4e1702fdae9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:44:07.955051 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-408a4fea-cb8d-4b7b-ad46-a1261197440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:07.963959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1319/2633] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:44:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:44:17.944277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:32.161509 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca4e50-f386-4153-bb55-991d9ff4ebd8 service swift] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:32.162984 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9fca4e50-f386-4153-bb55-991d9ff4ebd8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:32.178200 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca4e50-f386-4153-bb55-991d9ff4ebd8 service swift] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:32.184182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992a2c7-d023-4585-962c-75a3b6131cbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e6dd029a3d45f6aeb4da06db9753dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:32.185111 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992a2c7-d023-4585-962c-75a3b6131cbf service placement] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:32.185591 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992a2c7-d023-4585-962c-75a3b6131cbf service placement] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:32.186031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992a2c7-d023-4585-962c-75a3b6131cbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:32.188198 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b992a2c7-d023-4585-962c-75a3b6131cbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:32.201984 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992a2c7-d023-4585-962c-75a3b6131cbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:32.203936 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992a2c7-d023-4585-962c-75a3b6131cbf service placement] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:32.215815 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1315/2634] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:44:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:44:32.227907 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a4fea-cb8d-4b7b-ad46-a1261197440d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:32.229795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-408a4fea-cb8d-4b7b-ad46-a1261197440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:32.245158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a4fea-cb8d-4b7b-ad46-a1261197440d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:32.250271 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a436f6-09a6-4aa1-b12d-789403f1dabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:32.251474 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a436f6-09a6-4aa1-b12d-789403f1dabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:32.251820 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a436f6-09a6-4aa1-b12d-789403f1dabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:32.252158 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a436f6-09a6-4aa1-b12d-789403f1dabb admin admin] PATH_INFO: `/v3/users/b68e09c886b540f2940af15c10fd28c9` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:32.253596 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a436f6-09a6-4aa1-b12d-789403f1dabb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68e09c886b540f2940af15c10fd28c9)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:32.255599 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a436f6-09a6-4aa1-b12d-789403f1dabb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:32.310105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e9a436f6-09a6-4aa1-b12d-789403f1dabb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68e09c886b540f2940af15c10fd28c9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:32.319899 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e9a436f6-09a6-4aa1-b12d-789403f1dabb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68e09c886b540f2940af15c10fd28c9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:32.320932 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e9a436f6-09a6-4aa1-b12d-789403f1dabb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68e09c886b540f2940af15c10fd28c9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:32.321913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e9a436f6-09a6-4aa1-b12d-789403f1dabb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68e09c886b540f2940af15c10fd28c9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:32.338338 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-e9a436f6-09a6-4aa1-b12d-789403f1dabb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68e09c886b540f2940af15c10fd28c9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:32.351302 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1320/2635] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:44:32 2022] DELETE /identity/v3/users/b68e09c886b540f2940af15c10fd28c9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:44:32.554967 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992a2c7-d023-4585-962c-75a3b6131cbf service placement] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:32.576062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992a2c7-d023-4585-962c-75a3b6131cbf service placement] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:32.643077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bb52b-482c-403a-8bea-4bfcf2f1d85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:32.644010 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bb52b-482c-403a-8bea-4bfcf2f1d85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:32.644292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bb52b-482c-403a-8bea-4bfcf2f1d85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:32.644569 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bb52b-482c-403a-8bea-4bfcf2f1d85a admin admin] PATH_INFO: `/v3/projects/9f07873934b14857900273fa86646e8b` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:32.645877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bb52b-482c-403a-8bea-4bfcf2f1d85a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f07873934b14857900273fa86646e8b)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:32.648664 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bb52b-482c-403a-8bea-4bfcf2f1d85a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:32.702058 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bf4bb52b-482c-403a-8bea-4bfcf2f1d85a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f07873934b14857900273fa86646e8b', 'request_id': 'req-bf4bb52b-482c-403a-8bea-4bfcf2f1d85a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:32.708074 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bf4bb52b-482c-403a-8bea-4bfcf2f1d85a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f07873934b14857900273fa86646e8b', 'request_id': 'req-bf4bb52b-482c-403a-8bea-4bfcf2f1d85a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:32.714756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bf4bb52b-482c-403a-8bea-4bfcf2f1d85a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f07873934b14857900273fa86646e8b', 'request_id': 'req-bf4bb52b-482c-403a-8bea-4bfcf2f1d85a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:32.730691 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bf4bb52b-482c-403a-8bea-4bfcf2f1d85a admin admin] The token cache is being invalidate because project 9f07873934b14857900273fa86646e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:44:32.730981 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bf4bb52b-482c-403a-8bea-4bfcf2f1d85a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:32.731612 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bf4bb52b-482c-403a-8bea-4bfcf2f1d85a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:32.733325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1316/2636] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:44:32 2022] DELETE /identity/v3/projects/9f07873934b14857900273fa86646e8b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:44:32.738475 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f647d07-a6a1-4b06-9f99-34c13d15a640 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:32.738777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f647d07-a6a1-4b06-9f99-34c13d15a640 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:32.739074 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f647d07-a6a1-4b06-9f99-34c13d15a640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:32.759027 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8f647d07-a6a1-4b06-9f99-34c13d15a640 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:44:32.760268 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8f647d07-a6a1-4b06-9f99-34c13d15a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:32.830659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1321/2637] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:44:32.838998 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442521f7-2d13-458c-9e19-c442793c0a2d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:32.839288 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442521f7-2d13-458c-9e19-c442793c0a2d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:32.839565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442521f7-2d13-458c-9e19-c442793c0a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:32.860057 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-442521f7-2d13-458c-9e19-c442793c0a2d None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:44:32.861283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-442521f7-2d13-458c-9e19-c442793c0a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:32.871503 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1317/2638] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:44:32.876343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f647d07-a6a1-4b06-9f99-34c13d15a640 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:32.890236 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f647d07-a6a1-4b06-9f99-34c13d15a640 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:32.896269 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2737b-d50a-4a7e-a5c5-3261779424c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:32.896941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2737b-d50a-4a7e-a5c5-3261779424c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:32.897229 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2737b-d50a-4a7e-a5c5-3261779424c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:32.897618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2737b-d50a-4a7e-a5c5-3261779424c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:32.898372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2737b-d50a-4a7e-a5c5-3261779424c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:44:32.898881 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2737b-d50a-4a7e-a5c5-3261779424c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:32.900283 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2737b-d50a-4a7e-a5c5-3261779424c5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:32.913073 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1322/2639] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:44:32.917734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442521f7-2d13-458c-9e19-c442793c0a2d None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:32.927538 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442521f7-2d13-458c-9e19-c442793c0a2d None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:32.933580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b43dc-5a3f-4413-bad4-53c7c7fcf781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:32.934266 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b43dc-5a3f-4413-bad4-53c7c7fcf781 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:32.934559 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b43dc-5a3f-4413-bad4-53c7c7fcf781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:32.934868 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b43dc-5a3f-4413-bad4-53c7c7fcf781 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:32.935618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b43dc-5a3f-4413-bad4-53c7c7fcf781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:32.938122 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b43dc-5a3f-4413-bad4-53c7c7fcf781 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:32.979153 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1318/2640] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:44:32 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:44:32.983276 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2737b-d50a-4a7e-a5c5-3261779424c5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:32.994186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2737b-d50a-4a7e-a5c5-3261779424c5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:33.056719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c34dc-402c-44c9-aa5e-467a94372cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:33.057437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c34dc-402c-44c9-aa5e-467a94372cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:33.057741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c34dc-402c-44c9-aa5e-467a94372cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:33.058009 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c34dc-402c-44c9-aa5e-467a94372cd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:33.058735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c34dc-402c-44c9-aa5e-467a94372cd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:33.060654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c34dc-402c-44c9-aa5e-467a94372cd5 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:33.067598 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:33.086226 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1323/2641] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:44:32 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:44:33.087359 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b43dc-5a3f-4413-bad4-53c7c7fcf781 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:33.098642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b43dc-5a3f-4413-bad4-53c7c7fcf781 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:33.103899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1be76-31cf-40ae-b906-368ecdc61888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:33.104560 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1be76-31cf-40ae-b906-368ecdc61888 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:33.104864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1be76-31cf-40ae-b906-368ecdc61888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:33.105144 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1be76-31cf-40ae-b906-368ecdc61888 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:33.105954 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1be76-31cf-40ae-b906-368ecdc61888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:33.107552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad1be76-31cf-40ae-b906-368ecdc61888 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:33.117963 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1319/2642] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:44:33.122209 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c34dc-402c-44c9-aa5e-467a94372cd5 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:33.132689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c34dc-402c-44c9-aa5e-467a94372cd5 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:33.137911 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea2a10-c565-4e1f-8dda-28551074aaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:33.138565 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea2a10-c565-4e1f-8dda-28551074aaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:33.138846 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea2a10-c565-4e1f-8dda-28551074aaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:33.139105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea2a10-c565-4e1f-8dda-28551074aaf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:33.139823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea2a10-c565-4e1f-8dda-28551074aaf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:33.141592 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea2a10-c565-4e1f-8dda-28551074aaf2 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:33.151511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1324/2643] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:44:33.155584 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1be76-31cf-40ae-b906-368ecdc61888 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:33.167553 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1be76-31cf-40ae-b906-368ecdc61888 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:33.175988 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad615e26-4c67-4f57-96f2-f16dec1a3702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:33.177316 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad615e26-4c67-4f57-96f2-f16dec1a3702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:33.177646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad615e26-4c67-4f57-96f2-f16dec1a3702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:33.177967 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad615e26-4c67-4f57-96f2-f16dec1a3702 admin admin] PATH_INFO: `/v3/projects/bc615b0a9d7343acae36c6c85cbc20cf/users/d9813b778f8e4a4fb6d78c2716efd767/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:33.197496 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad615e26-4c67-4f57-96f2-f16dec1a3702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc615b0a9d7343acae36c6c85cbc20cf, user_id=d9813b778f8e4a4fb6d78c2716efd767, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:33.200159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad615e26-4c67-4f57-96f2-f16dec1a3702 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:33.215036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1320/2644] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:44:33 2022] PUT /identity/v3/projects/bc615b0a9d7343acae36c6c85cbc20cf/users/d9813b778f8e4a4fb6d78c2716efd767/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:44:33.226661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ee204-f202-4f4a-ac0d-5be938ec98f8 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:33.226969 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ee204-f202-4f4a-ac0d-5be938ec98f8 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:33.227237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ee204-f202-4f4a-ac0d-5be938ec98f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:33.256327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-934ee204-f202-4f4a-ac0d-5be938ec98f8 None None] MFA Rules not processed for user `d9813b778f8e4a4fb6d78c2716efd767`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:44:33.257496 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-934ee204-f202-4f4a-ac0d-5be938ec98f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:33.326277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1325/2645] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:44:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:44:33.341848 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad615e26-4c67-4f57-96f2-f16dec1a3702 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:33.344252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ad615e26-4c67-4f57-96f2-f16dec1a3702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:33.352433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:33.424657 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad615e26-4c67-4f57-96f2-f16dec1a3702 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:33.430902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d025cc-ab7f-46ae-b60c-a9daa5a0fbca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:33.431558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d025cc-ab7f-46ae-b60c-a9daa5a0fbca service nova] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:33.431850 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d025cc-ab7f-46ae-b60c-a9daa5a0fbca service nova] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:33.432137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d025cc-ab7f-46ae-b60c-a9daa5a0fbca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:33.440223 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d025cc-ab7f-46ae-b60c-a9daa5a0fbca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:33.441872 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d025cc-ab7f-46ae-b60c-a9daa5a0fbca service nova] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:33.450905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1321/2646] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:44:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:44:36.192828 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ee204-f202-4f4a-ac0d-5be938ec98f8 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:36.263599 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ee204-f202-4f4a-ac0d-5be938ec98f8 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:36.268805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7147d6-432a-42ca-96a5-ed7fc6ac203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:36.269718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7147d6-432a-42ca-96a5-ed7fc6ac203e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:36.270026 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7147d6-432a-42ca-96a5-ed7fc6ac203e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:36.270276 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7147d6-432a-42ca-96a5-ed7fc6ac203e admin admin] PATH_INFO: `/v3/users/d9813b778f8e4a4fb6d78c2716efd767` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:36.271539 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7147d6-432a-42ca-96a5-ed7fc6ac203e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9813b778f8e4a4fb6d78c2716efd767)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:36.273505 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7147d6-432a-42ca-96a5-ed7fc6ac203e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:36.324713 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3c7147d6-432a-42ca-96a5-ed7fc6ac203e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9813b778f8e4a4fb6d78c2716efd767'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:36.335751 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3c7147d6-432a-42ca-96a5-ed7fc6ac203e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9813b778f8e4a4fb6d78c2716efd767'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:36.336380 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3c7147d6-432a-42ca-96a5-ed7fc6ac203e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9813b778f8e4a4fb6d78c2716efd767'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:36.337162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3c7147d6-432a-42ca-96a5-ed7fc6ac203e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9813b778f8e4a4fb6d78c2716efd767'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:36.356274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:36.358886 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-3c7147d6-432a-42ca-96a5-ed7fc6ac203e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9813b778f8e4a4fb6d78c2716efd767'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:36.377935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1326/2647] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:44:36 2022] DELETE /identity/v3/users/d9813b778f8e4a4fb6d78c2716efd767 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:44:36.382623 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6c06e-178c-4de3-a666-5f868494d244 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:36.383108 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6c06e-178c-4de3-a666-5f868494d244 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:36.383242 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6c06e-178c-4de3-a666-5f868494d244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:36.401528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-63d6c06e-178c-4de3-a666-5f868494d244 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:44:36.402734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-63d6c06e-178c-4de3-a666-5f868494d244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:36.462754 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1322/2648] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:44:36.476591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7147d6-432a-42ca-96a5-ed7fc6ac203e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:36.479090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3c7147d6-432a-42ca-96a5-ed7fc6ac203e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:36.542224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7147d6-432a-42ca-96a5-ed7fc6ac203e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:36.546910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba66fc6-bb0e-4e19-a886-25a27728f1cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:36.547569 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba66fc6-bb0e-4e19-a886-25a27728f1cb service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:36.547857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba66fc6-bb0e-4e19-a886-25a27728f1cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:36.548132 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba66fc6-bb0e-4e19-a886-25a27728f1cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:36.558280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba66fc6-bb0e-4e19-a886-25a27728f1cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:36.559716 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba66fc6-bb0e-4e19-a886-25a27728f1cb service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:36.569259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1327/2649] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:44:36.845514 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6c06e-178c-4de3-a666-5f868494d244 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:36.847347 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-63d6c06e-178c-4de3-a666-5f868494d244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:36.859099 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6c06e-178c-4de3-a666-5f868494d244 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:36.864108 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577e2e3-3b7b-4017-be2d-8c65435945a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:36.864999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577e2e3-3b7b-4017-be2d-8c65435945a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:36.865283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577e2e3-3b7b-4017-be2d-8c65435945a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:36.865626 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577e2e3-3b7b-4017-be2d-8c65435945a2 admin admin] PATH_INFO: `/v3/projects/bc615b0a9d7343acae36c6c85cbc20cf` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:36.866900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577e2e3-3b7b-4017-be2d-8c65435945a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc615b0a9d7343acae36c6c85cbc20cf)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:36.868814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577e2e3-3b7b-4017-be2d-8c65435945a2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:36.918719 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4577e2e3-3b7b-4017-be2d-8c65435945a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc615b0a9d7343acae36c6c85cbc20cf', 'request_id': 'req-4577e2e3-3b7b-4017-be2d-8c65435945a2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:36.924067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4577e2e3-3b7b-4017-be2d-8c65435945a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc615b0a9d7343acae36c6c85cbc20cf', 'request_id': 'req-4577e2e3-3b7b-4017-be2d-8c65435945a2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:36.930152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4577e2e3-3b7b-4017-be2d-8c65435945a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc615b0a9d7343acae36c6c85cbc20cf', 'request_id': 'req-4577e2e3-3b7b-4017-be2d-8c65435945a2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:36.944168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4577e2e3-3b7b-4017-be2d-8c65435945a2 admin admin] The token cache is being invalidate because project bc615b0a9d7343acae36c6c85cbc20cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:44:36.944463 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4577e2e3-3b7b-4017-be2d-8c65435945a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:36.945078 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-4577e2e3-3b7b-4017-be2d-8c65435945a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:44:36.946631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1323/2650] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:44:36 2022] DELETE /identity/v3/projects/bc615b0a9d7343acae36c6c85cbc20cf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:44:36.951978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd985b3f-3877-440d-b342-b206b0083ec4 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:36.952274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd985b3f-3877-440d-b342-b206b0083ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:36.952543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd985b3f-3877-440d-b342-b206b0083ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:36.970550 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-dd985b3f-3877-440d-b342-b206b0083ec4 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:44:36.971810 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-dd985b3f-3877-440d-b342-b206b0083ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:37.036717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1328/2651] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:44:37.045728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e913e-7801-4452-80d6-0fd1b34da6c9 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:37.046028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e913e-7801-4452-80d6-0fd1b34da6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:37.046303 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e913e-7801-4452-80d6-0fd1b34da6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:37.065772 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-ce7e913e-7801-4452-80d6-0fd1b34da6c9 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:44:37.068414 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-ce7e913e-7801-4452-80d6-0fd1b34da6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:37.077372 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1324/2652] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:44:37.081950 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd985b3f-3877-440d-b342-b206b0083ec4 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:37.092385 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd985b3f-3877-440d-b342-b206b0083ec4 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:37.098238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184223af-84f9-411d-9e54-09de22414a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:37.099016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184223af-84f9-411d-9e54-09de22414a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:37.099284 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184223af-84f9-411d-9e54-09de22414a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:37.099598 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184223af-84f9-411d-9e54-09de22414a49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:37.100401 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184223af-84f9-411d-9e54-09de22414a49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:44:37.100708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184223af-84f9-411d-9e54-09de22414a49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:37.102444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184223af-84f9-411d-9e54-09de22414a49 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:37.114071 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1329/2653] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:44:37.118520 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e913e-7801-4452-80d6-0fd1b34da6c9 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:37.128528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e913e-7801-4452-80d6-0fd1b34da6c9 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:37.134084 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc324882-573c-4e2d-b899-349cb0464d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:37.134742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc324882-573c-4e2d-b899-349cb0464d72 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:37.135025 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc324882-573c-4e2d-b899-349cb0464d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:37.135304 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc324882-573c-4e2d-b899-349cb0464d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:37.136016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc324882-573c-4e2d-b899-349cb0464d72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:37.137958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc324882-573c-4e2d-b899-349cb0464d72 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:37.141388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:37.171351 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1325/2654] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:44:37 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:44:37.172602 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184223af-84f9-411d-9e54-09de22414a49 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:37.182802 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184223af-84f9-411d-9e54-09de22414a49 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:37.242488 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bc1c9-fd88-4c1b-839c-ce694b5bbd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:37.243157 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bc1c9-fd88-4c1b-839c-ce694b5bbd2d admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:37.243414 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bc1c9-fd88-4c1b-839c-ce694b5bbd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:37.243697 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bc1c9-fd88-4c1b-839c-ce694b5bbd2d admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:37.244395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bc1c9-fd88-4c1b-839c-ce694b5bbd2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:37.246385 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bc1c9-fd88-4c1b-839c-ce694b5bbd2d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:37.268931 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1330/2655] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:44:37 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:44:37.273439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc324882-573c-4e2d-b899-349cb0464d72 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:37.283947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc324882-573c-4e2d-b899-349cb0464d72 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:37.289137 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895c3df-7932-40f6-9d2d-cd4c09d9f9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:37.289865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895c3df-7932-40f6-9d2d-cd4c09d9f9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:37.290154 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895c3df-7932-40f6-9d2d-cd4c09d9f9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:37.290436 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895c3df-7932-40f6-9d2d-cd4c09d9f9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:37.291225 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895c3df-7932-40f6-9d2d-cd4c09d9f9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:37.292897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895c3df-7932-40f6-9d2d-cd4c09d9f9d1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:37.303479 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1326/2656] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:44:37.307277 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bc1c9-fd88-4c1b-839c-ce694b5bbd2d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:37.317087 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bc1c9-fd88-4c1b-839c-ce694b5bbd2d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:37.322137 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67acf9-4b2b-425d-8da3-75f0e4cbbef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:37.322782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67acf9-4b2b-425d-8da3-75f0e4cbbef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:37.323062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67acf9-4b2b-425d-8da3-75f0e4cbbef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:37.323335 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67acf9-4b2b-425d-8da3-75f0e4cbbef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:37.324069 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67acf9-4b2b-425d-8da3-75f0e4cbbef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:37.325701 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67acf9-4b2b-425d-8da3-75f0e4cbbef0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:37.326992 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:37.337427 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1331/2657] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:44:37.341574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895c3df-7932-40f6-9d2d-cd4c09d9f9d1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:37.352246 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895c3df-7932-40f6-9d2d-cd4c09d9f9d1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:37.357602 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0f108-b440-42f2-af71-eef07899e811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:37.358485 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0f108-b440-42f2-af71-eef07899e811 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:37.358767 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0f108-b440-42f2-af71-eef07899e811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:37.359069 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0f108-b440-42f2-af71-eef07899e811 admin admin] PATH_INFO: `/v3/projects/ce2e378248d741c08c1e4e75043cec7a/users/bc6d7ad170cf475b9f47321369b3bed5/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:37.374766 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0f108-b440-42f2-af71-eef07899e811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce2e378248d741c08c1e4e75043cec7a, user_id=bc6d7ad170cf475b9f47321369b3bed5, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:37.377578 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0f108-b440-42f2-af71-eef07899e811 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:37.391742 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1327/2658] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:44:37 2022] PUT /identity/v3/projects/ce2e378248d741c08c1e4e75043cec7a/users/bc6d7ad170cf475b9f47321369b3bed5/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:44:37.402527 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bbfa8-b4dc-4f97-b0dd-d4ab2e7a6254 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:37.402815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bbfa8-b4dc-4f97-b0dd-d4ab2e7a6254 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:37.403094 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bbfa8-b4dc-4f97-b0dd-d4ab2e7a6254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:37.430369 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2f8bbfa8-b4dc-4f97-b0dd-d4ab2e7a6254 None None] MFA Rules not processed for user `bc6d7ad170cf475b9f47321369b3bed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:44:37.431581 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2f8bbfa8-b4dc-4f97-b0dd-d4ab2e7a6254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:37.495905 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1332/2659] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:44:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:44:37.500439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0f108-b440-42f2-af71-eef07899e811 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:37.564893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0f108-b440-42f2-af71-eef07899e811 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:37.570495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc56497-5d87-401b-8768-60caaee0bd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:37.571175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc56497-5d87-401b-8768-60caaee0bd77 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:37.571467 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc56497-5d87-401b-8768-60caaee0bd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:37.571760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc56497-5d87-401b-8768-60caaee0bd77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:37.572453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc56497-5d87-401b-8768-60caaee0bd77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:37.574396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc56497-5d87-401b-8768-60caaee0bd77 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:37.603357 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1328/2660] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:44:37 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:44:37.607380 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bbfa8-b4dc-4f97-b0dd-d4ab2e7a6254 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:37.618799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bbfa8-b4dc-4f97-b0dd-d4ab2e7a6254 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:37.677338 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdabbf-20e1-4510-9ba0-7b1357e72a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:37.678070 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdabbf-20e1-4510-9ba0-7b1357e72a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:37.678348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdabbf-20e1-4510-9ba0-7b1357e72a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:37.678621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdabbf-20e1-4510-9ba0-7b1357e72a83 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:37.679310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdabbf-20e1-4510-9ba0-7b1357e72a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:37.681240 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fdabbf-20e1-4510-9ba0-7b1357e72a83 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:37.701822 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1333/2661] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:44:37 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:44:37.706174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc56497-5d87-401b-8768-60caaee0bd77 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:37.716839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc56497-5d87-401b-8768-60caaee0bd77 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:37.722658 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90131b6a-f495-4797-9297-5914a455bc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:37.723327 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90131b6a-f495-4797-9297-5914a455bc95 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:37.723616 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90131b6a-f495-4797-9297-5914a455bc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:37.723899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90131b6a-f495-4797-9297-5914a455bc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:37.724648 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90131b6a-f495-4797-9297-5914a455bc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:37.726293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90131b6a-f495-4797-9297-5914a455bc95 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:37.737138 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1329/2662] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:44:37.741394 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdabbf-20e1-4510-9ba0-7b1357e72a83 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:37.751725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdabbf-20e1-4510-9ba0-7b1357e72a83 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:37.757415 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2faf2-8f9c-459f-805c-d3e1968c7155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:37.758344 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2faf2-8f9c-459f-805c-d3e1968c7155 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:37.758642 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2faf2-8f9c-459f-805c-d3e1968c7155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:37.758926 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2faf2-8f9c-459f-805c-d3e1968c7155 admin admin] PATH_INFO: `/v3/projects/05bbc5416f6d49b1b2ae3ca6466a308c/users/018eb43549774ff1b0d02fa991309899/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:37.775111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2faf2-8f9c-459f-805c-d3e1968c7155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bbc5416f6d49b1b2ae3ca6466a308c, user_id=018eb43549774ff1b0d02fa991309899, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:37.777830 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2faf2-8f9c-459f-805c-d3e1968c7155 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:37.793516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1334/2663] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:44:37 2022] PUT /identity/v3/projects/05bbc5416f6d49b1b2ae3ca6466a308c/users/018eb43549774ff1b0d02fa991309899/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:44:37.797584 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90131b6a-f495-4797-9297-5914a455bc95 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:37.807818 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90131b6a-f495-4797-9297-5914a455bc95 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:37.866032 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f5f10-8f1e-446d-bdea-65985c319035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:37.866644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f5f10-8f1e-446d-bdea-65985c319035 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:37.866927 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f5f10-8f1e-446d-bdea-65985c319035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:37.867199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f5f10-8f1e-446d-bdea-65985c319035 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:37.867933 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f5f10-8f1e-446d-bdea-65985c319035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:37.869576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f5f10-8f1e-446d-bdea-65985c319035 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:37.879853 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1330/2664] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:44:37.884503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2faf2-8f9c-459f-805c-d3e1968c7155 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:37.895623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2faf2-8f9c-459f-805c-d3e1968c7155 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:37.900619 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e103313-d731-4de5-933a-9f650ef24a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:37.901557 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e103313-d731-4de5-933a-9f650ef24a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:37.901834 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e103313-d731-4de5-933a-9f650ef24a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:37.902107 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e103313-d731-4de5-933a-9f650ef24a85 admin admin] PATH_INFO: `/v3/projects/05bbc5416f6d49b1b2ae3ca6466a308c/users/018eb43549774ff1b0d02fa991309899/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:37.904128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e103313-d731-4de5-933a-9f650ef24a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bbc5416f6d49b1b2ae3ca6466a308c, user_id=018eb43549774ff1b0d02fa991309899, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:37.906782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e103313-d731-4de5-933a-9f650ef24a85 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:37.917696 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1335/2665] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:44:37 2022] PUT /identity/v3/projects/05bbc5416f6d49b1b2ae3ca6466a308c/users/018eb43549774ff1b0d02fa991309899/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:44:37.933178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20629bf-0646-49f2-9e9c-fe11b7799ede None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:37.933618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20629bf-0646-49f2-9e9c-fe11b7799ede None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:37.933996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20629bf-0646-49f2-9e9c-fe11b7799ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:37.962088 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b20629bf-0646-49f2-9e9c-fe11b7799ede None None] MFA Rules not processed for user `018eb43549774ff1b0d02fa991309899`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:44:37.963291 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b20629bf-0646-49f2-9e9c-fe11b7799ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:37.972756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:38.043792 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1331/2666] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:44:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:44:38.060116 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e103313-d731-4de5-933a-9f650ef24a85 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:38.062114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1e103313-d731-4de5-933a-9f650ef24a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:38.108630 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:38.126159 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e103313-d731-4de5-933a-9f650ef24a85 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:38.130468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d58ffe-9adf-4d14-a746-62f4f4fe3544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:38.131112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d58ffe-9adf-4d14-a746-62f4f4fe3544 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:38.131392 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d58ffe-9adf-4d14-a746-62f4f4fe3544 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:38.131669 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d58ffe-9adf-4d14-a746-62f4f4fe3544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:38.141471 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d58ffe-9adf-4d14-a746-62f4f4fe3544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:38.142900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d58ffe-9adf-4d14-a746-62f4f4fe3544 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:38.154567 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1336/2667] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:44:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:44:38.236718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20629bf-0646-49f2-9e9c-fe11b7799ede None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:38.247628 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20629bf-0646-49f2-9e9c-fe11b7799ede None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:38.252210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7eccf5-6e7e-4613-a69f-eaa3fdbd8a75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:38.252879 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7eccf5-6e7e-4613-a69f-eaa3fdbd8a75 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:38.253160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7eccf5-6e7e-4613-a69f-eaa3fdbd8a75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:38.253489 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7eccf5-6e7e-4613-a69f-eaa3fdbd8a75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:38.311856 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7eccf5-6e7e-4613-a69f-eaa3fdbd8a75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:38.313298 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7eccf5-6e7e-4613-a69f-eaa3fdbd8a75 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:38.322550 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1332/2668] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:44:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:44:48.148199 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=9 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:48.318548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=53 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:44:59.487343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d58ffe-9adf-4d14-a746-62f4f4fe3544 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:44:59.496002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d58ffe-9adf-4d14-a746-62f4f4fe3544 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:44:59.500377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f49f7e-9e1f-4984-a46a-8d2c3df98eaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:44:59.501181 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f49f7e-9e1f-4984-a46a-8d2c3df98eaa service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:44:59.501493 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f49f7e-9e1f-4984-a46a-8d2c3df98eaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:44:59.501767 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f49f7e-9e1f-4984-a46a-8d2c3df98eaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:44:59.503682 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-99f49f7e-9e1f-4984-a46a-8d2c3df98eaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:44:59.581408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f49f7e-9e1f-4984-a46a-8d2c3df98eaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:44:59.582626 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f49f7e-9e1f-4984-a46a-8d2c3df98eaa service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:44:59.593893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1337/2669] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:44:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:07.674077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7eccf5-6e7e-4613-a69f-eaa3fdbd8a75 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:07.738168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7eccf5-6e7e-4613-a69f-eaa3fdbd8a75 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:07.744536 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819296b-fb0d-4d43-b7a2-73c06b66f543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:07.745477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819296b-fb0d-4d43-b7a2-73c06b66f543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:07.745761 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819296b-fb0d-4d43-b7a2-73c06b66f543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:07.746037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819296b-fb0d-4d43-b7a2-73c06b66f543 admin admin] PATH_INFO: `/v3/users/bc6d7ad170cf475b9f47321369b3bed5` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:07.747263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819296b-fb0d-4d43-b7a2-73c06b66f543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc6d7ad170cf475b9f47321369b3bed5)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:07.749243 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819296b-fb0d-4d43-b7a2-73c06b66f543 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:07.797429 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6819296b-fb0d-4d43-b7a2-73c06b66f543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc6d7ad170cf475b9f47321369b3bed5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:07.805986 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6819296b-fb0d-4d43-b7a2-73c06b66f543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc6d7ad170cf475b9f47321369b3bed5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:07.806572 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6819296b-fb0d-4d43-b7a2-73c06b66f543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc6d7ad170cf475b9f47321369b3bed5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:07.807233 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6819296b-fb0d-4d43-b7a2-73c06b66f543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc6d7ad170cf475b9f47321369b3bed5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:07.819588 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6819296b-fb0d-4d43-b7a2-73c06b66f543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc6d7ad170cf475b9f47321369b3bed5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:07.831901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1333/2670] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:07 2022] DELETE /identity/v3/users/bc6d7ad170cf475b9f47321369b3bed5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:07.836670 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bec2f1-4d80-4c00-9cd2-2ebf16b7468d None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:07.837164 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bec2f1-4d80-4c00-9cd2-2ebf16b7468d None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:07.837329 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bec2f1-4d80-4c00-9cd2-2ebf16b7468d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:07.855051 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-91bec2f1-4d80-4c00-9cd2-2ebf16b7468d None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:07.856255 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-91bec2f1-4d80-4c00-9cd2-2ebf16b7468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:07.917779 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1338/2671] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:07.928087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819296b-fb0d-4d43-b7a2-73c06b66f543 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:07.929794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6819296b-fb0d-4d43-b7a2-73c06b66f543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:07.990167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819296b-fb0d-4d43-b7a2-73c06b66f543 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:07.994136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2b0f7-c3b0-4865-85f5-dd72d2c5ff2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:07.994791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2b0f7-c3b0-4865-85f5-dd72d2c5ff2c service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:07.995077 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2b0f7-c3b0-4865-85f5-dd72d2c5ff2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:07.995357 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2b0f7-c3b0-4865-85f5-dd72d2c5ff2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:08.005319 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2b0f7-c3b0-4865-85f5-dd72d2c5ff2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:08.006810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2b0f7-c3b0-4865-85f5-dd72d2c5ff2c service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:08.017125 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1334/2672] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:08.289700 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bec2f1-4d80-4c00-9cd2-2ebf16b7468d None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:08.291327 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-91bec2f1-4d80-4c00-9cd2-2ebf16b7468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:08.303841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bec2f1-4d80-4c00-9cd2-2ebf16b7468d None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:08.309831 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5408b-21e9-47dc-92b0-11d8e51128db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:08.310743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5408b-21e9-47dc-92b0-11d8e51128db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:08.311056 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5408b-21e9-47dc-92b0-11d8e51128db admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:08.311349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5408b-21e9-47dc-92b0-11d8e51128db admin admin] PATH_INFO: `/v3/projects/ce2e378248d741c08c1e4e75043cec7a` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:08.312696 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5408b-21e9-47dc-92b0-11d8e51128db admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce2e378248d741c08c1e4e75043cec7a)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:08.314643 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5408b-21e9-47dc-92b0-11d8e51128db admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:08.361544 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-72c5408b-21e9-47dc-92b0-11d8e51128db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce2e378248d741c08c1e4e75043cec7a', 'request_id': 'req-72c5408b-21e9-47dc-92b0-11d8e51128db'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:08.369919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-72c5408b-21e9-47dc-92b0-11d8e51128db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce2e378248d741c08c1e4e75043cec7a', 'request_id': 'req-72c5408b-21e9-47dc-92b0-11d8e51128db'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:08.378901 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-72c5408b-21e9-47dc-92b0-11d8e51128db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce2e378248d741c08c1e4e75043cec7a', 'request_id': 'req-72c5408b-21e9-47dc-92b0-11d8e51128db'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:08.393668 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-72c5408b-21e9-47dc-92b0-11d8e51128db admin admin] The token cache is being invalidate because project ce2e378248d741c08c1e4e75043cec7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:08.393962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-72c5408b-21e9-47dc-92b0-11d8e51128db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:08.394712 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-72c5408b-21e9-47dc-92b0-11d8e51128db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:08.396359 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1339/2673] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:08 2022] DELETE /identity/v3/projects/ce2e378248d741c08c1e4e75043cec7a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:08.402529 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2b0f7-c3b0-4865-85f5-dd72d2c5ff2c service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:08.415534 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2b0f7-c3b0-4865-85f5-dd72d2c5ff2c service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:08.434839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:08.475037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149c4ab-5e1b-4150-bcf6-dc03ff2f6116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:08.475930 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149c4ab-5e1b-4150-bcf6-dc03ff2f6116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:08.476218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149c4ab-5e1b-4150-bcf6-dc03ff2f6116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:08.476501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149c4ab-5e1b-4150-bcf6-dc03ff2f6116 admin admin] PATH_INFO: `/v3/users/018eb43549774ff1b0d02fa991309899` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:08.477781 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149c4ab-5e1b-4150-bcf6-dc03ff2f6116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=018eb43549774ff1b0d02fa991309899)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:08.479728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149c4ab-5e1b-4150-bcf6-dc03ff2f6116 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:08.530969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1149c4ab-5e1b-4150-bcf6-dc03ff2f6116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018eb43549774ff1b0d02fa991309899'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:08.541945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1149c4ab-5e1b-4150-bcf6-dc03ff2f6116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018eb43549774ff1b0d02fa991309899'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:08.542573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1149c4ab-5e1b-4150-bcf6-dc03ff2f6116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018eb43549774ff1b0d02fa991309899'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:08.543206 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1149c4ab-5e1b-4150-bcf6-dc03ff2f6116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018eb43549774ff1b0d02fa991309899'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:08.555790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-1149c4ab-5e1b-4150-bcf6-dc03ff2f6116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018eb43549774ff1b0d02fa991309899'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:08.571374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1335/2674] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:08 2022] DELETE /identity/v3/users/018eb43549774ff1b0d02fa991309899 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:08.864624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5408b-21e9-47dc-92b0-11d8e51128db admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:08.866284 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-72c5408b-21e9-47dc-92b0-11d8e51128db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:08.886921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5408b-21e9-47dc-92b0-11d8e51128db admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:08.896078 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:08.953072 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140e2af-b080-4f54-a5f7-7c934dc19371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:08.954059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140e2af-b080-4f54-a5f7-7c934dc19371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:08.954364 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140e2af-b080-4f54-a5f7-7c934dc19371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:08.954645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140e2af-b080-4f54-a5f7-7c934dc19371 admin admin] PATH_INFO: `/v3/projects/05bbc5416f6d49b1b2ae3ca6466a308c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:08.955946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140e2af-b080-4f54-a5f7-7c934dc19371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05bbc5416f6d49b1b2ae3ca6466a308c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:08.958160 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140e2af-b080-4f54-a5f7-7c934dc19371 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:09.008792 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0140e2af-b080-4f54-a5f7-7c934dc19371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05bbc5416f6d49b1b2ae3ca6466a308c', 'request_id': 'req-0140e2af-b080-4f54-a5f7-7c934dc19371'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:09.014838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0140e2af-b080-4f54-a5f7-7c934dc19371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05bbc5416f6d49b1b2ae3ca6466a308c', 'request_id': 'req-0140e2af-b080-4f54-a5f7-7c934dc19371'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:09.021131 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0140e2af-b080-4f54-a5f7-7c934dc19371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05bbc5416f6d49b1b2ae3ca6466a308c', 'request_id': 'req-0140e2af-b080-4f54-a5f7-7c934dc19371'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:09.034590 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0140e2af-b080-4f54-a5f7-7c934dc19371 admin admin] The token cache is being invalidate because project 05bbc5416f6d49b1b2ae3ca6466a308c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:09.034940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0140e2af-b080-4f54-a5f7-7c934dc19371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:09.035579 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0140e2af-b080-4f54-a5f7-7c934dc19371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:09.037148 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1340/2675] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:08 2022] DELETE /identity/v3/projects/05bbc5416f6d49b1b2ae3ca6466a308c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:09.042168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ea002-ebc4-41f6-b7a7-c551613e9048 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:09.042683 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ea002-ebc4-41f6-b7a7-c551613e9048 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:09.042779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ea002-ebc4-41f6-b7a7-c551613e9048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:09.061044 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-9c2ea002-ebc4-41f6-b7a7-c551613e9048 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:09.062282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9c2ea002-ebc4-41f6-b7a7-c551613e9048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:09.126564 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1336/2676] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:09.134851 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3f811-4820-453b-aeec-e58fdbf56090 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:09.135077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3f811-4820-453b-aeec-e58fdbf56090 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:09.135344 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3f811-4820-453b-aeec-e58fdbf56090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:09.154100 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7ca3f811-4820-453b-aeec-e58fdbf56090 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:09.155293 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7ca3f811-4820-453b-aeec-e58fdbf56090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:09.163597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1341/2677] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:09.167982 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ea002-ebc4-41f6-b7a7-c551613e9048 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:09.177904 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ea002-ebc4-41f6-b7a7-c551613e9048 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:09.182854 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e651c-97fc-4643-88fc-ec4e4cb6f1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:09.183510 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e651c-97fc-4643-88fc-ec4e4cb6f1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:09.183800 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e651c-97fc-4643-88fc-ec4e4cb6f1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:09.184079 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e651c-97fc-4643-88fc-ec4e4cb6f1f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:09.184812 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e651c-97fc-4643-88fc-ec4e4cb6f1f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:45:09.185123 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e651c-97fc-4643-88fc-ec4e4cb6f1f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:09.186773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e651c-97fc-4643-88fc-ec4e4cb6f1f1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:09.200505 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1337/2678] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:45:09.205013 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3f811-4820-453b-aeec-e58fdbf56090 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:09.215052 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3f811-4820-453b-aeec-e58fdbf56090 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:09.220499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25d5e8-2b2f-41bc-8165-dcee972f5e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:09.221312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25d5e8-2b2f-41bc-8165-dcee972f5e42 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:09.221645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25d5e8-2b2f-41bc-8165-dcee972f5e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:09.221926 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25d5e8-2b2f-41bc-8165-dcee972f5e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:09.222738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25d5e8-2b2f-41bc-8165-dcee972f5e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:09.224647 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25d5e8-2b2f-41bc-8165-dcee972f5e42 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:09.252276 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1342/2679] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:09 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:09.256646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e651c-97fc-4643-88fc-ec4e4cb6f1f1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:09.267158 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e651c-97fc-4643-88fc-ec4e4cb6f1f1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:09.293801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:09.327829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e9b34-ac2b-468b-bf7c-55aa3d492eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:09.328517 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9b34-ac2b-468b-bf7c-55aa3d492eea admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:09.328836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9b34-ac2b-468b-bf7c-55aa3d492eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:09.329104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e9b34-ac2b-468b-bf7c-55aa3d492eea admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:09.329864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e9b34-ac2b-468b-bf7c-55aa3d492eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:09.331828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e9b34-ac2b-468b-bf7c-55aa3d492eea admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:09.353756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1338/2680] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:09 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:09.358101 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25d5e8-2b2f-41bc-8165-dcee972f5e42 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:09.369080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25d5e8-2b2f-41bc-8165-dcee972f5e42 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:09.374963 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf36e4-12f5-4b67-aeb8-85b75312e62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:09.375637 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf36e4-12f5-4b67-aeb8-85b75312e62f admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:09.375945 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf36e4-12f5-4b67-aeb8-85b75312e62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:09.376225 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf36e4-12f5-4b67-aeb8-85b75312e62f admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:09.376972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf36e4-12f5-4b67-aeb8-85b75312e62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:09.378651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf36e4-12f5-4b67-aeb8-85b75312e62f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:09.390748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1343/2681] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:09.394701 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e9b34-ac2b-468b-bf7c-55aa3d492eea admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:09.404861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e9b34-ac2b-468b-bf7c-55aa3d492eea admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:09.410131 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c74634-2e4d-4f0d-bfbd-62222bd39f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:09.410912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c74634-2e4d-4f0d-bfbd-62222bd39f5a admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:09.411202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c74634-2e4d-4f0d-bfbd-62222bd39f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:09.411481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c74634-2e4d-4f0d-bfbd-62222bd39f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:09.412293 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c74634-2e4d-4f0d-bfbd-62222bd39f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:09.413935 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c74634-2e4d-4f0d-bfbd-62222bd39f5a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:09.424160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1339/2682] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:09.428424 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf36e4-12f5-4b67-aeb8-85b75312e62f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:09.438816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf36e4-12f5-4b67-aeb8-85b75312e62f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:09.444527 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0ee6a-52e9-4e17-a014-7ff5e802b149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:09.445491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0ee6a-52e9-4e17-a014-7ff5e802b149 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:09.445775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0ee6a-52e9-4e17-a014-7ff5e802b149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:09.446051 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0ee6a-52e9-4e17-a014-7ff5e802b149 admin admin] PATH_INFO: `/v3/projects/5087e3d317114ed78dcf993530c359e7/users/ab09e94480a74fcda5295b5aa21fb8f8/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:09.461765 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0ee6a-52e9-4e17-a014-7ff5e802b149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5087e3d317114ed78dcf993530c359e7, user_id=ab09e94480a74fcda5295b5aa21fb8f8, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:09.464434 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0ee6a-52e9-4e17-a014-7ff5e802b149 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:09.481368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1344/2683] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:09 2022] PUT /identity/v3/projects/5087e3d317114ed78dcf993530c359e7/users/ab09e94480a74fcda5295b5aa21fb8f8/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:45:09.495110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3f9eb-ae33-42a3-9698-3e35bc38108c None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:09.495401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3f9eb-ae33-42a3-9698-3e35bc38108c None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:09.495725 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3f9eb-ae33-42a3-9698-3e35bc38108c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:09.524668 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e7b3f9eb-ae33-42a3-9698-3e35bc38108c None None] MFA Rules not processed for user `ab09e94480a74fcda5295b5aa21fb8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:09.525900 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e7b3f9eb-ae33-42a3-9698-3e35bc38108c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:09.592687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1340/2684] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:09.597866 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0ee6a-52e9-4e17-a014-7ff5e802b149 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:09.638563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:09.665141 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0ee6a-52e9-4e17-a014-7ff5e802b149 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:09.670023 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0b2d7-5549-4b70-8834-4b34180e7515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:09.670689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0b2d7-5549-4b70-8834-4b34180e7515 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:09.670975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0b2d7-5549-4b70-8834-4b34180e7515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:09.671252 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0b2d7-5549-4b70-8834-4b34180e7515 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:09.671946 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0b2d7-5549-4b70-8834-4b34180e7515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:09.673887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0b2d7-5549-4b70-8834-4b34180e7515 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:09.702656 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1345/2685] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:09 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:09.707359 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3f9eb-ae33-42a3-9698-3e35bc38108c None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:09.718798 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3f9eb-ae33-42a3-9698-3e35bc38108c None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:09.784221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc581e63-dbf3-4f1c-a15d-2d9fe34d910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:09.784895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc581e63-dbf3-4f1c-a15d-2d9fe34d910e admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:09.785187 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc581e63-dbf3-4f1c-a15d-2d9fe34d910e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:09.785514 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc581e63-dbf3-4f1c-a15d-2d9fe34d910e admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:09.786231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc581e63-dbf3-4f1c-a15d-2d9fe34d910e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:09.788152 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc581e63-dbf3-4f1c-a15d-2d9fe34d910e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:09.810791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1341/2686] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:09 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:09.814705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0b2d7-5549-4b70-8834-4b34180e7515 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:09.825829 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0b2d7-5549-4b70-8834-4b34180e7515 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:09.830768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db2cf8-1b1f-4269-86d9-6990f3cbcfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:09.831443 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db2cf8-1b1f-4269-86d9-6990f3cbcfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:09.831764 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db2cf8-1b1f-4269-86d9-6990f3cbcfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:09.832092 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db2cf8-1b1f-4269-86d9-6990f3cbcfd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:09.832861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db2cf8-1b1f-4269-86d9-6990f3cbcfd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:09.834654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db2cf8-1b1f-4269-86d9-6990f3cbcfd4 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:09.846931 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1346/2687] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:09.851008 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc581e63-dbf3-4f1c-a15d-2d9fe34d910e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:09.860857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc581e63-dbf3-4f1c-a15d-2d9fe34d910e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:09.865417 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0c194-0ff0-4def-a682-037d780fb4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:09.866360 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0c194-0ff0-4def-a682-037d780fb4d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:09.866646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0c194-0ff0-4def-a682-037d780fb4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:09.866920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0c194-0ff0-4def-a682-037d780fb4d0 admin admin] PATH_INFO: `/v3/projects/2c429b580439410fad47ef86e86a0680/users/7abd7def0bfe492f94f383d625175974/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:09.883312 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0c194-0ff0-4def-a682-037d780fb4d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c429b580439410fad47ef86e86a0680, user_id=7abd7def0bfe492f94f383d625175974, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:09.886036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0c194-0ff0-4def-a682-037d780fb4d0 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:09.901610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1342/2688] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:09 2022] PUT /identity/v3/projects/2c429b580439410fad47ef86e86a0680/users/7abd7def0bfe492f94f383d625175974/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:09.905728 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db2cf8-1b1f-4269-86d9-6990f3cbcfd4 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:09.916684 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db2cf8-1b1f-4269-86d9-6990f3cbcfd4 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:09.979756 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d4cde-a863-4bee-9e88-bef9fed52695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:09.980445 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d4cde-a863-4bee-9e88-bef9fed52695 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:09.980730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d4cde-a863-4bee-9e88-bef9fed52695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:09.981010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d4cde-a863-4bee-9e88-bef9fed52695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:09.981805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d4cde-a863-4bee-9e88-bef9fed52695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:09.983409 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d4cde-a863-4bee-9e88-bef9fed52695 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:09.993667 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1347/2689] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:09.999689 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0c194-0ff0-4def-a682-037d780fb4d0 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:10.005897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:10.014191 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0c194-0ff0-4def-a682-037d780fb4d0 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:10.019256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db00ba-d89c-40dd-9236-9a3fd95c94c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:10.020168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db00ba-d89c-40dd-9236-9a3fd95c94c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:10.020476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db00ba-d89c-40dd-9236-9a3fd95c94c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:10.020779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db00ba-d89c-40dd-9236-9a3fd95c94c4 admin admin] PATH_INFO: `/v3/projects/2c429b580439410fad47ef86e86a0680/users/7abd7def0bfe492f94f383d625175974/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:10.022792 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db00ba-d89c-40dd-9236-9a3fd95c94c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c429b580439410fad47ef86e86a0680, user_id=7abd7def0bfe492f94f383d625175974, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:10.025464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db00ba-d89c-40dd-9236-9a3fd95c94c4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:10.036403 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1343/2690] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:09 2022] PUT /identity/v3/projects/2c429b580439410fad47ef86e86a0680/users/7abd7def0bfe492f94f383d625175974/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:45:10.047359 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf580f-79d7-43f7-af2f-a6454669a71e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:10.047657 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf580f-79d7-43f7-af2f-a6454669a71e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:10.047940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf580f-79d7-43f7-af2f-a6454669a71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:10.076479 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-05cf580f-79d7-43f7-af2f-a6454669a71e None None] MFA Rules not processed for user `7abd7def0bfe492f94f383d625175974`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:10.077749 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-05cf580f-79d7-43f7-af2f-a6454669a71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:10.150031 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1348/2691] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:10 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:10.161632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db00ba-d89c-40dd-9236-9a3fd95c94c4 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:10.163525 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c1db00ba-d89c-40dd-9236-9a3fd95c94c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:10.224213 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db00ba-d89c-40dd-9236-9a3fd95c94c4 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:10.228067 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a71e24-21f9-4d6f-b4d1-0ce6f3f0d7d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:10.228718 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a71e24-21f9-4d6f-b4d1-0ce6f3f0d7d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:10.229001 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a71e24-21f9-4d6f-b4d1-0ce6f3f0d7d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:10.229284 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a71e24-21f9-4d6f-b4d1-0ce6f3f0d7d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:10.240153 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a71e24-21f9-4d6f-b4d1-0ce6f3f0d7d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:10.241694 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a71e24-21f9-4d6f-b4d1-0ce6f3f0d7d8 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:10.252106 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1344/2692] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:11.631025 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf580f-79d7-43f7-af2f-a6454669a71e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:11.664721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:11.696262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf580f-79d7-43f7-af2f-a6454669a71e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:11.701098 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7012-5813-4c66-aa99-23b23ac4e277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:11.702044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7012-5813-4c66-aa99-23b23ac4e277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:11.702358 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7012-5813-4c66-aa99-23b23ac4e277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:11.702642 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7012-5813-4c66-aa99-23b23ac4e277 admin admin] PATH_INFO: `/v3/users/ab09e94480a74fcda5295b5aa21fb8f8` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:11.703955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b7012-5813-4c66-aa99-23b23ac4e277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab09e94480a74fcda5295b5aa21fb8f8)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:11.705943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b7012-5813-4c66-aa99-23b23ac4e277 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:11.760515 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4c7b7012-5813-4c66-aa99-23b23ac4e277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab09e94480a74fcda5295b5aa21fb8f8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:11.769511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4c7b7012-5813-4c66-aa99-23b23ac4e277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab09e94480a74fcda5295b5aa21fb8f8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:11.770155 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4c7b7012-5813-4c66-aa99-23b23ac4e277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab09e94480a74fcda5295b5aa21fb8f8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:11.770795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4c7b7012-5813-4c66-aa99-23b23ac4e277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab09e94480a74fcda5295b5aa21fb8f8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:11.788112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-4c7b7012-5813-4c66-aa99-23b23ac4e277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab09e94480a74fcda5295b5aa21fb8f8'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:11.801542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1349/2693] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:11 2022] DELETE /identity/v3/users/ab09e94480a74fcda5295b5aa21fb8f8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:11.806330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6f36a-40ac-44de-83bb-3f31c0f993e4 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:11.806838 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6f36a-40ac-44de-83bb-3f31c0f993e4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:11.806838 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6f36a-40ac-44de-83bb-3f31c0f993e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:11.825326 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-f3d6f36a-40ac-44de-83bb-3f31c0f993e4 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:11.826565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f3d6f36a-40ac-44de-83bb-3f31c0f993e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:11.887033 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1345/2694] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:11.897125 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7012-5813-4c66-aa99-23b23ac4e277 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:11.898848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4c7b7012-5813-4c66-aa99-23b23ac4e277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:11.966267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7012-5813-4c66-aa99-23b23ac4e277 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:11.970671 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1155b-4b50-447f-aa21-eedc09a85546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:11.971280 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1155b-4b50-447f-aa21-eedc09a85546 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:11.971794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1155b-4b50-447f-aa21-eedc09a85546 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:11.972079 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1155b-4b50-447f-aa21-eedc09a85546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:11.982064 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1155b-4b50-447f-aa21-eedc09a85546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:11.983650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1155b-4b50-447f-aa21-eedc09a85546 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:11.995233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1350/2695] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:12.286797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6f36a-40ac-44de-83bb-3f31c0f993e4 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:12.288362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-f3d6f36a-40ac-44de-83bb-3f31c0f993e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:12.301282 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6f36a-40ac-44de-83bb-3f31c0f993e4 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:12.307261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9029108-003d-4364-85c0-6d7be620ffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:12.309500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9029108-003d-4364-85c0-6d7be620ffb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:12.311356 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9029108-003d-4364-85c0-6d7be620ffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:12.312499 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9029108-003d-4364-85c0-6d7be620ffb2 admin admin] PATH_INFO: `/v3/projects/5087e3d317114ed78dcf993530c359e7` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:12.313939 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9029108-003d-4364-85c0-6d7be620ffb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5087e3d317114ed78dcf993530c359e7)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:12.316965 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9029108-003d-4364-85c0-6d7be620ffb2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:12.365141 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c9029108-003d-4364-85c0-6d7be620ffb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5087e3d317114ed78dcf993530c359e7', 'request_id': 'req-c9029108-003d-4364-85c0-6d7be620ffb2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:12.370935 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c9029108-003d-4364-85c0-6d7be620ffb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5087e3d317114ed78dcf993530c359e7', 'request_id': 'req-c9029108-003d-4364-85c0-6d7be620ffb2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:12.377315 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c9029108-003d-4364-85c0-6d7be620ffb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5087e3d317114ed78dcf993530c359e7', 'request_id': 'req-c9029108-003d-4364-85c0-6d7be620ffb2'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:12.391409 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c9029108-003d-4364-85c0-6d7be620ffb2 admin admin] The token cache is being invalidate because project 5087e3d317114ed78dcf993530c359e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:12.391705 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c9029108-003d-4364-85c0-6d7be620ffb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:12.392321 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c9029108-003d-4364-85c0-6d7be620ffb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:12.393955 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1346/2696] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:12 2022] DELETE /identity/v3/projects/5087e3d317114ed78dcf993530c359e7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:12.398528 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1155b-4b50-447f-aa21-eedc09a85546 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:12.408272 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1155b-4b50-447f-aa21-eedc09a85546 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:12.471685 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:12.483767 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961cf7c-0c7a-4e34-a9fe-0f031c0a6be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:12.484990 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961cf7c-0c7a-4e34-a9fe-0f031c0a6be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:12.485373 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961cf7c-0c7a-4e34-a9fe-0f031c0a6be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:12.485787 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961cf7c-0c7a-4e34-a9fe-0f031c0a6be0 admin admin] PATH_INFO: `/v3/users/7abd7def0bfe492f94f383d625175974` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:12.487324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961cf7c-0c7a-4e34-a9fe-0f031c0a6be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abd7def0bfe492f94f383d625175974)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:12.489954 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961cf7c-0c7a-4e34-a9fe-0f031c0a6be0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:12.541275 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0961cf7c-0c7a-4e34-a9fe-0f031c0a6be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abd7def0bfe492f94f383d625175974'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:12.552537 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0961cf7c-0c7a-4e34-a9fe-0f031c0a6be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abd7def0bfe492f94f383d625175974'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:12.553230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0961cf7c-0c7a-4e34-a9fe-0f031c0a6be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abd7def0bfe492f94f383d625175974'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:12.553959 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0961cf7c-0c7a-4e34-a9fe-0f031c0a6be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abd7def0bfe492f94f383d625175974'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:12.568833 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0961cf7c-0c7a-4e34-a9fe-0f031c0a6be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abd7def0bfe492f94f383d625175974'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:12.584645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1351/2697] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:12 2022] DELETE /identity/v3/users/7abd7def0bfe492f94f383d625175974 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:12.919322 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9029108-003d-4364-85c0-6d7be620ffb2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:12.921448 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c9029108-003d-4364-85c0-6d7be620ffb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:12.964005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9029108-003d-4364-85c0-6d7be620ffb2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:12.990735 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:13.055230 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e5f4c-295e-4786-8634-0d9e214905b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:13.056814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e5f4c-295e-4786-8634-0d9e214905b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:13.057101 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e5f4c-295e-4786-8634-0d9e214905b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:13.057473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e5f4c-295e-4786-8634-0d9e214905b1 admin admin] PATH_INFO: `/v3/projects/2c429b580439410fad47ef86e86a0680` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:13.058870 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e5f4c-295e-4786-8634-0d9e214905b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c429b580439410fad47ef86e86a0680)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:13.060805 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e5f4c-295e-4786-8634-0d9e214905b1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:13.135386 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-827e5f4c-295e-4786-8634-0d9e214905b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c429b580439410fad47ef86e86a0680', 'request_id': 'req-827e5f4c-295e-4786-8634-0d9e214905b1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:13.140735 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-827e5f4c-295e-4786-8634-0d9e214905b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c429b580439410fad47ef86e86a0680', 'request_id': 'req-827e5f4c-295e-4786-8634-0d9e214905b1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:13.147012 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-827e5f4c-295e-4786-8634-0d9e214905b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c429b580439410fad47ef86e86a0680', 'request_id': 'req-827e5f4c-295e-4786-8634-0d9e214905b1'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:13.160440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-827e5f4c-295e-4786-8634-0d9e214905b1 admin admin] The token cache is being invalidate because project 2c429b580439410fad47ef86e86a0680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:13.160860 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-827e5f4c-295e-4786-8634-0d9e214905b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:13.161620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-827e5f4c-295e-4786-8634-0d9e214905b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:13.163295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1347/2698] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:12 2022] DELETE /identity/v3/projects/2c429b580439410fad47ef86e86a0680 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:13.168409 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc860fc-2749-4cf3-8bff-02753328f83b None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:13.168910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc860fc-2749-4cf3-8bff-02753328f83b None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:13.169126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc860fc-2749-4cf3-8bff-02753328f83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:13.186885 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-acc860fc-2749-4cf3-8bff-02753328f83b None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:13.188150 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-acc860fc-2749-4cf3-8bff-02753328f83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:13.253768 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1352/2699] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:45:13.261672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b1a74-349a-4593-a796-a68b7430af11 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:13.261965 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b1a74-349a-4593-a796-a68b7430af11 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:13.262250 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b1a74-349a-4593-a796-a68b7430af11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:13.284133 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1c9b1a74-349a-4593-a796-a68b7430af11 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:13.285366 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1c9b1a74-349a-4593-a796-a68b7430af11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:13.293642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1348/2700] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:13.298046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc860fc-2749-4cf3-8bff-02753328f83b None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:13.308597 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc860fc-2749-4cf3-8bff-02753328f83b None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:13.314238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3e972-b73c-496f-a382-669d26b26e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:13.315002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3e972-b73c-496f-a382-669d26b26e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:13.315275 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3e972-b73c-496f-a382-669d26b26e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:13.315590 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3e972-b73c-496f-a382-669d26b26e25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:13.316360 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3e972-b73c-496f-a382-669d26b26e25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:45:13.316661 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3e972-b73c-496f-a382-669d26b26e25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:13.318369 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3e972-b73c-496f-a382-669d26b26e25 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:13.331524 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1353/2701] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:45:13.335784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b1a74-349a-4593-a796-a68b7430af11 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:13.345543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b1a74-349a-4593-a796-a68b7430af11 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:13.350570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8615b-772c-4776-8a12-40023d4115b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:13.351243 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8615b-772c-4776-8a12-40023d4115b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:13.351536 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8615b-772c-4776-8a12-40023d4115b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:13.351817 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8615b-772c-4776-8a12-40023d4115b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:13.352579 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8615b-772c-4776-8a12-40023d4115b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:13.354608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8615b-772c-4776-8a12-40023d4115b2 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:13.382241 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1349/2702] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:13 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:13.386424 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3e972-b73c-496f-a382-669d26b26e25 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:13.397020 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3e972-b73c-496f-a382-669d26b26e25 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:13.478266 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446e11d-2114-43ab-a749-4d440e1fb40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:13.479067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446e11d-2114-43ab-a749-4d440e1fb40f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:13.479458 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446e11d-2114-43ab-a749-4d440e1fb40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:13.479855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446e11d-2114-43ab-a749-4d440e1fb40f admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:13.480578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446e11d-2114-43ab-a749-4d440e1fb40f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:13.482609 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446e11d-2114-43ab-a749-4d440e1fb40f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:13.490689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:13.515578 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1354/2703] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:13 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:13.516861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8615b-772c-4776-8a12-40023d4115b2 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:13.529558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8615b-772c-4776-8a12-40023d4115b2 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:13.535938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17495148-4bd5-4154-b723-42547a469c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:13.536376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17495148-4bd5-4154-b723-42547a469c77 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:13.536850 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17495148-4bd5-4154-b723-42547a469c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:13.537211 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17495148-4bd5-4154-b723-42547a469c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:13.538052 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17495148-4bd5-4154-b723-42547a469c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:13.539814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17495148-4bd5-4154-b723-42547a469c77 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:13.558973 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1350/2704] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:13.562653 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446e11d-2114-43ab-a749-4d440e1fb40f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:13.583606 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446e11d-2114-43ab-a749-4d440e1fb40f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:13.588663 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53558c43-235a-4a3e-adcd-158e5c14925d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:13.589652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558c43-235a-4a3e-adcd-158e5c14925d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:13.590111 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558c43-235a-4a3e-adcd-158e5c14925d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:13.590786 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558c43-235a-4a3e-adcd-158e5c14925d admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:13.591255 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53558c43-235a-4a3e-adcd-158e5c14925d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:13.593140 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53558c43-235a-4a3e-adcd-158e5c14925d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:13.613281 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1355/2705] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:45:13.614672 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17495148-4bd5-4154-b723-42547a469c77 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:13.627026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17495148-4bd5-4154-b723-42547a469c77 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:13.637847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c172b3-24e4-4d9a-b62d-d1e762ac5f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:13.638780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c172b3-24e4-4d9a-b62d-d1e762ac5f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:13.639063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c172b3-24e4-4d9a-b62d-d1e762ac5f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:13.639340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c172b3-24e4-4d9a-b62d-d1e762ac5f99 admin admin] PATH_INFO: `/v3/projects/5930879dedad433785300e8b0525cdf3/users/29b89ba59efd4fd9ad385b0a22782810/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:13.658117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c172b3-24e4-4d9a-b62d-d1e762ac5f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5930879dedad433785300e8b0525cdf3, user_id=29b89ba59efd4fd9ad385b0a22782810, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:13.661711 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c172b3-24e4-4d9a-b62d-d1e762ac5f99 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:13.677207 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1351/2706] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:13 2022] PUT /identity/v3/projects/5930879dedad433785300e8b0525cdf3/users/29b89ba59efd4fd9ad385b0a22782810/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:13.688575 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d6666-d6a5-4365-a35e-bb404e11313e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:13.688872 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d6666-d6a5-4365-a35e-bb404e11313e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:13.689156 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d6666-d6a5-4365-a35e-bb404e11313e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:13.716052 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b53d6666-d6a5-4365-a35e-bb404e11313e None None] MFA Rules not processed for user `29b89ba59efd4fd9ad385b0a22782810`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:13.717336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b53d6666-d6a5-4365-a35e-bb404e11313e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:13.803416 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1356/2707] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:45:13.808228 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c172b3-24e4-4d9a-b62d-d1e762ac5f99 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:13.867028 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:13.895913 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c172b3-24e4-4d9a-b62d-d1e762ac5f99 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:13.905604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa8a62-0231-4c8c-9df1-385beb21009e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:13.906397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa8a62-0231-4c8c-9df1-385beb21009e admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:13.906769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa8a62-0231-4c8c-9df1-385beb21009e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:13.907124 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa8a62-0231-4c8c-9df1-385beb21009e admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:13.907999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa8a62-0231-4c8c-9df1-385beb21009e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:13.912447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa8a62-0231-4c8c-9df1-385beb21009e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:13.949525 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1352/2708] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:13 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:13.950806 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d6666-d6a5-4365-a35e-bb404e11313e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:13.962012 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d6666-d6a5-4365-a35e-bb404e11313e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:14.027160 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e0629-b53b-4ac1-a6e5-379327ba04f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:14.027858 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e0629-b53b-4ac1-a6e5-379327ba04f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:14.028151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e0629-b53b-4ac1-a6e5-379327ba04f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:14.028418 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e0629-b53b-4ac1-a6e5-379327ba04f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:14.029264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e0629-b53b-4ac1-a6e5-379327ba04f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:14.031212 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e0629-b53b-4ac1-a6e5-379327ba04f9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:14.061770 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1357/2709] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:13 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:14.066018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa8a62-0231-4c8c-9df1-385beb21009e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:14.074451 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e0629-b53b-4ac1-a6e5-379327ba04f9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:14.076798 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-476e0629-b53b-4ac1-a6e5-379327ba04f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:14.076949 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa8a62-0231-4c8c-9df1-385beb21009e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:14.081981 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd0241-19e4-4992-a465-02b7f943df28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:14.082688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd0241-19e4-4992-a465-02b7f943df28 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:14.083041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd0241-19e4-4992-a465-02b7f943df28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:14.083382 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cd0241-19e4-4992-a465-02b7f943df28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:14.084188 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd0241-19e4-4992-a465-02b7f943df28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:14.086016 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cd0241-19e4-4992-a465-02b7f943df28 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:14.098139 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1353/2710] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:14.099039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e0629-b53b-4ac1-a6e5-379327ba04f9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:14.102280 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd0241-19e4-4992-a465-02b7f943df28 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:14.104237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050d432-9eb3-4a49-91d5-972d75e5fbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:14.105164 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050d432-9eb3-4a49-91d5-972d75e5fbd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:14.105490 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050d432-9eb3-4a49-91d5-972d75e5fbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:14.105760 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050d432-9eb3-4a49-91d5-972d75e5fbd0 admin admin] PATH_INFO: `/v3/users/0500f97ac6d34fb489a4e1702fdae9cd` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:14.107140 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050d432-9eb3-4a49-91d5-972d75e5fbd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0500f97ac6d34fb489a4e1702fdae9cd)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:14.108988 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050d432-9eb3-4a49-91d5-972d75e5fbd0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:14.112061 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cd0241-19e4-4992-a465-02b7f943df28 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:14.116861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3c890-c2ad-49ea-a0e9-75a931f4209d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:14.117786 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3c890-c2ad-49ea-a0e9-75a931f4209d admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:14.118078 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3c890-c2ad-49ea-a0e9-75a931f4209d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:14.118353 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3c890-c2ad-49ea-a0e9-75a931f4209d admin admin] PATH_INFO: `/v3/projects/258e9a4f8a634bb788b9d488cc63f8f6/users/eaabd5a30ba049cca8751308dfd0b441/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:14.137617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3c890-c2ad-49ea-a0e9-75a931f4209d admin admin] RBAC: Authorizing `identity:create_grant(project_id=258e9a4f8a634bb788b9d488cc63f8f6, user_id=eaabd5a30ba049cca8751308dfd0b441, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:14.140383 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3c890-c2ad-49ea-a0e9-75a931f4209d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:14.156945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1354/2711] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:14 2022] PUT /identity/v3/projects/258e9a4f8a634bb788b9d488cc63f8f6/users/eaabd5a30ba049cca8751308dfd0b441/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:45:14.160590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3c890-c2ad-49ea-a0e9-75a931f4209d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:14.174603 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2050d432-9eb3-4a49-91d5-972d75e5fbd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0500f97ac6d34fb489a4e1702fdae9cd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:14.179955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:INSERT=7,keystone:SELECT=85,keystone:DELETE=8 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:14.187660 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2050d432-9eb3-4a49-91d5-972d75e5fbd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0500f97ac6d34fb489a4e1702fdae9cd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:14.189083 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2050d432-9eb3-4a49-91d5-972d75e5fbd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0500f97ac6d34fb489a4e1702fdae9cd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:14.190224 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2050d432-9eb3-4a49-91d5-972d75e5fbd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0500f97ac6d34fb489a4e1702fdae9cd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:14.212633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-2050d432-9eb3-4a49-91d5-972d75e5fbd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0500f97ac6d34fb489a4e1702fdae9cd'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:14.229927 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1358/2712] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:14 2022] DELETE /identity/v3/users/0500f97ac6d34fb489a4e1702fdae9cd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:14.249094 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3c890-c2ad-49ea-a0e9-75a931f4209d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:14.316795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21113b48-b8a4-4130-9feb-e285cbdca2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:14.318062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21113b48-b8a4-4130-9feb-e285cbdca2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:14.318062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21113b48-b8a4-4130-9feb-e285cbdca2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:14.318346 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21113b48-b8a4-4130-9feb-e285cbdca2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:14.318933 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21113b48-b8a4-4130-9feb-e285cbdca2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:14.320595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21113b48-b8a4-4130-9feb-e285cbdca2bf admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:14.331219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1355/2713] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:45:14.335570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050d432-9eb3-4a49-91d5-972d75e5fbd0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:14.336926 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2050d432-9eb3-4a49-91d5-972d75e5fbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:14.350231 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050d432-9eb3-4a49-91d5-972d75e5fbd0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:14.354789 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdec7fe-3f6c-4580-9a21-841a521a7453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:14.355700 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdec7fe-3f6c-4580-9a21-841a521a7453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:14.355980 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdec7fe-3f6c-4580-9a21-841a521a7453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:14.356256 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdec7fe-3f6c-4580-9a21-841a521a7453 admin admin] PATH_INFO: `/v3/projects/258e9a4f8a634bb788b9d488cc63f8f6/users/eaabd5a30ba049cca8751308dfd0b441/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:14.358264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdec7fe-3f6c-4580-9a21-841a521a7453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258e9a4f8a634bb788b9d488cc63f8f6, user_id=eaabd5a30ba049cca8751308dfd0b441, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:14.360898 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdec7fe-3f6c-4580-9a21-841a521a7453 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:14.371417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1359/2714] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:14 2022] PUT /identity/v3/projects/258e9a4f8a634bb788b9d488cc63f8f6/users/eaabd5a30ba049cca8751308dfd0b441/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:45:14.381707 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f828c60-5f23-4534-a0c5-130645fee743 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:14.381999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f828c60-5f23-4534-a0c5-130645fee743 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:14.382277 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f828c60-5f23-4534-a0c5-130645fee743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:14.408911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-2f828c60-5f23-4534-a0c5-130645fee743 None None] MFA Rules not processed for user `eaabd5a30ba049cca8751308dfd0b441`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:14.410473 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2f828c60-5f23-4534-a0c5-130645fee743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:14.418599 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdec7fe-3f6c-4580-9a21-841a521a7453 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:14.420646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-afdec7fe-3f6c-4580-9a21-841a521a7453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:14.446573 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:14.492437 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdec7fe-3f6c-4580-9a21-841a521a7453 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:14.493864 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1356/2715] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:14.497297 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4f267-fc82-46de-8849-2715ca24bb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:14.498204 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4f267-fc82-46de-8849-2715ca24bb7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:14.498494 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4f267-fc82-46de-8849-2715ca24bb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:14.498777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4f267-fc82-46de-8849-2715ca24bb7d admin admin] PATH_INFO: `/v3/projects/5c7cdfbe4c724715a184f8856d05319d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:14.500334 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4f267-fc82-46de-8849-2715ca24bb7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7cdfbe4c724715a184f8856d05319d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:14.502291 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4f267-fc82-46de-8849-2715ca24bb7d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:14.505262 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f828c60-5f23-4534-a0c5-130645fee743 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:14.506635 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2f828c60-5f23-4534-a0c5-130645fee743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:14.550393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-17a4f267-fc82-46de-8849-2715ca24bb7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7cdfbe4c724715a184f8856d05319d', 'request_id': 'req-17a4f267-fc82-46de-8849-2715ca24bb7d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:14.555929 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-17a4f267-fc82-46de-8849-2715ca24bb7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7cdfbe4c724715a184f8856d05319d', 'request_id': 'req-17a4f267-fc82-46de-8849-2715ca24bb7d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:14.563193 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-17a4f267-fc82-46de-8849-2715ca24bb7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7cdfbe4c724715a184f8856d05319d', 'request_id': 'req-17a4f267-fc82-46de-8849-2715ca24bb7d'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:14.563793 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f828c60-5f23-4534-a0c5-130645fee743 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:14.576173 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-17a4f267-fc82-46de-8849-2715ca24bb7d admin admin] The token cache is being invalidate because project 5c7cdfbe4c724715a184f8856d05319d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:14.576455 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-17a4f267-fc82-46de-8849-2715ca24bb7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:14.577080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-17a4f267-fc82-46de-8849-2715ca24bb7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:14.578894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1360/2716] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:14 2022] DELETE /identity/v3/projects/5c7cdfbe4c724715a184f8856d05319d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:45:14.583418 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869f61e-210d-457f-b29d-af50e9959edc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:14.583710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869f61e-210d-457f-b29d-af50e9959edc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:14.583996 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869f61e-210d-457f-b29d-af50e9959edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:14.601940 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8869f61e-210d-457f-b29d-af50e9959edc None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:14.603077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8869f61e-210d-457f-b29d-af50e9959edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:14.617321 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45292a-1119-4687-8c58-a69f6357da47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:14.618045 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45292a-1119-4687-8c58-a69f6357da47 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:14.618329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45292a-1119-4687-8c58-a69f6357da47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:14.618639 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45292a-1119-4687-8c58-a69f6357da47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:14.620580 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2b45292a-1119-4687-8c58-a69f6357da47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:14.645014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:14.671623 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1361/2717] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:45:14.679166 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5bacc-c65a-4ff2-b9ac-fdb4a86cb334 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:14.679541 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5bacc-c65a-4ff2-b9ac-fdb4a86cb334 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:14.680033 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5bacc-c65a-4ff2-b9ac-fdb4a86cb334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:14.689898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45292a-1119-4687-8c58-a69f6357da47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:14.692030 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45292a-1119-4687-8c58-a69f6357da47 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:14.700246 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ebf5bacc-c65a-4ff2-b9ac-fdb4a86cb334 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:14.701480 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ebf5bacc-c65a-4ff2-b9ac-fdb4a86cb334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:14.703762 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1357/2718] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:45:14.709819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1362/2719] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:45:14.714034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45292a-1119-4687-8c58-a69f6357da47 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:14.725841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45292a-1119-4687-8c58-a69f6357da47 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:14.731166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c701c5-a96d-4665-a875-8e1bfd177ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:14.732169 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c701c5-a96d-4665-a875-8e1bfd177ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:14.732530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c701c5-a96d-4665-a875-8e1bfd177ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:14.732880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c701c5-a96d-4665-a875-8e1bfd177ef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:14.733795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c701c5-a96d-4665-a875-8e1bfd177ef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:45:14.734179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c701c5-a96d-4665-a875-8e1bfd177ef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:14.735862 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c701c5-a96d-4665-a875-8e1bfd177ef0 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:14.749627 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1358/2720] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:45:14.754016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5bacc-c65a-4ff2-b9ac-fdb4a86cb334 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:14.765508 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5bacc-c65a-4ff2-b9ac-fdb4a86cb334 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:14.770997 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1949d-77ca-4cf6-93c6-9e64a273ed01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:14.771835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1949d-77ca-4cf6-93c6-9e64a273ed01 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:14.772206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1949d-77ca-4cf6-93c6-9e64a273ed01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:14.772485 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1949d-77ca-4cf6-93c6-9e64a273ed01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:14.773441 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1949d-77ca-4cf6-93c6-9e64a273ed01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:14.775340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1949d-77ca-4cf6-93c6-9e64a273ed01 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:14.805715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1363/2721] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:14 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:45:14.806880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c701c5-a96d-4665-a875-8e1bfd177ef0 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:14.817064 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c701c5-a96d-4665-a875-8e1bfd177ef0 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:14.831483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=100 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:14.888041 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb4327-f9a2-443f-a046-b20abf08d9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:14.888868 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb4327-f9a2-443f-a046-b20abf08d9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:14.889271 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb4327-f9a2-443f-a046-b20abf08d9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:14.889725 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb4327-f9a2-443f-a046-b20abf08d9a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:14.890749 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb4327-f9a2-443f-a046-b20abf08d9a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:14.893592 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb4327-f9a2-443f-a046-b20abf08d9a1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:14.915725 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1359/2722] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:14 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:14.920477 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1949d-77ca-4cf6-93c6-9e64a273ed01 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:14.931159 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1949d-77ca-4cf6-93c6-9e64a273ed01 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:14.936915 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6611c29-5ded-4d2f-bfc3-9eb1ac7ef5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:14.937650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6611c29-5ded-4d2f-bfc3-9eb1ac7ef5fe admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:14.937923 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6611c29-5ded-4d2f-bfc3-9eb1ac7ef5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:14.938201 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6611c29-5ded-4d2f-bfc3-9eb1ac7ef5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:14.938961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6611c29-5ded-4d2f-bfc3-9eb1ac7ef5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:14.940570 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6611c29-5ded-4d2f-bfc3-9eb1ac7ef5fe admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:14.953373 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1364/2723] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:14.957438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb4327-f9a2-443f-a046-b20abf08d9a1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:14.967702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb4327-f9a2-443f-a046-b20abf08d9a1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:14.973049 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dd2db-fbff-4e36-9a03-731f75827d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:14.973833 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dd2db-fbff-4e36-9a03-731f75827d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:14.974122 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dd2db-fbff-4e36-9a03-731f75827d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:14.974435 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dd2db-fbff-4e36-9a03-731f75827d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:14.975176 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599dd2db-fbff-4e36-9a03-731f75827d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:14.976818 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599dd2db-fbff-4e36-9a03-731f75827d79 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:14.988327 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1360/2724] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:14.992748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6611c29-5ded-4d2f-bfc3-9eb1ac7ef5fe admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:15.003600 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6611c29-5ded-4d2f-bfc3-9eb1ac7ef5fe admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:15.008501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b84562-53ef-4559-97bf-a486597eef6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:15.009442 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b84562-53ef-4559-97bf-a486597eef6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:15.010055 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b84562-53ef-4559-97bf-a486597eef6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:15.010424 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b84562-53ef-4559-97bf-a486597eef6e admin admin] PATH_INFO: `/v3/projects/fe6369572a184780933eca3c42d42abc/users/522438f9fddf4f6a995fe0f885081b25/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:15.029073 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b84562-53ef-4559-97bf-a486597eef6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6369572a184780933eca3c42d42abc, user_id=522438f9fddf4f6a995fe0f885081b25, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:15.031806 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b84562-53ef-4559-97bf-a486597eef6e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:15.058510 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1365/2725] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:14 2022] PUT /identity/v3/projects/fe6369572a184780933eca3c42d42abc/users/522438f9fddf4f6a995fe0f885081b25/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:15.061739 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d37f7a-ef9e-48c2-86b9-e704cfa80ea9 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:15.065635 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d37f7a-ef9e-48c2-86b9-e704cfa80ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:15.065635 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d37f7a-ef9e-48c2-86b9-e704cfa80ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:15.095753 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-a7d37f7a-ef9e-48c2-86b9-e704cfa80ea9 None None] MFA Rules not processed for user `522438f9fddf4f6a995fe0f885081b25`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:15.096979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a7d37f7a-ef9e-48c2-86b9-e704cfa80ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:15.164764 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1361/2726] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:45:15.176907 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b84562-53ef-4559-97bf-a486597eef6e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:15.178876 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-25b84562-53ef-4559-97bf-a486597eef6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:15.254347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b84562-53ef-4559-97bf-a486597eef6e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:15.260364 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b94cbe-0d54-45ec-ae82-a16293eeb4a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:15.261368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b94cbe-0d54-45ec-ae82-a16293eeb4a7 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:15.261670 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b94cbe-0d54-45ec-ae82-a16293eeb4a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:15.261954 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b94cbe-0d54-45ec-ae82-a16293eeb4a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:15.270337 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b94cbe-0d54-45ec-ae82-a16293eeb4a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:15.271975 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b94cbe-0d54-45ec-ae82-a16293eeb4a7 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:15.280890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1366/2727] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:15.362815 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d37f7a-ef9e-48c2-86b9-e704cfa80ea9 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:15.364520 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a7d37f7a-ef9e-48c2-86b9-e704cfa80ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:15.423037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d37f7a-ef9e-48c2-86b9-e704cfa80ea9 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:15.427255 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b76f39-511e-41c7-935d-eeba5f78bb2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:15.428013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b76f39-511e-41c7-935d-eeba5f78bb2e service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:15.428309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b76f39-511e-41c7-935d-eeba5f78bb2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:15.428595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b76f39-511e-41c7-935d-eeba5f78bb2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:15.430694 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-a1b76f39-511e-41c7-935d-eeba5f78bb2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:15.445591 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b76f39-511e-41c7-935d-eeba5f78bb2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:15.447168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b76f39-511e-41c7-935d-eeba5f78bb2e service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:15.458527 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1362/2728] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:15.616788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b94cbe-0d54-45ec-ae82-a16293eeb4a7 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:15.681098 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b94cbe-0d54-45ec-ae82-a16293eeb4a7 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:15.686501 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3200ce-730d-4895-9fa7-64d2c8c04fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:15.687439 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3200ce-730d-4895-9fa7-64d2c8c04fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:15.687725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3200ce-730d-4895-9fa7-64d2c8c04fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:15.687993 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3200ce-730d-4895-9fa7-64d2c8c04fcf admin admin] PATH_INFO: `/v3/users/522438f9fddf4f6a995fe0f885081b25` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:15.689238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3200ce-730d-4895-9fa7-64d2c8c04fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=522438f9fddf4f6a995fe0f885081b25)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:15.691258 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3200ce-730d-4895-9fa7-64d2c8c04fcf admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:15.701608 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:15.746088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0d3200ce-730d-4895-9fa7-64d2c8c04fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '522438f9fddf4f6a995fe0f885081b25'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:15.754860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0d3200ce-730d-4895-9fa7-64d2c8c04fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '522438f9fddf4f6a995fe0f885081b25'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:15.755538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0d3200ce-730d-4895-9fa7-64d2c8c04fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '522438f9fddf4f6a995fe0f885081b25'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:15.756219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0d3200ce-730d-4895-9fa7-64d2c8c04fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '522438f9fddf4f6a995fe0f885081b25'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:15.768415 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0d3200ce-730d-4895-9fa7-64d2c8c04fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '522438f9fddf4f6a995fe0f885081b25'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:15.780848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1367/2729] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:15 2022] DELETE /identity/v3/users/522438f9fddf4f6a995fe0f885081b25 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:15.785797 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbf637-5ba5-4cee-a695-21a7a038b496 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:15.786091 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbf637-5ba5-4cee-a695-21a7a038b496 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:15.786369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbf637-5ba5-4cee-a695-21a7a038b496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:15.804569 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-decbf637-5ba5-4cee-a695-21a7a038b496 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:15.805806 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-decbf637-5ba5-4cee-a695-21a7a038b496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:15.830432 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:15.870661 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1363/2730] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:15.882583 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3200ce-730d-4895-9fa7-64d2c8c04fcf admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:15.884328 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0d3200ce-730d-4895-9fa7-64d2c8c04fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:15.948943 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3200ce-730d-4895-9fa7-64d2c8c04fcf admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:15.953125 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de692e-0967-41ab-9880-df068fe8e110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:15.953823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de692e-0967-41ab-9880-df068fe8e110 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:15.954106 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de692e-0967-41ab-9880-df068fe8e110 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:15.954380 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de692e-0967-41ab-9880-df068fe8e110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:15.964902 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de692e-0967-41ab-9880-df068fe8e110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:15.966377 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de692e-0967-41ab-9880-df068fe8e110 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:15.976769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1368/2731] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:16.255572 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbf637-5ba5-4cee-a695-21a7a038b496 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:16.257199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-decbf637-5ba5-4cee-a695-21a7a038b496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:16.271962 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbf637-5ba5-4cee-a695-21a7a038b496 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:16.277276 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d72e9-581b-48f4-9095-b72d19deec55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:16.278485 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d72e9-581b-48f4-9095-b72d19deec55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:16.278777 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d72e9-581b-48f4-9095-b72d19deec55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:16.279063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d72e9-581b-48f4-9095-b72d19deec55 admin admin] PATH_INFO: `/v3/projects/fe6369572a184780933eca3c42d42abc` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:16.280463 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d72e9-581b-48f4-9095-b72d19deec55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6369572a184780933eca3c42d42abc)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:16.283309 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d72e9-581b-48f4-9095-b72d19deec55 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:16.333216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f76d72e9-581b-48f4-9095-b72d19deec55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6369572a184780933eca3c42d42abc', 'request_id': 'req-f76d72e9-581b-48f4-9095-b72d19deec55'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:16.339373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f76d72e9-581b-48f4-9095-b72d19deec55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6369572a184780933eca3c42d42abc', 'request_id': 'req-f76d72e9-581b-48f4-9095-b72d19deec55'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:16.346340 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f76d72e9-581b-48f4-9095-b72d19deec55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6369572a184780933eca3c42d42abc', 'request_id': 'req-f76d72e9-581b-48f4-9095-b72d19deec55'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:16.358949 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f76d72e9-581b-48f4-9095-b72d19deec55 admin admin] The token cache is being invalidate because project fe6369572a184780933eca3c42d42abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:16.359401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f76d72e9-581b-48f4-9095-b72d19deec55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:16.360027 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-f76d72e9-581b-48f4-9095-b72d19deec55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:16.361954 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1364/2732] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:16 2022] DELETE /identity/v3/projects/fe6369572a184780933eca3c42d42abc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:16.367113 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f426048-9bd2-456a-9293-e1bd168b402a None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:16.367620 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f426048-9bd2-456a-9293-e1bd168b402a None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:16.367710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f426048-9bd2-456a-9293-e1bd168b402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:16.386133 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8f426048-9bd2-456a-9293-e1bd168b402a None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:16.387349 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8f426048-9bd2-456a-9293-e1bd168b402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:16.460430 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1369/2733] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:45:16.470429 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a94c22-1383-4878-8125-63931119b8c3 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:16.470830 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a94c22-1383-4878-8125-63931119b8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:16.471248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a94c22-1383-4878-8125-63931119b8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:16.491255 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b3a94c22-1383-4878-8125-63931119b8c3 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:16.492516 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b3a94c22-1383-4878-8125-63931119b8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:16.500578 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1365/2734] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:16.504954 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f426048-9bd2-456a-9293-e1bd168b402a None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:16.514834 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f426048-9bd2-456a-9293-e1bd168b402a None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:16.520001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221fd5b-1716-4dd1-9695-8a517d678fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:16.520750 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221fd5b-1716-4dd1-9695-8a517d678fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:16.521038 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221fd5b-1716-4dd1-9695-8a517d678fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:16.521318 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221fd5b-1716-4dd1-9695-8a517d678fc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:16.522145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221fd5b-1716-4dd1-9695-8a517d678fc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:45:16.522457 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221fd5b-1716-4dd1-9695-8a517d678fc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:16.524848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221fd5b-1716-4dd1-9695-8a517d678fc3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:16.537506 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1370/2735] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:45:16.541834 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a94c22-1383-4878-8125-63931119b8c3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:16.551252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a94c22-1383-4878-8125-63931119b8c3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:16.556297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072de4f-c592-4d70-9abf-f988315c8148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:16.556956 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072de4f-c592-4d70-9abf-f988315c8148 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:16.557241 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072de4f-c592-4d70-9abf-f988315c8148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:16.557548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072de4f-c592-4d70-9abf-f988315c8148 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:16.558274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072de4f-c592-4d70-9abf-f988315c8148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:16.560200 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072de4f-c592-4d70-9abf-f988315c8148 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:16.588174 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1366/2736] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:16 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:16.591736 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221fd5b-1716-4dd1-9695-8a517d678fc3 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:16.602916 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221fd5b-1716-4dd1-9695-8a517d678fc3 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:16.617467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:16.665362 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a78865-f687-49e9-b8fe-ab06fcba71fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:16.666061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78865-f687-49e9-b8fe-ab06fcba71fa admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:16.666347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78865-f687-49e9-b8fe-ab06fcba71fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:16.666627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78865-f687-49e9-b8fe-ab06fcba71fa admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:16.667324 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a78865-f687-49e9-b8fe-ab06fcba71fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:16.669250 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a78865-f687-49e9-b8fe-ab06fcba71fa admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:16.689823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1371/2737] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:16 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:16.694379 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072de4f-c592-4d70-9abf-f988315c8148 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:16.705401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072de4f-c592-4d70-9abf-f988315c8148 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:16.711436 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f9fe3-0754-4dec-a981-91a6c657f863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:16.712105 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9fe3-0754-4dec-a981-91a6c657f863 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:16.712388 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9fe3-0754-4dec-a981-91a6c657f863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:16.712666 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9fe3-0754-4dec-a981-91a6c657f863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:16.713475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f9fe3-0754-4dec-a981-91a6c657f863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:16.715089 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f9fe3-0754-4dec-a981-91a6c657f863 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:16.726094 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1367/2738] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:45:16.731706 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a78865-f687-49e9-b8fe-ab06fcba71fa admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:16.742801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a78865-f687-49e9-b8fe-ab06fcba71fa admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:16.748552 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea41fae-5f67-4f26-bbaa-ddb8ad63f213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:16.749214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea41fae-5f67-4f26-bbaa-ddb8ad63f213 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:16.749541 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea41fae-5f67-4f26-bbaa-ddb8ad63f213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:16.749817 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea41fae-5f67-4f26-bbaa-ddb8ad63f213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:16.750551 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea41fae-5f67-4f26-bbaa-ddb8ad63f213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:16.752149 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea41fae-5f67-4f26-bbaa-ddb8ad63f213 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:16.762778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1372/2739] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:16.767148 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f9fe3-0754-4dec-a981-91a6c657f863 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:16.777252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f9fe3-0754-4dec-a981-91a6c657f863 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:16.782270 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158654f-1259-4ec5-9351-7a24e49ae40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:16.783160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158654f-1259-4ec5-9351-7a24e49ae40f admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:16.783442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158654f-1259-4ec5-9351-7a24e49ae40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:16.783720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158654f-1259-4ec5-9351-7a24e49ae40f admin admin] PATH_INFO: `/v3/projects/482c7aafe139419498d8d4e236a85519/users/3d20e75e0b4d43338d68ea0132fda7f5/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:16.798545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158654f-1259-4ec5-9351-7a24e49ae40f admin admin] RBAC: Authorizing `identity:create_grant(project_id=482c7aafe139419498d8d4e236a85519, user_id=3d20e75e0b4d43338d68ea0132fda7f5, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:16.801205 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158654f-1259-4ec5-9351-7a24e49ae40f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:16.815689 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1368/2740] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:16 2022] PUT /identity/v3/projects/482c7aafe139419498d8d4e236a85519/users/3d20e75e0b4d43338d68ea0132fda7f5/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:16.827213 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b94900-6927-44e0-a708-f82d111544d1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:16.827494 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b94900-6927-44e0-a708-f82d111544d1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:16.827861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b94900-6927-44e0-a708-f82d111544d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:16.863423 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-e1b94900-6927-44e0-a708-f82d111544d1 None None] MFA Rules not processed for user `3d20e75e0b4d43338d68ea0132fda7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:16.864696 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e1b94900-6927-44e0-a708-f82d111544d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:16.933518 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1373/2741] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:16.938252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158654f-1259-4ec5-9351-7a24e49ae40f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:16.993950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:17.016032 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158654f-1259-4ec5-9351-7a24e49ae40f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:17.022449 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581d976-7551-43a9-96ef-ff5cc8bfd364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:17.023118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581d976-7551-43a9-96ef-ff5cc8bfd364 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:17.023406 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581d976-7551-43a9-96ef-ff5cc8bfd364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:17.023683 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581d976-7551-43a9-96ef-ff5cc8bfd364 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:17.024413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581d976-7551-43a9-96ef-ff5cc8bfd364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:17.026693 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581d976-7551-43a9-96ef-ff5cc8bfd364 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:17.053754 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1369/2742] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:16 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:17.058130 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b94900-6927-44e0-a708-f82d111544d1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:17.069068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b94900-6927-44e0-a708-f82d111544d1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:17.130442 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420bb13-2154-4ec9-a44d-b768212e1183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:17.131159 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420bb13-2154-4ec9-a44d-b768212e1183 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:17.131455 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420bb13-2154-4ec9-a44d-b768212e1183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:17.131738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420bb13-2154-4ec9-a44d-b768212e1183 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:17.132444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420bb13-2154-4ec9-a44d-b768212e1183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:17.134417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420bb13-2154-4ec9-a44d-b768212e1183 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:17.155103 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1374/2743] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:17 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:17.159397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581d976-7551-43a9-96ef-ff5cc8bfd364 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:17.169663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581d976-7551-43a9-96ef-ff5cc8bfd364 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:17.174401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a9c08-bc06-48bf-bf69-6de000fd8366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:17.175062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a9c08-bc06-48bf-bf69-6de000fd8366 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:17.175367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a9c08-bc06-48bf-bf69-6de000fd8366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:17.175642 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a9c08-bc06-48bf-bf69-6de000fd8366 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:17.176376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a9c08-bc06-48bf-bf69-6de000fd8366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:17.178037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a9c08-bc06-48bf-bf69-6de000fd8366 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:17.189751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1370/2744] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:17.193925 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420bb13-2154-4ec9-a44d-b768212e1183 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:17.203863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420bb13-2154-4ec9-a44d-b768212e1183 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:17.208666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842b673-8ad3-4f26-b864-c9a666b418a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:17.209621 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842b673-8ad3-4f26-b864-c9a666b418a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:17.209908 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842b673-8ad3-4f26-b864-c9a666b418a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:17.210188 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842b673-8ad3-4f26-b864-c9a666b418a8 admin admin] PATH_INFO: `/v3/projects/56f1bb24056348a3bbce382962849421/users/c01bcd4bf5c34e329e58faa3b1288140/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:17.222912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:17.226228 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842b673-8ad3-4f26-b864-c9a666b418a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f1bb24056348a3bbce382962849421, user_id=c01bcd4bf5c34e329e58faa3b1288140, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:17.228838 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842b673-8ad3-4f26-b864-c9a666b418a8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:17.243805 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1375/2745] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:17 2022] PUT /identity/v3/projects/56f1bb24056348a3bbce382962849421/users/c01bcd4bf5c34e329e58faa3b1288140/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:17.247698 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a9c08-bc06-48bf-bf69-6de000fd8366 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:17.257809 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a9c08-bc06-48bf-bf69-6de000fd8366 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:17.315451 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3484c-1d49-4ec5-ba1e-baf30f13da08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:17.316142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3484c-1d49-4ec5-ba1e-baf30f13da08 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:17.316428 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3484c-1d49-4ec5-ba1e-baf30f13da08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:17.316751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3484c-1d49-4ec5-ba1e-baf30f13da08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:17.317626 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3484c-1d49-4ec5-ba1e-baf30f13da08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:17.319210 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3484c-1d49-4ec5-ba1e-baf30f13da08 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:17.329255 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1371/2746] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:17.334447 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842b673-8ad3-4f26-b864-c9a666b418a8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:17.345511 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842b673-8ad3-4f26-b864-c9a666b418a8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:17.351187 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4661d21-c516-4f56-b9cb-df14bdc2d5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:17.352084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4661d21-c516-4f56-b9cb-df14bdc2d5fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:17.352368 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4661d21-c516-4f56-b9cb-df14bdc2d5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:17.352644 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4661d21-c516-4f56-b9cb-df14bdc2d5fd admin admin] PATH_INFO: `/v3/projects/56f1bb24056348a3bbce382962849421/users/c01bcd4bf5c34e329e58faa3b1288140/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:17.354775 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4661d21-c516-4f56-b9cb-df14bdc2d5fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=56f1bb24056348a3bbce382962849421, user_id=c01bcd4bf5c34e329e58faa3b1288140, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:17.357417 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4661d21-c516-4f56-b9cb-df14bdc2d5fd admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:17.372232 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1376/2747] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:17 2022] PUT /identity/v3/projects/56f1bb24056348a3bbce382962849421/users/c01bcd4bf5c34e329e58faa3b1288140/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:17.384932 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68b012-09f9-4d95-b92f-2b8afc4974e1 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:17.385251 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68b012-09f9-4d95-b92f-2b8afc4974e1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:17.385575 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68b012-09f9-4d95-b92f-2b8afc4974e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:17.412707 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-6a68b012-09f9-4d95-b92f-2b8afc4974e1 None None] MFA Rules not processed for user `c01bcd4bf5c34e329e58faa3b1288140`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:17.413936 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6a68b012-09f9-4d95-b92f-2b8afc4974e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:17.490666 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1372/2748] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:17.506660 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4661d21-c516-4f56-b9cb-df14bdc2d5fd admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:17.508807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-e4661d21-c516-4f56-b9cb-df14bdc2d5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:17.570384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4661d21-c516-4f56-b9cb-df14bdc2d5fd admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:17.574457 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de982f-99dc-485a-80ef-6bc1e163e9bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:17.575122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de982f-99dc-485a-80ef-6bc1e163e9bf service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:17.575429 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de982f-99dc-485a-80ef-6bc1e163e9bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:17.575709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de982f-99dc-485a-80ef-6bc1e163e9bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:17.585388 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de982f-99dc-485a-80ef-6bc1e163e9bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:17.586865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de982f-99dc-485a-80ef-6bc1e163e9bf service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:17.598677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1377/2749] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:17.626533 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68b012-09f9-4d95-b92f-2b8afc4974e1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:17.673581 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:17.692899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68b012-09f9-4d95-b92f-2b8afc4974e1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:17.697509 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86eac2-4bc9-4523-901b-d78099643608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:17.698408 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86eac2-4bc9-4523-901b-d78099643608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:17.698721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86eac2-4bc9-4523-901b-d78099643608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:17.699014 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86eac2-4bc9-4523-901b-d78099643608 admin admin] PATH_INFO: `/v3/users/3d20e75e0b4d43338d68ea0132fda7f5` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:17.700661 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86eac2-4bc9-4523-901b-d78099643608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d20e75e0b4d43338d68ea0132fda7f5)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:17.702899 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86eac2-4bc9-4523-901b-d78099643608 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:17.752743 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bd86eac2-4bc9-4523-901b-d78099643608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d20e75e0b4d43338d68ea0132fda7f5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:17.763636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bd86eac2-4bc9-4523-901b-d78099643608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d20e75e0b4d43338d68ea0132fda7f5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:17.766037 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bd86eac2-4bc9-4523-901b-d78099643608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d20e75e0b4d43338d68ea0132fda7f5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:17.766687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bd86eac2-4bc9-4523-901b-d78099643608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d20e75e0b4d43338d68ea0132fda7f5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:17.780472 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-bd86eac2-4bc9-4523-901b-d78099643608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d20e75e0b4d43338d68ea0132fda7f5'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:17.793455 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1373/2750] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:17 2022] DELETE /identity/v3/users/3d20e75e0b4d43338d68ea0132fda7f5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:17.797854 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbea34-db32-4bdb-85d1-aaf8f92471a6 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:17.798155 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbea34-db32-4bdb-85d1-aaf8f92471a6 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:17.798442 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbea34-db32-4bdb-85d1-aaf8f92471a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:17.817063 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-64cbea34-db32-4bdb-85d1-aaf8f92471a6 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:17.818369 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-64cbea34-db32-4bdb-85d1-aaf8f92471a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:17.881467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1378/2751] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:17.892887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86eac2-4bc9-4523-901b-d78099643608 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:17.894516 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-bd86eac2-4bc9-4523-901b-d78099643608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:17.959453 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86eac2-4bc9-4523-901b-d78099643608 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:17.964075 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ad7f1-8ba2-41ca-bb94-7030f3aaf02e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:17.964744 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ad7f1-8ba2-41ca-bb94-7030f3aaf02e service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:17.965023 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ad7f1-8ba2-41ca-bb94-7030f3aaf02e service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:17.965305 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ad7f1-8ba2-41ca-bb94-7030f3aaf02e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:17.975812 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ad7f1-8ba2-41ca-bb94-7030f3aaf02e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:17.977263 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ad7f1-8ba2-41ca-bb94-7030f3aaf02e service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:17.987837 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1374/2752] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:18.274509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbea34-db32-4bdb-85d1-aaf8f92471a6 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:18.276210 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-64cbea34-db32-4bdb-85d1-aaf8f92471a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:18.289710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbea34-db32-4bdb-85d1-aaf8f92471a6 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:18.295268 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f575c3-5974-4f06-8bc6-a91badb2db6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:18.296861 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f575c3-5974-4f06-8bc6-a91badb2db6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:18.297532 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f575c3-5974-4f06-8bc6-a91badb2db6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:18.297821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f575c3-5974-4f06-8bc6-a91badb2db6e admin admin] PATH_INFO: `/v3/projects/482c7aafe139419498d8d4e236a85519` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:18.299086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f575c3-5974-4f06-8bc6-a91badb2db6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=482c7aafe139419498d8d4e236a85519)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:18.301014 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f575c3-5974-4f06-8bc6-a91badb2db6e admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:18.349015 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0f575c3-5974-4f06-8bc6-a91badb2db6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482c7aafe139419498d8d4e236a85519', 'request_id': 'req-a0f575c3-5974-4f06-8bc6-a91badb2db6e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:18.355049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0f575c3-5974-4f06-8bc6-a91badb2db6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482c7aafe139419498d8d4e236a85519', 'request_id': 'req-a0f575c3-5974-4f06-8bc6-a91badb2db6e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:18.361382 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0f575c3-5974-4f06-8bc6-a91badb2db6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482c7aafe139419498d8d4e236a85519', 'request_id': 'req-a0f575c3-5974-4f06-8bc6-a91badb2db6e'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:18.375039 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0f575c3-5974-4f06-8bc6-a91badb2db6e admin admin] The token cache is being invalidate because project 482c7aafe139419498d8d4e236a85519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:18.375654 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0f575c3-5974-4f06-8bc6-a91badb2db6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:18.376261 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a0f575c3-5974-4f06-8bc6-a91badb2db6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:18.378029 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1379/2753] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:18 2022] DELETE /identity/v3/projects/482c7aafe139419498d8d4e236a85519 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:18.382286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ad7f1-8ba2-41ca-bb94-7030f3aaf02e service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:18.392413 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ad7f1-8ba2-41ca-bb94-7030f3aaf02e service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:18.450117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ce533-518a-43c4-b9e1-bb7a9ce9f738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:18.451050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ce533-518a-43c4-b9e1-bb7a9ce9f738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:18.451330 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ce533-518a-43c4-b9e1-bb7a9ce9f738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:18.451611 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ce533-518a-43c4-b9e1-bb7a9ce9f738 admin admin] PATH_INFO: `/v3/users/c01bcd4bf5c34e329e58faa3b1288140` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:18.452852 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ce533-518a-43c4-b9e1-bb7a9ce9f738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01bcd4bf5c34e329e58faa3b1288140)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:18.454829 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1ce533-518a-43c4-b9e1-bb7a9ce9f738 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:18.461787 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:18.510324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5e1ce533-518a-43c4-b9e1-bb7a9ce9f738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01bcd4bf5c34e329e58faa3b1288140'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:18.519688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5e1ce533-518a-43c4-b9e1-bb7a9ce9f738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01bcd4bf5c34e329e58faa3b1288140'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:18.520910 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5e1ce533-518a-43c4-b9e1-bb7a9ce9f738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01bcd4bf5c34e329e58faa3b1288140'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:18.521586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5e1ce533-518a-43c4-b9e1-bb7a9ce9f738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01bcd4bf5c34e329e58faa3b1288140'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:18.534349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-5e1ce533-518a-43c4-b9e1-bb7a9ce9f738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01bcd4bf5c34e329e58faa3b1288140'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:18.546548 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1375/2754] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:18 2022] DELETE /identity/v3/users/c01bcd4bf5c34e329e58faa3b1288140 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:18.833828 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f575c3-5974-4f06-8bc6-a91badb2db6e admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:18.835391 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a0f575c3-5974-4f06-8bc6-a91badb2db6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:18.845300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:18.850507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f575c3-5974-4f06-8bc6-a91badb2db6e admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:18.920008 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d9b20-68c5-458a-b94c-875ba52d4b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:18.920907 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d9b20-68c5-458a-b94c-875ba52d4b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:18.921192 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d9b20-68c5-458a-b94c-875ba52d4b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:18.921636 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d9b20-68c5-458a-b94c-875ba52d4b38 admin admin] PATH_INFO: `/v3/projects/56f1bb24056348a3bbce382962849421` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:18.922850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d9b20-68c5-458a-b94c-875ba52d4b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56f1bb24056348a3bbce382962849421)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:18.924767 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d9b20-68c5-458a-b94c-875ba52d4b38 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:18.949730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ce533-518a-43c4-b9e1-bb7a9ce9f738 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:18.951134 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-5e1ce533-518a-43c4-b9e1-bb7a9ce9f738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:18.974191 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7a6d9b20-68c5-458a-b94c-875ba52d4b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56f1bb24056348a3bbce382962849421', 'request_id': 'req-7a6d9b20-68c5-458a-b94c-875ba52d4b38'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:18.980067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7a6d9b20-68c5-458a-b94c-875ba52d4b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56f1bb24056348a3bbce382962849421', 'request_id': 'req-7a6d9b20-68c5-458a-b94c-875ba52d4b38'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:18.986148 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7a6d9b20-68c5-458a-b94c-875ba52d4b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56f1bb24056348a3bbce382962849421', 'request_id': 'req-7a6d9b20-68c5-458a-b94c-875ba52d4b38'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:18.999889 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7a6d9b20-68c5-458a-b94c-875ba52d4b38 admin admin] The token cache is being invalidate because project 56f1bb24056348a3bbce382962849421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:19.000179 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7a6d9b20-68c5-458a-b94c-875ba52d4b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:19.000799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-7a6d9b20-68c5-458a-b94c-875ba52d4b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:19.002592 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1380/2755] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:18 2022] DELETE /identity/v3/projects/56f1bb24056348a3bbce382962849421 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:19.007438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d9ac7-4c52-4cd3-861c-aa016f77bcbb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:19.007733 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d9ac7-4c52-4cd3-861c-aa016f77bcbb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:19.008016 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d9ac7-4c52-4cd3-861c-aa016f77bcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:19.010631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1ce533-518a-43c4-b9e1-bb7a9ce9f738 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:19.026559 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-8e3d9ac7-4c52-4cd3-861c-aa016f77bcbb None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:19.027717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-8e3d9ac7-4c52-4cd3-861c-aa016f77bcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:19.060888 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456560f-f258-4b86-b173-7b8a2a6c35ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:19.061636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456560f-f258-4b86-b173-7b8a2a6c35ce service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:19.061920 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456560f-f258-4b86-b173-7b8a2a6c35ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:19.062194 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456560f-f258-4b86-b173-7b8a2a6c35ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:19.070325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9456560f-f258-4b86-b173-7b8a2a6c35ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:19.097187 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1381/2756] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:19.105042 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462cf4e-462c-4ccb-aa41-87126ca0a5ed None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:19.105330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462cf4e-462c-4ccb-aa41-87126ca0a5ed None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:19.105642 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462cf4e-462c-4ccb-aa41-87126ca0a5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:19.123011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0462cf4e-462c-4ccb-aa41-87126ca0a5ed None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:19.124219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0462cf4e-462c-4ccb-aa41-87126ca0a5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:19.127600 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:19.134266 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1382/2757] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:45:19.138359 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462cf4e-462c-4ccb-aa41-87126ca0a5ed None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:19.141440 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456560f-f258-4b86-b173-7b8a2a6c35ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:19.142974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456560f-f258-4b86-b173-7b8a2a6c35ce service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:19.147470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462cf4e-462c-4ccb-aa41-87126ca0a5ed None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:19.152396 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350d6b9-e157-4256-a6a1-a2f06de62e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:19.153035 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350d6b9-e157-4256-a6a1-a2f06de62e92 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:19.153320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350d6b9-e157-4256-a6a1-a2f06de62e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:19.153646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350d6b9-e157-4256-a6a1-a2f06de62e92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:19.153768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1376/2758] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:19.154359 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350d6b9-e157-4256-a6a1-a2f06de62e92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:45:19.154695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350d6b9-e157-4256-a6a1-a2f06de62e92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:19.156308 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350d6b9-e157-4256-a6a1-a2f06de62e92 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:19.167961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1383/2759] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 15 00:45:19.172313 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456560f-f258-4b86-b173-7b8a2a6c35ce service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:19.183536 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456560f-f258-4b86-b173-7b8a2a6c35ce service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:19.188918 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272cbbb-715d-4daf-b16b-523ebc99b487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:19.189728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272cbbb-715d-4daf-b16b-523ebc99b487 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:19.190082 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272cbbb-715d-4daf-b16b-523ebc99b487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:19.190373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272cbbb-715d-4daf-b16b-523ebc99b487 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:19.191514 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272cbbb-715d-4daf-b16b-523ebc99b487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:19.193468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272cbbb-715d-4daf-b16b-523ebc99b487 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:19.221284 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1377/2760] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:19 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:19.225512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350d6b9-e157-4256-a6a1-a2f06de62e92 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:19.236249 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350d6b9-e157-4256-a6a1-a2f06de62e92 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:19.247504 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:19.295279 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95de0bc-a880-49ae-a8be-c2b532f131ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:19.295991 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95de0bc-a880-49ae-a8be-c2b532f131ff admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:19.296174 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95de0bc-a880-49ae-a8be-c2b532f131ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:19.296489 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95de0bc-a880-49ae-a8be-c2b532f131ff admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:19.297196 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95de0bc-a880-49ae-a8be-c2b532f131ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:19.299190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95de0bc-a880-49ae-a8be-c2b532f131ff admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:19.319080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1384/2761] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:19 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:19.323219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272cbbb-715d-4daf-b16b-523ebc99b487 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:19.334283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272cbbb-715d-4daf-b16b-523ebc99b487 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:19.339031 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a095d-8fd6-43d2-85e8-cef5e0a00d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:19.339673 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a095d-8fd6-43d2-85e8-cef5e0a00d43 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:19.339958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a095d-8fd6-43d2-85e8-cef5e0a00d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:19.340235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a095d-8fd6-43d2-85e8-cef5e0a00d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:19.340992 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a095d-8fd6-43d2-85e8-cef5e0a00d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:19.342738 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a095d-8fd6-43d2-85e8-cef5e0a00d43 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:19.356647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1378/2762] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:19.362206 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95de0bc-a880-49ae-a8be-c2b532f131ff admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:19.373293 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95de0bc-a880-49ae-a8be-c2b532f131ff admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:19.378762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c737a-ee4e-4f5f-a0aa-d51ffaab8307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:19.379537 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c737a-ee4e-4f5f-a0aa-d51ffaab8307 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:19.379824 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c737a-ee4e-4f5f-a0aa-d51ffaab8307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:19.380954 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c737a-ee4e-4f5f-a0aa-d51ffaab8307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:19.381739 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c737a-ee4e-4f5f-a0aa-d51ffaab8307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:19.383718 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c737a-ee4e-4f5f-a0aa-d51ffaab8307 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:19.396202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1385/2763] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:19.400724 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a095d-8fd6-43d2-85e8-cef5e0a00d43 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:19.413768 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a095d-8fd6-43d2-85e8-cef5e0a00d43 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:19.418498 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599694da-eb60-48d8-a19c-8e4a6e526712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:19.419397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599694da-eb60-48d8-a19c-8e4a6e526712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:19.419676 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599694da-eb60-48d8-a19c-8e4a6e526712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:19.419944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599694da-eb60-48d8-a19c-8e4a6e526712 admin admin] PATH_INFO: `/v3/projects/faf12599e4bb4a2b8f6059f2cb408f6d/users/4d9d07eff1e04728a72aca3e224ca0c3/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:19.436360 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599694da-eb60-48d8-a19c-8e4a6e526712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf12599e4bb4a2b8f6059f2cb408f6d, user_id=4d9d07eff1e04728a72aca3e224ca0c3, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:19.439049 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599694da-eb60-48d8-a19c-8e4a6e526712 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:19.463076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1379/2764] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:19 2022] PUT /identity/v3/projects/faf12599e4bb4a2b8f6059f2cb408f6d/users/4d9d07eff1e04728a72aca3e224ca0c3/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:19.473955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393a3cf-5325-42f3-a648-161701d8d53e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:19.474343 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393a3cf-5325-42f3-a648-161701d8d53e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:19.474692 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393a3cf-5325-42f3-a648-161701d8d53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:19.501135 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-5393a3cf-5325-42f3-a648-161701d8d53e None None] MFA Rules not processed for user `4d9d07eff1e04728a72aca3e224ca0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:19.502482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-5393a3cf-5325-42f3-a648-161701d8d53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:19.568459 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1386/2765] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:45:19.574511 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599694da-eb60-48d8-a19c-8e4a6e526712 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:19.638941 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599694da-eb60-48d8-a19c-8e4a6e526712 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:19.644959 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9e160-5ee4-4415-ac30-df82f1ceef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:19.645666 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9e160-5ee4-4415-ac30-df82f1ceef81 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:19.645952 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9e160-5ee4-4415-ac30-df82f1ceef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:19.646233 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9e160-5ee4-4415-ac30-df82f1ceef81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:19.646950 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9e160-5ee4-4415-ac30-df82f1ceef81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:19.648875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9e160-5ee4-4415-ac30-df82f1ceef81 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:19.676221 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1380/2766] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:19 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:45:19.680547 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393a3cf-5325-42f3-a648-161701d8d53e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:19.691662 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393a3cf-5325-42f3-a648-161701d8d53e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:19.750416 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8436f-c082-4622-bdf5-761975b34225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:19.751109 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8436f-c082-4622-bdf5-761975b34225 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:19.751394 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8436f-c082-4622-bdf5-761975b34225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:19.751670 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8436f-c082-4622-bdf5-761975b34225 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:19.752357 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8436f-c082-4622-bdf5-761975b34225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:19.754311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8436f-c082-4622-bdf5-761975b34225 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:19.775488 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1387/2767] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:19 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:19.779610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9e160-5ee4-4415-ac30-df82f1ceef81 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:19.790254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9e160-5ee4-4415-ac30-df82f1ceef81 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:19.795517 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afd5fd-722e-46b1-bd77-6fb1c2c5b57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:19.796215 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afd5fd-722e-46b1-bd77-6fb1c2c5b57d admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:19.796502 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afd5fd-722e-46b1-bd77-6fb1c2c5b57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:19.796778 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afd5fd-722e-46b1-bd77-6fb1c2c5b57d admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:19.797576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afd5fd-722e-46b1-bd77-6fb1c2c5b57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:19.799652 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1afd5fd-722e-46b1-bd77-6fb1c2c5b57d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:19.813202 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1381/2768] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:19.817774 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8436f-c082-4622-bdf5-761975b34225 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:19.831933 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8436f-c082-4622-bdf5-761975b34225 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:19.837874 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93d704-b7ca-42c8-9387-9346ae334638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:19.838777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93d704-b7ca-42c8-9387-9346ae334638 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:19.839084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93d704-b7ca-42c8-9387-9346ae334638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:19.839361 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93d704-b7ca-42c8-9387-9346ae334638 admin admin] PATH_INFO: `/v3/projects/6b022336060f43978dcab6fe05da1b92/users/f21fd119db3944a2b43ea65a2bd599a7/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:19.851102 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:19.856408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93d704-b7ca-42c8-9387-9346ae334638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b022336060f43978dcab6fe05da1b92, user_id=f21fd119db3944a2b43ea65a2bd599a7, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:19.859164 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93d704-b7ca-42c8-9387-9346ae334638 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:19.874467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1388/2769] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:19 2022] PUT /identity/v3/projects/6b022336060f43978dcab6fe05da1b92/users/f21fd119db3944a2b43ea65a2bd599a7/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:19.878481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afd5fd-722e-46b1-bd77-6fb1c2c5b57d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:19.888653 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afd5fd-722e-46b1-bd77-6fb1c2c5b57d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:19.948329 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2263f2-fc9d-4594-a9d9-b0507587b5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:19.949015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2263f2-fc9d-4594-a9d9-b0507587b5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:19.949299 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2263f2-fc9d-4594-a9d9-b0507587b5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:19.949605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2263f2-fc9d-4594-a9d9-b0507587b5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:19.950342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2263f2-fc9d-4594-a9d9-b0507587b5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:19.951944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2263f2-fc9d-4594-a9d9-b0507587b5d5 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:19.962013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1382/2770] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:19.966403 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93d704-b7ca-42c8-9387-9346ae334638 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:19.978170 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93d704-b7ca-42c8-9387-9346ae334638 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:19.983735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece467a-4d4d-42cb-b1af-ae84329f584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:19.984639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece467a-4d4d-42cb-b1af-ae84329f584b admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:19.984934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece467a-4d4d-42cb-b1af-ae84329f584b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:19.985209 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece467a-4d4d-42cb-b1af-ae84329f584b admin admin] PATH_INFO: `/v3/projects/6b022336060f43978dcab6fe05da1b92/users/f21fd119db3944a2b43ea65a2bd599a7/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:19.987472 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece467a-4d4d-42cb-b1af-ae84329f584b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b022336060f43978dcab6fe05da1b92, user_id=f21fd119db3944a2b43ea65a2bd599a7, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:19.990202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece467a-4d4d-42cb-b1af-ae84329f584b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:20.000596 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1389/2771] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:19 2022] PUT /identity/v3/projects/6b022336060f43978dcab6fe05da1b92/users/f21fd119db3944a2b43ea65a2bd599a7/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:20.012331 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fee582-f333-4f15-a576-008b140f9a92 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:20.012624 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fee582-f333-4f15-a576-008b140f9a92 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:20.012905 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fee582-f333-4f15-a576-008b140f9a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:20.019785 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:20.041150 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-29fee582-f333-4f15-a576-008b140f9a92 None None] MFA Rules not processed for user `f21fd119db3944a2b43ea65a2bd599a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:20.042415 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-29fee582-f333-4f15-a576-008b140f9a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:20.112422 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1383/2772] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:45:20.127372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece467a-4d4d-42cb-b1af-ae84329f584b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:20.129303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-aece467a-4d4d-42cb-b1af-ae84329f584b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:20.188807 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece467a-4d4d-42cb-b1af-ae84329f584b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:20.192837 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321811f-cc45-428f-a9da-d0350b541cf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:20.193516 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321811f-cc45-428f-a9da-d0350b541cf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:20.193802 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321811f-cc45-428f-a9da-d0350b541cf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:20.194082 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321811f-cc45-428f-a9da-d0350b541cf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:20.204433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321811f-cc45-428f-a9da-d0350b541cf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:20.205912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321811f-cc45-428f-a9da-d0350b541cf3 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:20.215645 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1390/2773] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:20.298179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fee582-f333-4f15-a576-008b140f9a92 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:20.308632 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fee582-f333-4f15-a576-008b140f9a92 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:20.313044 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f84465-9c0c-436e-be98-ec968dd638cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:20.313723 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f84465-9c0c-436e-be98-ec968dd638cc service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:20.314005 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f84465-9c0c-436e-be98-ec968dd638cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:20.314272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f84465-9c0c-436e-be98-ec968dd638cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:20.374877 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f84465-9c0c-436e-be98-ec968dd638cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:20.376251 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f84465-9c0c-436e-be98-ec968dd638cc service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:20.385616 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1384/2774] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:24.051010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321811f-cc45-428f-a9da-d0350b541cf3 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:24.052690 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-1321811f-cc45-428f-a9da-d0350b541cf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:24.121730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321811f-cc45-428f-a9da-d0350b541cf3 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:24.126863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea45be5-8346-4ab0-a98d-fe38462b7e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:24.127776 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea45be5-8346-4ab0-a98d-fe38462b7e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:24.128061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea45be5-8346-4ab0-a98d-fe38462b7e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:24.128335 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea45be5-8346-4ab0-a98d-fe38462b7e8f admin admin] PATH_INFO: `/v3/users/29b89ba59efd4fd9ad385b0a22782810` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:24.129669 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea45be5-8346-4ab0-a98d-fe38462b7e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b89ba59efd4fd9ad385b0a22782810)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:24.131662 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea45be5-8346-4ab0-a98d-fe38462b7e8f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:24.191384 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6ea45be5-8346-4ab0-a98d-fe38462b7e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b89ba59efd4fd9ad385b0a22782810'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:24.200937 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6ea45be5-8346-4ab0-a98d-fe38462b7e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b89ba59efd4fd9ad385b0a22782810'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:24.201691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6ea45be5-8346-4ab0-a98d-fe38462b7e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b89ba59efd4fd9ad385b0a22782810'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:24.202444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6ea45be5-8346-4ab0-a98d-fe38462b7e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b89ba59efd4fd9ad385b0a22782810'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:24.215503 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6ea45be5-8346-4ab0-a98d-fe38462b7e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b89ba59efd4fd9ad385b0a22782810'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:24.223986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:24.232558 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1391/2775] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:24 2022] DELETE /identity/v3/users/29b89ba59efd4fd9ad385b0a22782810 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:24.237530 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cdc63-4c16-4247-bbc9-583652ac1711 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:24.238208 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cdc63-4c16-4247-bbc9-583652ac1711 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:24.238534 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cdc63-4c16-4247-bbc9-583652ac1711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:24.258774 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-6f2cdc63-4c16-4247-bbc9-583652ac1711 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:24.259994 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6f2cdc63-4c16-4247-bbc9-583652ac1711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:24.320631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1385/2776] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:24.330534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea45be5-8346-4ab0-a98d-fe38462b7e8f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:24.332067 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6ea45be5-8346-4ab0-a98d-fe38462b7e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:24.392789 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea45be5-8346-4ab0-a98d-fe38462b7e8f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:24.397117 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac891ac-a4f4-4962-aa08-2be3126aeb74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:24.397808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac891ac-a4f4-4962-aa08-2be3126aeb74 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:24.398092 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac891ac-a4f4-4962-aa08-2be3126aeb74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:24.398372 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac891ac-a4f4-4962-aa08-2be3126aeb74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:24.408147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac891ac-a4f4-4962-aa08-2be3126aeb74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:24.409635 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac891ac-a4f4-4962-aa08-2be3126aeb74 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:24.419447 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1392/2777] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:24.717481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cdc63-4c16-4247-bbc9-583652ac1711 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:24.719055 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6f2cdc63-4c16-4247-bbc9-583652ac1711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:24.731857 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cdc63-4c16-4247-bbc9-583652ac1711 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:24.737383 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:24.738269 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:24.738559 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:24.738814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7 admin admin] PATH_INFO: `/v3/projects/5930879dedad433785300e8b0525cdf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:24.740090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5930879dedad433785300e8b0525cdf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:24.742048 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:24.774448 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:24.797732 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5930879dedad433785300e8b0525cdf3', 'request_id': 'req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:24.803717 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5930879dedad433785300e8b0525cdf3', 'request_id': 'req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:24.810380 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5930879dedad433785300e8b0525cdf3', 'request_id': 'req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:24.824909 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7 admin admin] The token cache is being invalidate because project 5930879dedad433785300e8b0525cdf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:24.825338 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:24.826321 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:24.827967 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1386/2778] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:24 2022] DELETE /identity/v3/projects/5930879dedad433785300e8b0525cdf3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:24.832288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac891ac-a4f4-4962-aa08-2be3126aeb74 service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:24.842646 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac891ac-a4f4-4962-aa08-2be3126aeb74 service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:24.900208 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85708166-1fa6-4a9e-a87b-2fffaafe6b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:24.901098 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708166-1fa6-4a9e-a87b-2fffaafe6b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:24.901380 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708166-1fa6-4a9e-a87b-2fffaafe6b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:24.901669 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85708166-1fa6-4a9e-a87b-2fffaafe6b01 admin admin] PATH_INFO: `/v3/users/eaabd5a30ba049cca8751308dfd0b441` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:24.902921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85708166-1fa6-4a9e-a87b-2fffaafe6b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaabd5a30ba049cca8751308dfd0b441)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:24.904941 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85708166-1fa6-4a9e-a87b-2fffaafe6b01 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:24.952521 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-85708166-1fa6-4a9e-a87b-2fffaafe6b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaabd5a30ba049cca8751308dfd0b441'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:24.959727 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-85708166-1fa6-4a9e-a87b-2fffaafe6b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaabd5a30ba049cca8751308dfd0b441'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:24.960473 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-85708166-1fa6-4a9e-a87b-2fffaafe6b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaabd5a30ba049cca8751308dfd0b441'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:24.961135 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-85708166-1fa6-4a9e-a87b-2fffaafe6b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaabd5a30ba049cca8751308dfd0b441'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:24.974662 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-85708166-1fa6-4a9e-a87b-2fffaafe6b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaabd5a30ba049cca8751308dfd0b441'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:24.988694 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1393/2779] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:24 2022] DELETE /identity/v3/users/eaabd5a30ba049cca8751308dfd0b441 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:25.136673 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:25.138426 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:25.152274 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2809c-67a7-4309-91f9-8fb3e6ddcba7 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:25.227232 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d048ba7-bf2e-4941-911b-158884c01b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:25.228150 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d048ba7-bf2e-4941-911b-158884c01b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:25.228427 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d048ba7-bf2e-4941-911b-158884c01b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:25.228702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d048ba7-bf2e-4941-911b-158884c01b04 admin admin] PATH_INFO: `/v3/users/4d9d07eff1e04728a72aca3e224ca0c3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:25.230065 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d048ba7-bf2e-4941-911b-158884c01b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d9d07eff1e04728a72aca3e224ca0c3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:25.232029 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d048ba7-bf2e-4941-911b-158884c01b04 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:25.295480 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3d048ba7-bf2e-4941-911b-158884c01b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d9d07eff1e04728a72aca3e224ca0c3'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:25.306327 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3d048ba7-bf2e-4941-911b-158884c01b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d9d07eff1e04728a72aca3e224ca0c3'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:25.307015 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3d048ba7-bf2e-4941-911b-158884c01b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d9d07eff1e04728a72aca3e224ca0c3'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:25.307703 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3d048ba7-bf2e-4941-911b-158884c01b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d9d07eff1e04728a72aca3e224ca0c3'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:25.322437 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-3d048ba7-bf2e-4941-911b-158884c01b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d9d07eff1e04728a72aca3e224ca0c3'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:25.335778 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1387/2780] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:25 2022] DELETE /identity/v3/users/4d9d07eff1e04728a72aca3e224ca0c3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:25.340552 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9891ea2-8563-449f-b823-55c628d83ff1 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:25.341071 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9891ea2-8563-449f-b823-55c628d83ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:25.341197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9891ea2-8563-449f-b823-55c628d83ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:25.360955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-b9891ea2-8563-449f-b823-55c628d83ff1 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:25.362259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b9891ea2-8563-449f-b823-55c628d83ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:25.385219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:25.448001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1394/2781] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:25.457371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d048ba7-bf2e-4941-911b-158884c01b04 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:25.458912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-3d048ba7-bf2e-4941-911b-158884c01b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:25.496722 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:25.529576 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d048ba7-bf2e-4941-911b-158884c01b04 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:25.533890 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3f77d-a71b-4574-9c6d-a3382ffcbc1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:25.534846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3f77d-a71b-4574-9c6d-a3382ffcbc1f service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:25.535089 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3f77d-a71b-4574-9c6d-a3382ffcbc1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:25.535397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3f77d-a71b-4574-9c6d-a3382ffcbc1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:25.536197 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9891ea2-8563-449f-b823-55c628d83ff1 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:25.537909 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-b9891ea2-8563-449f-b823-55c628d83ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:25.550363 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9891ea2-8563-449f-b823-55c628d83ff1 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:25.551187 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3f77d-a71b-4574-9c6d-a3382ffcbc1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:25.553645 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3f77d-a71b-4574-9c6d-a3382ffcbc1f service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:25.555221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983c080-f4fd-4348-b9cc-3d3a39457c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:25.556045 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983c080-f4fd-4348-b9cc-3d3a39457c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:25.556393 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983c080-f4fd-4348-b9cc-3d3a39457c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:25.556618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983c080-f4fd-4348-b9cc-3d3a39457c19 admin admin] PATH_INFO: `/v3/projects/258e9a4f8a634bb788b9d488cc63f8f6` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:25.557862 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983c080-f4fd-4348-b9cc-3d3a39457c19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=258e9a4f8a634bb788b9d488cc63f8f6)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:25.559806 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983c080-f4fd-4348-b9cc-3d3a39457c19 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:25.567026 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1388/2782] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:25.609406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8983c080-f4fd-4348-b9cc-3d3a39457c19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258e9a4f8a634bb788b9d488cc63f8f6', 'request_id': 'req-8983c080-f4fd-4348-b9cc-3d3a39457c19'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:25.614942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8983c080-f4fd-4348-b9cc-3d3a39457c19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258e9a4f8a634bb788b9d488cc63f8f6', 'request_id': 'req-8983c080-f4fd-4348-b9cc-3d3a39457c19'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:25.622705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8983c080-f4fd-4348-b9cc-3d3a39457c19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258e9a4f8a634bb788b9d488cc63f8f6', 'request_id': 'req-8983c080-f4fd-4348-b9cc-3d3a39457c19'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:25.641859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8983c080-f4fd-4348-b9cc-3d3a39457c19 admin admin] The token cache is being invalidate because project 258e9a4f8a634bb788b9d488cc63f8f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:25.642352 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8983c080-f4fd-4348-b9cc-3d3a39457c19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:25.643080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-8983c080-f4fd-4348-b9cc-3d3a39457c19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:25.644793 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1395/2783] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:25 2022] DELETE /identity/v3/projects/258e9a4f8a634bb788b9d488cc63f8f6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:25.651572 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248811e3-3b68-4fa4-8b25-d0f4d1db8736 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:25.652038 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248811e3-3b68-4fa4-8b25-d0f4d1db8736 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:25.652357 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248811e3-3b68-4fa4-8b25-d0f4d1db8736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:25.670698 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-248811e3-3b68-4fa4-8b25-d0f4d1db8736 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:25.671961 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-248811e3-3b68-4fa4-8b25-d0f4d1db8736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:25.743628 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1389/2784] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:45:25.752024 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca256d-f329-4dc8-8f27-22154e9628a7 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:25.752311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca256d-f329-4dc8-8f27-22154e9628a7 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:25.752594 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca256d-f329-4dc8-8f27-22154e9628a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:25.771202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-52ca256d-f329-4dc8-8f27-22154e9628a7 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:25.772433 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-52ca256d-f329-4dc8-8f27-22154e9628a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:25.780865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1396/2785] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:25.784889 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248811e3-3b68-4fa4-8b25-d0f4d1db8736 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:25.795442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248811e3-3b68-4fa4-8b25-d0f4d1db8736 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:25.800225 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e133aed-304e-4c56-989d-2026a0af8a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:25.800892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e133aed-304e-4c56-989d-2026a0af8a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:25.801172 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e133aed-304e-4c56-989d-2026a0af8a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:25.801482 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e133aed-304e-4c56-989d-2026a0af8a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:25.802272 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e133aed-304e-4c56-989d-2026a0af8a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:45:25.802582 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e133aed-304e-4c56-989d-2026a0af8a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:25.804231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e133aed-304e-4c56-989d-2026a0af8a80 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:25.816035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1390/2786] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:45:25.820651 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca256d-f329-4dc8-8f27-22154e9628a7 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:25.829826 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca256d-f329-4dc8-8f27-22154e9628a7 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:25.834625 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58eae7-1ca7-468d-b136-b912f3a0ab6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:25.835352 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58eae7-1ca7-468d-b136-b912f3a0ab6b admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:25.835658 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58eae7-1ca7-468d-b136-b912f3a0ab6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:25.835905 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58eae7-1ca7-468d-b136-b912f3a0ab6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:25.836589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58eae7-1ca7-468d-b136-b912f3a0ab6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:25.838513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58eae7-1ca7-468d-b136-b912f3a0ab6b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:25.849860 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e133aed-304e-4c56-989d-2026a0af8a80 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:25.852557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1e133aed-304e-4c56-989d-2026a0af8a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:25.869395 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1397/2787] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:25 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:25.872942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58eae7-1ca7-468d-b136-b912f3a0ab6b admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:25.877365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e133aed-304e-4c56-989d-2026a0af8a80 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:25.934894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58eae7-1ca7-468d-b136-b912f3a0ab6b admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:25.938361 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cea931-56e7-4e58-802e-ede5f9d9c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:25.939404 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cea931-56e7-4e58-802e-ede5f9d9c96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:25.939755 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cea931-56e7-4e58-802e-ede5f9d9c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:25.940118 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cea931-56e7-4e58-802e-ede5f9d9c96a admin admin] PATH_INFO: `/v3/projects/faf12599e4bb4a2b8f6059f2cb408f6d` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:25.940273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d23ed-abeb-436d-a5b9-d3bf002a999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:25.941384 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cea931-56e7-4e58-802e-ede5f9d9c96a admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf12599e4bb4a2b8f6059f2cb408f6d)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:25.941497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d23ed-abeb-436d-a5b9-d3bf002a999f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:25.941785 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d23ed-abeb-436d-a5b9-d3bf002a999f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:25.941984 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d23ed-abeb-436d-a5b9-d3bf002a999f admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:25.942795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d23ed-abeb-436d-a5b9-d3bf002a999f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:25.943801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cea931-56e7-4e58-802e-ede5f9d9c96a admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:25.945227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d23ed-abeb-436d-a5b9-d3bf002a999f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:25.967270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1398/2788] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:25 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:45:25.971936 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d23ed-abeb-436d-a5b9-d3bf002a999f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:25.979746 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:25.984062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d23ed-abeb-436d-a5b9-d3bf002a999f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:25.993650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c0cea931-56e7-4e58-802e-ede5f9d9c96a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf12599e4bb4a2b8f6059f2cb408f6d', 'request_id': 'req-c0cea931-56e7-4e58-802e-ede5f9d9c96a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:25.999102 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c0cea931-56e7-4e58-802e-ede5f9d9c96a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf12599e4bb4a2b8f6059f2cb408f6d', 'request_id': 'req-c0cea931-56e7-4e58-802e-ede5f9d9c96a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:26.005607 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c0cea931-56e7-4e58-802e-ede5f9d9c96a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf12599e4bb4a2b8f6059f2cb408f6d', 'request_id': 'req-c0cea931-56e7-4e58-802e-ede5f9d9c96a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:26.007336 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:26.020104 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c0cea931-56e7-4e58-802e-ede5f9d9c96a admin admin] The token cache is being invalidate because project faf12599e4bb4a2b8f6059f2cb408f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:26.020396 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c0cea931-56e7-4e58-802e-ede5f9d9c96a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:26.021051 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-c0cea931-56e7-4e58-802e-ede5f9d9c96a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:26.022763 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1391/2789] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:25 2022] DELETE /identity/v3/projects/faf12599e4bb4a2b8f6059f2cb408f6d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:26.026625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cea931-56e7-4e58-802e-ede5f9d9c96a admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:26.028059 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c0cea931-56e7-4e58-802e-ede5f9d9c96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:26.049006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3220e-9f90-4496-bee2-931fdea0d502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:26.049891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3220e-9f90-4496-bee2-931fdea0d502 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:26.050288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3220e-9f90-4496-bee2-931fdea0d502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:26.050616 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3220e-9f90-4496-bee2-931fdea0d502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:26.051357 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3220e-9f90-4496-bee2-931fdea0d502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:26.053061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3220e-9f90-4496-bee2-931fdea0d502 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:26.064131 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1399/2790] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:45:26.067554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3220e-9f90-4496-bee2-931fdea0d502 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:26.069244 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-9de3220e-9f90-4496-bee2-931fdea0d502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:26.082612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3220e-9f90-4496-bee2-931fdea0d502 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:26.087742 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c1490-a0e4-44d9-86f7-83125f82ff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:26.088426 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c1490-a0e4-44d9-86f7-83125f82ff12 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:26.088713 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c1490-a0e4-44d9-86f7-83125f82ff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:26.088993 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c1490-a0e4-44d9-86f7-83125f82ff12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:26.089765 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c1490-a0e4-44d9-86f7-83125f82ff12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:26.091363 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c1490-a0e4-44d9-86f7-83125f82ff12 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:26.094112 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cea931-56e7-4e58-802e-ede5f9d9c96a admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:26.099813 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56e072-660d-41ce-903b-cfc7bfcc9f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:26.100841 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56e072-660d-41ce-903b-cfc7bfcc9f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:26.101138 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56e072-660d-41ce-903b-cfc7bfcc9f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:26.101439 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56e072-660d-41ce-903b-cfc7bfcc9f94 admin admin] PATH_INFO: `/v3/users/f21fd119db3944a2b43ea65a2bd599a7` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:26.101891 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1400/2791] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:45:26.105790 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56e072-660d-41ce-903b-cfc7bfcc9f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21fd119db3944a2b43ea65a2bd599a7)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:26.105931 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c1490-a0e4-44d9-86f7-83125f82ff12 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:26.107720 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56e072-660d-41ce-903b-cfc7bfcc9f94 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:26.115910 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c1490-a0e4-44d9-86f7-83125f82ff12 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:26.120822 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae3f70-19b6-4b63-8057-e3ef479884f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:26.121740 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae3f70-19b6-4b63-8057-e3ef479884f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:26.122026 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae3f70-19b6-4b63-8057-e3ef479884f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:26.122305 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae3f70-19b6-4b63-8057-e3ef479884f8 admin admin] PATH_INFO: `/v3/projects/9138a48abab64254ae7f3e8f16b281a7/users/0e3458d454d44d1c9d32cfe293d41e74/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:26.139507 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae3f70-19b6-4b63-8057-e3ef479884f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9138a48abab64254ae7f3e8f16b281a7, user_id=0e3458d454d44d1c9d32cfe293d41e74, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:26.142431 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae3f70-19b6-4b63-8057-e3ef479884f8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:26.157271 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1401/2792] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:26 2022] PUT /identity/v3/projects/9138a48abab64254ae7f3e8f16b281a7/users/0e3458d454d44d1c9d32cfe293d41e74/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:45:26.158990 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2e56e072-660d-41ce-903b-cfc7bfcc9f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21fd119db3944a2b43ea65a2bd599a7'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:26.168063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2e56e072-660d-41ce-903b-cfc7bfcc9f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21fd119db3944a2b43ea65a2bd599a7'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:26.168788 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2e56e072-660d-41ce-903b-cfc7bfcc9f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21fd119db3944a2b43ea65a2bd599a7'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:26.169558 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2e56e072-660d-41ce-903b-cfc7bfcc9f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21fd119db3944a2b43ea65a2bd599a7'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:26.184801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-2e56e072-660d-41ce-903b-cfc7bfcc9f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21fd119db3944a2b43ea65a2bd599a7'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:26.199838 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1392/2793] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:26 2022] DELETE /identity/v3/users/f21fd119db3944a2b43ea65a2bd599a7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:45:26.223353 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea8bfc-1b70-45ee-b660-1abfe39a70da None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:26.223717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea8bfc-1b70-45ee-b660-1abfe39a70da None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:26.224117 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea8bfc-1b70-45ee-b660-1abfe39a70da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:26.252492 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-f5ea8bfc-1b70-45ee-b660-1abfe39a70da None None] MFA Rules not processed for user `0e3458d454d44d1c9d32cfe293d41e74`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:26.253908 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f5ea8bfc-1b70-45ee-b660-1abfe39a70da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:26.326460 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1402/2794] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:26.337185 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56e072-660d-41ce-903b-cfc7bfcc9f94 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:26.339140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-2e56e072-660d-41ce-903b-cfc7bfcc9f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:26.406049 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56e072-660d-41ce-903b-cfc7bfcc9f94 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:26.409696 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9cfd4-7756-408e-bf2f-7022886fbd79 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a239897b9a0644ef9d2e0e2e333232fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:26.410393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9cfd4-7756-408e-bf2f-7022886fbd79 service glance] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:26.410685 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9cfd4-7756-408e-bf2f-7022886fbd79 service glance] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:26.410996 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9cfd4-7756-408e-bf2f-7022886fbd79 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:26.420185 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9cfd4-7756-408e-bf2f-7022886fbd79 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:26.421686 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9cfd4-7756-408e-bf2f-7022886fbd79 service glance] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:26.431386 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1393/2795] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:26.483871 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea8bfc-1b70-45ee-b660-1abfe39a70da None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:26.485606 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f5ea8bfc-1b70-45ee-b660-1abfe39a70da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:26.556719 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:26.562934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea8bfc-1b70-45ee-b660-1abfe39a70da None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:26.568283 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b09c9-286b-45c8-815c-52789c09af55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:26.569297 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b09c9-286b-45c8-815c-52789c09af55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:26.569614 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b09c9-286b-45c8-815c-52789c09af55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:26.569893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b09c9-286b-45c8-815c-52789c09af55 admin admin] PATH_INFO: `/v3/projects/6b022336060f43978dcab6fe05da1b92` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:26.571090 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b09c9-286b-45c8-815c-52789c09af55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b022336060f43978dcab6fe05da1b92)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:26.573011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b09c9-286b-45c8-815c-52789c09af55 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:26.619643 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-303b09c9-286b-45c8-815c-52789c09af55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b022336060f43978dcab6fe05da1b92', 'request_id': 'req-303b09c9-286b-45c8-815c-52789c09af55'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:26.625461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-303b09c9-286b-45c8-815c-52789c09af55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b022336060f43978dcab6fe05da1b92', 'request_id': 'req-303b09c9-286b-45c8-815c-52789c09af55'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:26.632006 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-303b09c9-286b-45c8-815c-52789c09af55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b022336060f43978dcab6fe05da1b92', 'request_id': 'req-303b09c9-286b-45c8-815c-52789c09af55'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:26.647430 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-303b09c9-286b-45c8-815c-52789c09af55 admin admin] The token cache is being invalidate because project 6b022336060f43978dcab6fe05da1b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:26.647713 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-303b09c9-286b-45c8-815c-52789c09af55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:26.648513 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-303b09c9-286b-45c8-815c-52789c09af55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:26.650133 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1403/2796] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:26 2022] DELETE /identity/v3/projects/6b022336060f43978dcab6fe05da1b92 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:26.655677 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0226b9e-f33a-4d2d-bf73-675d7c7430a4 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:26.656050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0226b9e-f33a-4d2d-bf73-675d7c7430a4 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:26.656488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0226b9e-f33a-4d2d-bf73-675d7c7430a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:26.676060 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b0226b9e-f33a-4d2d-bf73-675d7c7430a4 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:26.677268 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b0226b9e-f33a-4d2d-bf73-675d7c7430a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:26.686468 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:26.745810 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1394/2797] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:45:26.754008 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842c2e8-bff1-4f22-9212-2a95ebd7a752 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:26.754306 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842c2e8-bff1-4f22-9212-2a95ebd7a752 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:26.754619 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842c2e8-bff1-4f22-9212-2a95ebd7a752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:26.774320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-c842c2e8-bff1-4f22-9212-2a95ebd7a752 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:26.775554 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-c842c2e8-bff1-4f22-9212-2a95ebd7a752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:26.785004 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1404/2798] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:26.789694 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0226b9e-f33a-4d2d-bf73-675d7c7430a4 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:26.799570 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0226b9e-f33a-4d2d-bf73-675d7c7430a4 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:26.805515 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3990d82-740d-4a99-a299-353da455e27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:26.806696 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3990d82-740d-4a99-a299-353da455e27f admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:26.807003 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3990d82-740d-4a99-a299-353da455e27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:26.807663 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3990d82-740d-4a99-a299-353da455e27f admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:26.808488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3990d82-740d-4a99-a299-353da455e27f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:45:26.808826 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3990d82-740d-4a99-a299-353da455e27f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:26.810604 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3990d82-740d-4a99-a299-353da455e27f admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:26.824554 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1395/2799] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:45:26.829199 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842c2e8-bff1-4f22-9212-2a95ebd7a752 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:26.840288 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842c2e8-bff1-4f22-9212-2a95ebd7a752 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:26.846315 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95271b95-5f6c-497b-aeed-7c341df8dbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:26.847021 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95271b95-5f6c-497b-aeed-7c341df8dbdb admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:26.847312 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95271b95-5f6c-497b-aeed-7c341df8dbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:26.847591 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95271b95-5f6c-497b-aeed-7c341df8dbdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:26.848346 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95271b95-5f6c-497b-aeed-7c341df8dbdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:26.850308 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95271b95-5f6c-497b-aeed-7c341df8dbdb admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:26.881320 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1405/2800] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:26 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:26.883423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3990d82-740d-4a99-a299-353da455e27f admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:26.895367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3990d82-740d-4a99-a299-353da455e27f admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:26.963297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc8a47-0dab-4335-89a8-aab0614f4bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:26.964049 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc8a47-0dab-4335-89a8-aab0614f4bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:26.964339 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc8a47-0dab-4335-89a8-aab0614f4bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:26.964620 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc8a47-0dab-4335-89a8-aab0614f4bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:26.965317 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc8a47-0dab-4335-89a8-aab0614f4bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:26.967317 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc8a47-0dab-4335-89a8-aab0614f4bd6 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:26.988565 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1396/2801] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:26 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:26.993044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95271b95-5f6c-497b-aeed-7c341df8dbdb admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:27.003406 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95271b95-5f6c-497b-aeed-7c341df8dbdb admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:27.008027 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6aeb2-28da-4a34-ae18-3f5ae0e8fc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:27.008689 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6aeb2-28da-4a34-ae18-3f5ae0e8fc03 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:27.008972 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6aeb2-28da-4a34-ae18-3f5ae0e8fc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:27.009247 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6aeb2-28da-4a34-ae18-3f5ae0e8fc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:27.010050 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6aeb2-28da-4a34-ae18-3f5ae0e8fc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:27.011636 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6aeb2-28da-4a34-ae18-3f5ae0e8fc03 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:27.022342 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1406/2802] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:27.026497 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc8a47-0dab-4335-89a8-aab0614f4bd6 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:27.036852 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc8a47-0dab-4335-89a8-aab0614f4bd6 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:27.041647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d387ae-7b66-4caf-9852-b50404da0d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:27.042327 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d387ae-7b66-4caf-9852-b50404da0d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:27.042617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d387ae-7b66-4caf-9852-b50404da0d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:27.042896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d387ae-7b66-4caf-9852-b50404da0d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:27.043648 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d387ae-7b66-4caf-9852-b50404da0d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:27.045486 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d387ae-7b66-4caf-9852-b50404da0d2d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:27.055846 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1397/2803] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:27.060262 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6aeb2-28da-4a34-ae18-3f5ae0e8fc03 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:27.071187 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6aeb2-28da-4a34-ae18-3f5ae0e8fc03 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:27.076018 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff46b6-9c60-4fa1-b634-58df73e01c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:27.076980 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff46b6-9c60-4fa1-b634-58df73e01c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:27.077245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff46b6-9c60-4fa1-b634-58df73e01c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:27.077567 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff46b6-9c60-4fa1-b634-58df73e01c7c admin admin] PATH_INFO: `/v3/projects/8b435914368a46b7bdfb0cbdeb81e7a0/users/ef6581b213174bad9ed86b41ca192bcf/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:27.092552 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff46b6-9c60-4fa1-b634-58df73e01c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b435914368a46b7bdfb0cbdeb81e7a0, user_id=ef6581b213174bad9ed86b41ca192bcf, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:27.095490 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff46b6-9c60-4fa1-b634-58df73e01c7c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:27.108880 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1407/2804] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:27 2022] PUT /identity/v3/projects/8b435914368a46b7bdfb0cbdeb81e7a0/users/ef6581b213174bad9ed86b41ca192bcf/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:27.120023 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a304ee-a75b-4c6c-a617-b76766fde0f1 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:27.120324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a304ee-a75b-4c6c-a617-b76766fde0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:27.120670 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a304ee-a75b-4c6c-a617-b76766fde0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:27.153630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-b6a304ee-a75b-4c6c-a617-b76766fde0f1 None None] MFA Rules not processed for user `ef6581b213174bad9ed86b41ca192bcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:27.154907 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b6a304ee-a75b-4c6c-a617-b76766fde0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:27.225362 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1398/2805] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:27.229887 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff46b6-9c60-4fa1-b634-58df73e01c7c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:27.294333 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff46b6-9c60-4fa1-b634-58df73e01c7c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:27.299330 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6f1c2-174a-4928-adf3-027b1a496fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:27.300013 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6f1c2-174a-4928-adf3-027b1a496fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:27.300300 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6f1c2-174a-4928-adf3-027b1a496fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:27.300604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6f1c2-174a-4928-adf3-027b1a496fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:27.301311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6f1c2-174a-4928-adf3-027b1a496fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:27.303605 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6f1c2-174a-4928-adf3-027b1a496fa6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:27.331628 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1408/2806] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:27 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:45:27.336143 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a304ee-a75b-4c6c-a617-b76766fde0f1 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:27.348924 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a304ee-a75b-4c6c-a617-b76766fde0f1 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:27.353826 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:27.417191 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2185e-9097-48a2-8af1-b13508006789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:27.417895 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2185e-9097-48a2-8af1-b13508006789 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:27.418180 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2185e-9097-48a2-8af1-b13508006789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:27.418441 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2185e-9097-48a2-8af1-b13508006789 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:27.419179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2185e-9097-48a2-8af1-b13508006789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:27.421092 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2185e-9097-48a2-8af1-b13508006789 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:27.443772 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1399/2807] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:27 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:27.447788 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6f1c2-174a-4928-adf3-027b1a496fa6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:27.458751 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6f1c2-174a-4928-adf3-027b1a496fa6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:27.464267 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f86eec-5361-48ae-b0c4-a3dc27a7e69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:27.465010 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f86eec-5361-48ae-b0c4-a3dc27a7e69d admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:27.465293 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f86eec-5361-48ae-b0c4-a3dc27a7e69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:27.465580 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f86eec-5361-48ae-b0c4-a3dc27a7e69d admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:27.466367 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f86eec-5361-48ae-b0c4-a3dc27a7e69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:27.468088 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f86eec-5361-48ae-b0c4-a3dc27a7e69d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:27.469853 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:27.482385 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1409/2808] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:27.486659 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2185e-9097-48a2-8af1-b13508006789 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:27.499635 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2185e-9097-48a2-8af1-b13508006789 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:27.509140 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5740482-0ec7-42d4-b35b-33673283919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:27.510142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5740482-0ec7-42d4-b35b-33673283919e admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:27.510483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5740482-0ec7-42d4-b35b-33673283919e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:27.510803 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5740482-0ec7-42d4-b35b-33673283919e admin admin] PATH_INFO: `/v3/projects/4aa6064966a44df282fd660c95a62b5d/users/5ceba7e5adf64e8387131f8d87f3d0c3/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:27.529286 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5740482-0ec7-42d4-b35b-33673283919e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa6064966a44df282fd660c95a62b5d, user_id=5ceba7e5adf64e8387131f8d87f3d0c3, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:27.531972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5740482-0ec7-42d4-b35b-33673283919e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:27.554928 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1400/2809] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:27 2022] PUT /identity/v3/projects/4aa6064966a44df282fd660c95a62b5d/users/5ceba7e5adf64e8387131f8d87f3d0c3/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:45:27.559142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f86eec-5361-48ae-b0c4-a3dc27a7e69d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:27.570315 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f86eec-5361-48ae-b0c4-a3dc27a7e69d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:27.631338 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13083c-c1d3-4bb1-9e2e-589fa7c27629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:27.631934 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13083c-c1d3-4bb1-9e2e-589fa7c27629 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:27.632232 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13083c-c1d3-4bb1-9e2e-589fa7c27629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:27.632499 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13083c-c1d3-4bb1-9e2e-589fa7c27629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:27.633259 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13083c-c1d3-4bb1-9e2e-589fa7c27629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:27.635002 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13083c-c1d3-4bb1-9e2e-589fa7c27629 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:27.645961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1410/2810] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:27.652393 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5740482-0ec7-42d4-b35b-33673283919e admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:27.669158 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5740482-0ec7-42d4-b35b-33673283919e admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:27.676110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80446e9-21f4-493a-9283-5b8f21c0d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:27.677094 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80446e9-21f4-493a-9283-5b8f21c0d2ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:27.677442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80446e9-21f4-493a-9283-5b8f21c0d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:27.677728 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80446e9-21f4-493a-9283-5b8f21c0d2ad admin admin] PATH_INFO: `/v3/projects/4aa6064966a44df282fd660c95a62b5d/users/5ceba7e5adf64e8387131f8d87f3d0c3/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:27.680011 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80446e9-21f4-493a-9283-5b8f21c0d2ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa6064966a44df282fd660c95a62b5d, user_id=5ceba7e5adf64e8387131f8d87f3d0c3, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:27.682758 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80446e9-21f4-493a-9283-5b8f21c0d2ad admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:27.694195 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1401/2811] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:27 2022] PUT /identity/v3/projects/4aa6064966a44df282fd660c95a62b5d/users/5ceba7e5adf64e8387131f8d87f3d0c3/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:45:27.760007 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf680cc1-c96f-447a-bc35-26d889b93f53 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:27.760301 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf680cc1-c96f-447a-bc35-26d889b93f53 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:27.760882 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf680cc1-c96f-447a-bc35-26d889b93f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:27.798126 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-cf680cc1-c96f-447a-bc35-26d889b93f53 None None] MFA Rules not processed for user `5ceba7e5adf64e8387131f8d87f3d0c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:27.799382 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cf680cc1-c96f-447a-bc35-26d889b93f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:27.879114 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1411/2812] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:27.891381 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80446e9-21f4-493a-9283-5b8f21c0d2ad admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:27.893457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e80446e9-21f4-493a-9283-5b8f21c0d2ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:27.961488 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80446e9-21f4-493a-9283-5b8f21c0d2ad admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:27.965630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881201c-72ca-48de-bf0a-a83fc5a1ffb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:27.966313 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881201c-72ca-48de-bf0a-a83fc5a1ffb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:27.966571 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881201c-72ca-48de-bf0a-a83fc5a1ffb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:27.966845 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881201c-72ca-48de-bf0a-a83fc5a1ffb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:27.976875 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881201c-72ca-48de-bf0a-a83fc5a1ffb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:27.978373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881201c-72ca-48de-bf0a-a83fc5a1ffb5 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:27.987822 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1402/2813] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:28.396524 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf680cc1-c96f-447a-bc35-26d889b93f53 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:28.471542 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf680cc1-c96f-447a-bc35-26d889b93f53 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:28.477298 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c97f2f-5d18-4624-bfaf-dbdd816a9bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:28.478236 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c97f2f-5d18-4624-bfaf-dbdd816a9bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:28.478523 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c97f2f-5d18-4624-bfaf-dbdd816a9bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:28.478801 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c97f2f-5d18-4624-bfaf-dbdd816a9bb3 admin admin] PATH_INFO: `/v3/users/ef6581b213174bad9ed86b41ca192bcf` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:28.480116 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c97f2f-5d18-4624-bfaf-dbdd816a9bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6581b213174bad9ed86b41ca192bcf)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:28.482123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c97f2f-5d18-4624-bfaf-dbdd816a9bb3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:28.503186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:28.535520 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a2c97f2f-5d18-4624-bfaf-dbdd816a9bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6581b213174bad9ed86b41ca192bcf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:28.546316 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a2c97f2f-5d18-4624-bfaf-dbdd816a9bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6581b213174bad9ed86b41ca192bcf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:28.547355 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a2c97f2f-5d18-4624-bfaf-dbdd816a9bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6581b213174bad9ed86b41ca192bcf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:28.548134 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a2c97f2f-5d18-4624-bfaf-dbdd816a9bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6581b213174bad9ed86b41ca192bcf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:28.564287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-a2c97f2f-5d18-4624-bfaf-dbdd816a9bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6581b213174bad9ed86b41ca192bcf'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:28.578797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1412/2814] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:28 2022] DELETE /identity/v3/users/ef6581b213174bad9ed86b41ca192bcf => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:28.583684 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c143dcc-baf2-418d-8648-95067d5b2651 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:28.584156 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c143dcc-baf2-418d-8648-95067d5b2651 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:28.584276 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c143dcc-baf2-418d-8648-95067d5b2651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:28.602908 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-1c143dcc-baf2-418d-8648-95067d5b2651 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:28.604127 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1c143dcc-baf2-418d-8648-95067d5b2651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:28.675795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1403/2815] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:28.685860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c97f2f-5d18-4624-bfaf-dbdd816a9bb3 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:28.687374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-a2c97f2f-5d18-4624-bfaf-dbdd816a9bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:28.750082 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c97f2f-5d18-4624-bfaf-dbdd816a9bb3 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:28.754863 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33815f6d-200c-4a92-9825-83030d6d7cff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:28.755524 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815f6d-200c-4a92-9825-83030d6d7cff service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:28.755818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815f6d-200c-4a92-9825-83030d6d7cff service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:28.756097 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33815f6d-200c-4a92-9825-83030d6d7cff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:28.771915 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33815f6d-200c-4a92-9825-83030d6d7cff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:28.773405 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33815f6d-200c-4a92-9825-83030d6d7cff service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:28.789363 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1413/2816] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:29.084018 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c143dcc-baf2-418d-8648-95067d5b2651 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:29.085836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-1c143dcc-baf2-418d-8648-95067d5b2651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:29.094490 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:29.098681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c143dcc-baf2-418d-8648-95067d5b2651 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:29.104773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:29.105809 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:29.106097 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:29.106376 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de admin admin] PATH_INFO: `/v3/projects/8b435914368a46b7bdfb0cbdeb81e7a0` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:29.107605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b435914368a46b7bdfb0cbdeb81e7a0)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:29.109552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:29.157397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b435914368a46b7bdfb0cbdeb81e7a0', 'request_id': 'req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:29.162958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b435914368a46b7bdfb0cbdeb81e7a0', 'request_id': 'req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:29.170641 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b435914368a46b7bdfb0cbdeb81e7a0', 'request_id': 'req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:29.191734 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de admin admin] The token cache is being invalidate because project 8b435914368a46b7bdfb0cbdeb81e7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:29.192076 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:29.193142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:29.195142 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1404/2817] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:29 2022] DELETE /identity/v3/projects/8b435914368a46b7bdfb0cbdeb81e7a0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:29.199315 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33815f6d-200c-4a92-9825-83030d6d7cff service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:29.209595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33815f6d-200c-4a92-9825-83030d6d7cff service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:29.270237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa9966-deb4-4f39-b079-e5070f4ed44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:29.271484 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa9966-deb4-4f39-b079-e5070f4ed44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:29.271931 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa9966-deb4-4f39-b079-e5070f4ed44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:29.272347 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa9966-deb4-4f39-b079-e5070f4ed44b admin admin] PATH_INFO: `/v3/users/5ceba7e5adf64e8387131f8d87f3d0c3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:29.274157 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa9966-deb4-4f39-b079-e5070f4ed44b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ceba7e5adf64e8387131f8d87f3d0c3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:29.276112 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa9966-deb4-4f39-b079-e5070f4ed44b admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:29.321695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:29.327556 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-38aa9966-deb4-4f39-b079-e5070f4ed44b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ceba7e5adf64e8387131f8d87f3d0c3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:29.335602 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-38aa9966-deb4-4f39-b079-e5070f4ed44b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ceba7e5adf64e8387131f8d87f3d0c3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:29.336348 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-38aa9966-deb4-4f39-b079-e5070f4ed44b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ceba7e5adf64e8387131f8d87f3d0c3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:29.337040 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-38aa9966-deb4-4f39-b079-e5070f4ed44b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ceba7e5adf64e8387131f8d87f3d0c3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:29.349811 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-38aa9966-deb4-4f39-b079-e5070f4ed44b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ceba7e5adf64e8387131f8d87f3d0c3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:29.362408 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1414/2818] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:29 2022] DELETE /identity/v3/users/5ceba7e5adf64e8387131f8d87f3d0c3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:29.663692 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:29.665325 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:29.678874 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26a5b1-70eb-423d-ad8b-7bb72131c6de admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:29.741481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac5a69-8a6b-4430-aa59-8aa36ff22592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:29.742394 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac5a69-8a6b-4430-aa59-8aa36ff22592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:29.742666 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac5a69-8a6b-4430-aa59-8aa36ff22592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:29.742938 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac5a69-8a6b-4430-aa59-8aa36ff22592 admin admin] PATH_INFO: `/v3/projects/4aa6064966a44df282fd660c95a62b5d` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:29.744141 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac5a69-8a6b-4430-aa59-8aa36ff22592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa6064966a44df282fd660c95a62b5d)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:29.746099 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac5a69-8a6b-4430-aa59-8aa36ff22592 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:29.793999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-45ac5a69-8a6b-4430-aa59-8aa36ff22592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa6064966a44df282fd660c95a62b5d', 'request_id': 'req-45ac5a69-8a6b-4430-aa59-8aa36ff22592'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:29.800132 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-45ac5a69-8a6b-4430-aa59-8aa36ff22592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa6064966a44df282fd660c95a62b5d', 'request_id': 'req-45ac5a69-8a6b-4430-aa59-8aa36ff22592'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:29.806520 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-45ac5a69-8a6b-4430-aa59-8aa36ff22592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa6064966a44df282fd660c95a62b5d', 'request_id': 'req-45ac5a69-8a6b-4430-aa59-8aa36ff22592'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:29.827166 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-45ac5a69-8a6b-4430-aa59-8aa36ff22592 admin admin] The token cache is being invalidate because project 4aa6064966a44df282fd660c95a62b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:29.827475 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-45ac5a69-8a6b-4430-aa59-8aa36ff22592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:29.828257 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-45ac5a69-8a6b-4430-aa59-8aa36ff22592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:29.830283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1405/2819] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:29 2022] DELETE /identity/v3/projects/4aa6064966a44df282fd660c95a62b5d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:29.836914 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337f13b-2f35-4e38-bf9f-153dbcea3bcd None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:29.837412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337f13b-2f35-4e38-bf9f-153dbcea3bcd None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:29.837538 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337f13b-2f35-4e38-bf9f-153dbcea3bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:29.862588 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-0337f13b-2f35-4e38-bf9f-153dbcea3bcd None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:29.863857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-0337f13b-2f35-4e38-bf9f-153dbcea3bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:29.928667 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1415/2820] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:29.936922 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead86df-c618-453b-883d-57c1fcb187a3 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:29.937222 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead86df-c618-453b-883d-57c1fcb187a3 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:29.937527 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead86df-c618-453b-883d-57c1fcb187a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:29.958407 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-dead86df-c618-453b-883d-57c1fcb187a3 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:29.959636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-dead86df-c618-453b-883d-57c1fcb187a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:29.969302 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1406/2821] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:29.974794 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337f13b-2f35-4e38-bf9f-153dbcea3bcd None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:29.990512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337f13b-2f35-4e38-bf9f-153dbcea3bcd None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:29.999613 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8ae5b-6d6c-4c0a-9bb2-5a2730d012e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:30.000311 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8ae5b-6d6c-4c0a-9bb2-5a2730d012e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:30.000594 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8ae5b-6d6c-4c0a-9bb2-5a2730d012e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:30.000873 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8ae5b-6d6c-4c0a-9bb2-5a2730d012e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:30.002026 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8ae5b-6d6c-4c0a-9bb2-5a2730d012e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:45:30.002354 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8ae5b-6d6c-4c0a-9bb2-5a2730d012e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:30.004709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8ae5b-6d6c-4c0a-9bb2-5a2730d012e8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:30.018389 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1416/2822] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:45:30.022703 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead86df-c618-453b-883d-57c1fcb187a3 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:30.034318 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead86df-c618-453b-883d-57c1fcb187a3 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:30.040880 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3c564-4af9-495a-8c3d-0919b40719fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:30.041601 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3c564-4af9-495a-8c3d-0919b40719fe admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:30.041882 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3c564-4af9-495a-8c3d-0919b40719fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:30.042153 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3c564-4af9-495a-8c3d-0919b40719fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:30.042869 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3c564-4af9-495a-8c3d-0919b40719fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:30.044783 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3c564-4af9-495a-8c3d-0919b40719fe admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:30.056902 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:30.078765 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1407/2823] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:30 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:30.083147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8ae5b-6d6c-4c0a-9bb2-5a2730d012e8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:30.099640 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8ae5b-6d6c-4c0a-9bb2-5a2730d012e8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:30.160047 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196407c5-74f9-47e6-8148-c33712d83906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:30.160720 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196407c5-74f9-47e6-8148-c33712d83906 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:30.161073 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196407c5-74f9-47e6-8148-c33712d83906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:30.161561 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196407c5-74f9-47e6-8148-c33712d83906 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:30.162033 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196407c5-74f9-47e6-8148-c33712d83906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:30.164117 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196407c5-74f9-47e6-8148-c33712d83906 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:30.188717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1417/2824] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:30 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:30.193110 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3c564-4af9-495a-8c3d-0919b40719fe admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:30.204241 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3c564-4af9-495a-8c3d-0919b40719fe admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:30.212859 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8baff1-3e2b-4f9c-9305-94eff3438ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:30.213794 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8baff1-3e2b-4f9c-9305-94eff3438ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:30.214182 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8baff1-3e2b-4f9c-9305-94eff3438ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:30.214552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8baff1-3e2b-4f9c-9305-94eff3438ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:30.215566 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8baff1-3e2b-4f9c-9305-94eff3438ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:30.217941 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8baff1-3e2b-4f9c-9305-94eff3438ce4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:30.231508 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1408/2825] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:30.235624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196407c5-74f9-47e6-8148-c33712d83906 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:30.248307 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196407c5-74f9-47e6-8148-c33712d83906 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:30.255869 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0b5b2-4d9c-44b6-8976-4ccb1dceca53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:30.256748 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b5b2-4d9c-44b6-8976-4ccb1dceca53 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:30.257148 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b5b2-4d9c-44b6-8976-4ccb1dceca53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:30.257524 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b5b2-4d9c-44b6-8976-4ccb1dceca53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:30.258258 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0b5b2-4d9c-44b6-8976-4ccb1dceca53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:30.259872 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0b5b2-4d9c-44b6-8976-4ccb1dceca53 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:30.269818 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1418/2826] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:30.274943 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8baff1-3e2b-4f9c-9305-94eff3438ce4 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:30.292107 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8baff1-3e2b-4f9c-9305-94eff3438ce4 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:30.297919 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968439d-4eeb-4dc2-bd47-f9f1661849a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:30.298911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968439d-4eeb-4dc2-bd47-f9f1661849a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:30.299259 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968439d-4eeb-4dc2-bd47-f9f1661849a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:30.299703 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968439d-4eeb-4dc2-bd47-f9f1661849a9 admin admin] PATH_INFO: `/v3/projects/a20bfeb0158143079a58df9685bc2594/users/31dc205473554444947cb744ad2cafef/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:30.315586 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968439d-4eeb-4dc2-bd47-f9f1661849a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20bfeb0158143079a58df9685bc2594, user_id=31dc205473554444947cb744ad2cafef, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:30.318314 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968439d-4eeb-4dc2-bd47-f9f1661849a9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:30.335664 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1409/2827] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:30 2022] PUT /identity/v3/projects/a20bfeb0158143079a58df9685bc2594/users/31dc205473554444947cb744ad2cafef/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:30.341100 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97d93-1a0b-4f62-94cb-133fa7fd7707 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:30.341456 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97d93-1a0b-4f62-94cb-133fa7fd7707 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:30.341735 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97d93-1a0b-4f62-94cb-133fa7fd7707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:30.360563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-7eb97d93-1a0b-4f62-94cb-133fa7fd7707 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:30.361843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7eb97d93-1a0b-4f62-94cb-133fa7fd7707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:30.381713 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:30.430795 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1419/2828] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:30.442366 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968439d-4eeb-4dc2-bd47-f9f1661849a9 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:30.444729 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-7968439d-4eeb-4dc2-bd47-f9f1661849a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:30.509615 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968439d-4eeb-4dc2-bd47-f9f1661849a9 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:30.513545 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa5ed6-d40b-46a0-b256-069fded17c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:30.514197 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa5ed6-d40b-46a0-b256-069fded17c60 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:30.514478 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa5ed6-d40b-46a0-b256-069fded17c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:30.514756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa5ed6-d40b-46a0-b256-069fded17c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:30.524723 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa5ed6-d40b-46a0-b256-069fded17c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:30.526199 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa5ed6-d40b-46a0-b256-069fded17c60 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:30.535763 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1410/2829] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:34.673295 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6da04-40cd-4c93-8aea-2c98a0dcf7f0 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:34.673790 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6da04-40cd-4c93-8aea-2c98a0dcf7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:34.674195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6da04-40cd-4c93-8aea-2c98a0dcf7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:34.707108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-d8d6da04-40cd-4c93-8aea-2c98a0dcf7f0 None None] MFA Rules not processed for user `31dc205473554444947cb744ad2cafef`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:34.708426 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d8d6da04-40cd-4c93-8aea-2c98a0dcf7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:34.801303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1420/2830] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:34.806328 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa5ed6-d40b-46a0-b256-069fded17c60 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:34.816386 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa5ed6-d40b-46a0-b256-069fded17c60 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:34.821150 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cfe36-6760-4e61-9819-bb8caa439258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:34.821847 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cfe36-6760-4e61-9819-bb8caa439258 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:34.822136 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cfe36-6760-4e61-9819-bb8caa439258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:34.822416 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cfe36-6760-4e61-9819-bb8caa439258 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:34.823125 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cfe36-6760-4e61-9819-bb8caa439258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:34.825086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cfe36-6760-4e61-9819-bb8caa439258 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:34.865192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1411/2831] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:34 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:45:34.866438 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6da04-40cd-4c93-8aea-2c98a0dcf7f0 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:34.878392 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6da04-40cd-4c93-8aea-2c98a0dcf7f0 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:34.979044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8d3eb-b69f-4950-bb79-1184af679857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:34.979741 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8d3eb-b69f-4950-bb79-1184af679857 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:34.980061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8d3eb-b69f-4950-bb79-1184af679857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:34.980336 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8d3eb-b69f-4950-bb79-1184af679857 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:34.981190 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8d3eb-b69f-4950-bb79-1184af679857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:34.983231 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8d3eb-b69f-4950-bb79-1184af679857 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:35.005715 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1421/2832] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:34 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:35.010180 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cfe36-6760-4e61-9819-bb8caa439258 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:35.021434 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cfe36-6760-4e61-9819-bb8caa439258 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:35.029161 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f34351-b374-47f2-a5fd-c848cddc70fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:35.029911 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f34351-b374-47f2-a5fd-c848cddc70fd admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:35.030397 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f34351-b374-47f2-a5fd-c848cddc70fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:35.030683 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f34351-b374-47f2-a5fd-c848cddc70fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:35.031403 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f34351-b374-47f2-a5fd-c848cddc70fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:35.033036 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f34351-b374-47f2-a5fd-c848cddc70fd admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:35.046591 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1412/2833] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:35.050942 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8d3eb-b69f-4950-bb79-1184af679857 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:35.063708 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8d3eb-b69f-4950-bb79-1184af679857 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:35.069586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8807cb-86eb-4d78-8b93-7805e43a1966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:35.070848 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8807cb-86eb-4d78-8b93-7805e43a1966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:35.071264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8807cb-86eb-4d78-8b93-7805e43a1966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:35.071556 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8807cb-86eb-4d78-8b93-7805e43a1966 admin admin] PATH_INFO: `/v3/projects/1cee81a6c64d4c8da25c2e6ff423c0c4/users/80052f06d9bf488d948bb1c76c010984/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:35.093978 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8807cb-86eb-4d78-8b93-7805e43a1966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cee81a6c64d4c8da25c2e6ff423c0c4, user_id=80052f06d9bf488d948bb1c76c010984, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:35.096996 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8807cb-86eb-4d78-8b93-7805e43a1966 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:35.112355 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1422/2834] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:35 2022] PUT /identity/v3/projects/1cee81a6c64d4c8da25c2e6ff423c0c4/users/80052f06d9bf488d948bb1c76c010984/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 15 00:45:35.116423 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f34351-b374-47f2-a5fd-c848cddc70fd admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:35.127188 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f34351-b374-47f2-a5fd-c848cddc70fd admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:35.194887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb88c8a-827d-4b52-8a35-b7b126359555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:35.195630 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb88c8a-827d-4b52-8a35-b7b126359555 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:35.196051 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb88c8a-827d-4b52-8a35-b7b126359555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:35.196338 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb88c8a-827d-4b52-8a35-b7b126359555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:35.197087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb88c8a-827d-4b52-8a35-b7b126359555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:35.198753 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb88c8a-827d-4b52-8a35-b7b126359555 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:35.209369 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1413/2835] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:35.213912 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8807cb-86eb-4d78-8b93-7805e43a1966 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:35.225033 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8807cb-86eb-4d78-8b93-7805e43a1966 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:35.229859 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915bdf8-8c6c-46ee-b7c7-6dbc0027482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:35.230796 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915bdf8-8c6c-46ee-b7c7-6dbc0027482c admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:35.231083 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915bdf8-8c6c-46ee-b7c7-6dbc0027482c admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:35.231366 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915bdf8-8c6c-46ee-b7c7-6dbc0027482c admin admin] PATH_INFO: `/v3/projects/1cee81a6c64d4c8da25c2e6ff423c0c4/users/80052f06d9bf488d948bb1c76c010984/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:35.233610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915bdf8-8c6c-46ee-b7c7-6dbc0027482c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cee81a6c64d4c8da25c2e6ff423c0c4, user_id=80052f06d9bf488d948bb1c76c010984, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:35.236282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f915bdf8-8c6c-46ee-b7c7-6dbc0027482c admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:35.249066 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1423/2836] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:35 2022] PUT /identity/v3/projects/1cee81a6c64d4c8da25c2e6ff423c0c4/users/80052f06d9bf488d948bb1c76c010984/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:39.720813 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fca893-55a8-4fe3-ab3a-309577775aed None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:39.721368 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fca893-55a8-4fe3-ab3a-309577775aed None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:39.721486 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fca893-55a8-4fe3-ab3a-309577775aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:39.748248 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-d8fca893-55a8-4fe3-ab3a-309577775aed None None] MFA Rules not processed for user `80052f06d9bf488d948bb1c76c010984`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:39.749706 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-d8fca893-55a8-4fe3-ab3a-309577775aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:39.757941 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:39.827433 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1414/2837] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:39.846666 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915bdf8-8c6c-46ee-b7c7-6dbc0027482c admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:39.848705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f915bdf8-8c6c-46ee-b7c7-6dbc0027482c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:39.860392 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:39.939227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915bdf8-8c6c-46ee-b7c7-6dbc0027482c admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:39.947057 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6342b-8890-45a3-97b5-30483b15a234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:39.948188 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6342b-8890-45a3-97b5-30483b15a234 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:39.948710 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6342b-8890-45a3-97b5-30483b15a234 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:39.949211 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6342b-8890-45a3-97b5-30483b15a234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:40.035492 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6342b-8890-45a3-97b5-30483b15a234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:40.036856 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6342b-8890-45a3-97b5-30483b15a234 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:40.050009 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1424/2838] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:41.129936 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abd39d-e9cf-4947-8d01-c95da25cbc3d None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:41.130432 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abd39d-e9cf-4947-8d01-c95da25cbc3d None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:41.130551 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abd39d-e9cf-4947-8d01-c95da25cbc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:41.153947 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-22abd39d-e9cf-4947-8d01-c95da25cbc3d None None] MFA Rules not processed for user `31dc205473554444947cb744ad2cafef`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:41.155429 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-22abd39d-e9cf-4947-8d01-c95da25cbc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:41.162695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1415/2839] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:42.155409 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6342b-8890-45a3-97b5-30483b15a234 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:42.157093 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-3dd6342b-8890-45a3-97b5-30483b15a234 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:42.234586 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6342b-8890-45a3-97b5-30483b15a234 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:42.239664 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e655bb-efab-421d-871f-671ba3b3d6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:42.240589 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e655bb-efab-421d-871f-671ba3b3d6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:42.240873 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e655bb-efab-421d-871f-671ba3b3d6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:42.241147 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e655bb-efab-421d-871f-671ba3b3d6b6 admin admin] PATH_INFO: `/v3/users/0e3458d454d44d1c9d32cfe293d41e74` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:42.242456 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e655bb-efab-421d-871f-671ba3b3d6b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e3458d454d44d1c9d32cfe293d41e74)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:42.244548 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e655bb-efab-421d-871f-671ba3b3d6b6 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:42.301627 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:42.303404 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-89e655bb-efab-421d-871f-671ba3b3d6b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e3458d454d44d1c9d32cfe293d41e74'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:42.315195 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-89e655bb-efab-421d-871f-671ba3b3d6b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e3458d454d44d1c9d32cfe293d41e74'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:42.315955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-89e655bb-efab-421d-871f-671ba3b3d6b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e3458d454d44d1c9d32cfe293d41e74'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:42.316696 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-89e655bb-efab-421d-871f-671ba3b3d6b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e3458d454d44d1c9d32cfe293d41e74'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:42.329778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-89e655bb-efab-421d-871f-671ba3b3d6b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e3458d454d44d1c9d32cfe293d41e74'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:42.343145 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1425/2840] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:42 2022] DELETE /identity/v3/users/0e3458d454d44d1c9d32cfe293d41e74 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:42.348013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eae217-1eed-40ee-ad51-67bf69c8fe7e None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:42.348550 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eae217-1eed-40ee-ad51-67bf69c8fe7e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:42.348550 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eae217-1eed-40ee-ad51-67bf69c8fe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:42.366478 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e5eae217-1eed-40ee-ad51-67bf69c8fe7e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:42.367614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e5eae217-1eed-40ee-ad51-67bf69c8fe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:42.432626 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1416/2841] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:42.442629 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e655bb-efab-421d-871f-671ba3b3d6b6 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:42.444222 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-89e655bb-efab-421d-871f-671ba3b3d6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:42.513672 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e655bb-efab-421d-871f-671ba3b3d6b6 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:42.518187 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5035ae-fb02-4482-98e1-743d2b46baa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:42.518913 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5035ae-fb02-4482-98e1-743d2b46baa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:42.519230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5035ae-fb02-4482-98e1-743d2b46baa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:42.519557 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5035ae-fb02-4482-98e1-743d2b46baa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:42.529819 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5035ae-fb02-4482-98e1-743d2b46baa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:42.531270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5035ae-fb02-4482-98e1-743d2b46baa9 service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:42.541011 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1426/2842] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:42.875598 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eae217-1eed-40ee-ad51-67bf69c8fe7e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:42.877563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e5eae217-1eed-40ee-ad51-67bf69c8fe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:42.892495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eae217-1eed-40ee-ad51-67bf69c8fe7e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:42.897169 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13d901-0e0e-43e3-87fa-ec16f16d090d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:42.898638 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13d901-0e0e-43e3-87fa-ec16f16d090d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:42.899088 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13d901-0e0e-43e3-87fa-ec16f16d090d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:42.899610 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13d901-0e0e-43e3-87fa-ec16f16d090d admin admin] PATH_INFO: `/v3/projects/9138a48abab64254ae7f3e8f16b281a7` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:42.901121 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13d901-0e0e-43e3-87fa-ec16f16d090d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9138a48abab64254ae7f3e8f16b281a7)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:42.903275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13d901-0e0e-43e3-87fa-ec16f16d090d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:42.985178 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ff13d901-0e0e-43e3-87fa-ec16f16d090d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9138a48abab64254ae7f3e8f16b281a7', 'request_id': 'req-ff13d901-0e0e-43e3-87fa-ec16f16d090d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:42.996046 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ff13d901-0e0e-43e3-87fa-ec16f16d090d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9138a48abab64254ae7f3e8f16b281a7', 'request_id': 'req-ff13d901-0e0e-43e3-87fa-ec16f16d090d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:43.007745 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ff13d901-0e0e-43e3-87fa-ec16f16d090d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9138a48abab64254ae7f3e8f16b281a7', 'request_id': 'req-ff13d901-0e0e-43e3-87fa-ec16f16d090d'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:43.025732 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ff13d901-0e0e-43e3-87fa-ec16f16d090d admin admin] The token cache is being invalidate because project 9138a48abab64254ae7f3e8f16b281a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80188) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:43.026040 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ff13d901-0e0e-43e3-87fa-ec16f16d090d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:43.026716 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-ff13d901-0e0e-43e3-87fa-ec16f16d090d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:43.028596 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1417/2843] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:42 2022] DELETE /identity/v3/projects/9138a48abab64254ae7f3e8f16b281a7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:43.033497 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28c56-63b2-41d6-9646-0ce4b1264bcb None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.034163 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28c56-63b2-41d6-9646-0ce4b1264bcb None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.034563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28c56-63b2-41d6-9646-0ce4b1264bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.054373 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-2eb28c56-63b2-41d6-9646-0ce4b1264bcb None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:43.055769 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2eb28c56-63b2-41d6-9646-0ce4b1264bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:43.138487 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1427/2844] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:45:43.146552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c438e7-74e1-4049-a75c-c2dee0e5547a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.146737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c438e7-74e1-4049-a75c-c2dee0e5547a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.147025 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c438e7-74e1-4049-a75c-c2dee0e5547a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.166375 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-29c438e7-74e1-4049-a75c-c2dee0e5547a None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:43.167628 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-29c438e7-74e1-4049-a75c-c2dee0e5547a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:43.182430 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1418/2845] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:43.186867 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb28c56-63b2-41d6-9646-0ce4b1264bcb None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:43.197576 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb28c56-63b2-41d6-9646-0ce4b1264bcb None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:43.202695 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdb7da-cd2e-4874-9901-2120f96b709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:43.203611 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdb7da-cd2e-4874-9901-2120f96b709a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.204046 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdb7da-cd2e-4874-9901-2120f96b709a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.204340 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdb7da-cd2e-4874-9901-2120f96b709a admin admin] PATH_INFO: `/v3/domains` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.205119 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdb7da-cd2e-4874-9901-2120f96b709a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80189) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:45:43.205652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdb7da-cd2e-4874-9901-2120f96b709a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:43.209230 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdb7da-cd2e-4874-9901-2120f96b709a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:43.223677 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1428/2846] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:45:43.228176 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c438e7-74e1-4049-a75c-c2dee0e5547a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:43.241483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c438e7-74e1-4049-a75c-c2dee0e5547a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:43.250863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01650d80-0137-4d29-b5b9-7d130bb3c1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:43.251733 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01650d80-0137-4d29-b5b9-7d130bb3c1ba admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.252171 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01650d80-0137-4d29-b5b9-7d130bb3c1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.252608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01650d80-0137-4d29-b5b9-7d130bb3c1ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.253595 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01650d80-0137-4d29-b5b9-7d130bb3c1ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:43.255763 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01650d80-0137-4d29-b5b9-7d130bb3c1ba admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:43.304503 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:43.323991 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1419/2847] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:43 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:43.328245 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdb7da-cd2e-4874-9901-2120f96b709a admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:43.339650 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdb7da-cd2e-4874-9901-2120f96b709a admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:43.412590 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:43.425228 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8d6c7-e926-41d1-bb2e-56b1ca4083b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:43.426310 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8d6c7-e926-41d1-bb2e-56b1ca4083b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.426905 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8d6c7-e926-41d1-bb2e-56b1ca4083b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.427717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8d6c7-e926-41d1-bb2e-56b1ca4083b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.428743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8d6c7-e926-41d1-bb2e-56b1ca4083b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:43.430832 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8d6c7-e926-41d1-bb2e-56b1ca4083b1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:43.456509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1429/2848] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:43 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:43.460856 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01650d80-0137-4d29-b5b9-7d130bb3c1ba admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:43.472695 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01650d80-0137-4d29-b5b9-7d130bb3c1ba admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:43.477897 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31caba3-9bf1-4bb5-94c9-2a540a4e0a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:43.478643 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31caba3-9bf1-4bb5-94c9-2a540a4e0a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.479034 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31caba3-9bf1-4bb5-94c9-2a540a4e0a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.479627 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31caba3-9bf1-4bb5-94c9-2a540a4e0a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.480456 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31caba3-9bf1-4bb5-94c9-2a540a4e0a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:43.482167 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31caba3-9bf1-4bb5-94c9-2a540a4e0a98 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:43.496345 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1420/2849] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:43.500894 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8d6c7-e926-41d1-bb2e-56b1ca4083b1 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:43.515225 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8d6c7-e926-41d1-bb2e-56b1ca4083b1 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:43.520399 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d644c3-f199-4039-a720-9da3c012b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:43.521287 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d644c3-f199-4039-a720-9da3c012b65a admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.521771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d644c3-f199-4039-a720-9da3c012b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.522209 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d644c3-f199-4039-a720-9da3c012b65a admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.523108 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d644c3-f199-4039-a720-9da3c012b65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:43.525491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d644c3-f199-4039-a720-9da3c012b65a admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:43.542358 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31caba3-9bf1-4bb5-94c9-2a540a4e0a98 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:43.543102 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1430/2850] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:43.556782 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31caba3-9bf1-4bb5-94c9-2a540a4e0a98 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:43.561636 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca403b1-a3aa-4efb-8805-46d541cc1daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:43.562518 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca403b1-a3aa-4efb-8805-46d541cc1daf admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.562807 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca403b1-a3aa-4efb-8805-46d541cc1daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.563086 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca403b1-a3aa-4efb-8805-46d541cc1daf admin admin] PATH_INFO: `/v3/projects/b520d4afa13f4d73a3115add9533a63d/users/73eb3c5174464509b0f5ca581128a783/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.580441 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca403b1-a3aa-4efb-8805-46d541cc1daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b520d4afa13f4d73a3115add9533a63d, user_id=73eb3c5174464509b0f5ca581128a783, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:43.583218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca403b1-a3aa-4efb-8805-46d541cc1daf admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:43.603618 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1421/2851] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:43 2022] PUT /identity/v3/projects/b520d4afa13f4d73a3115add9533a63d/users/73eb3c5174464509b0f5ca581128a783/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:43.615577 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25a00a-54ed-4311-a638-32a08579726e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.615875 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25a00a-54ed-4311-a638-32a08579726e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.616162 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25a00a-54ed-4311-a638-32a08579726e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.684264 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-fb25a00a-54ed-4311-a638-32a08579726e None None] MFA Rules not processed for user `73eb3c5174464509b0f5ca581128a783`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:43.685698 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-fb25a00a-54ed-4311-a638-32a08579726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:43.769219 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1431/2852] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:43.774033 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca403b1-a3aa-4efb-8805-46d541cc1daf admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:43.838483 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca403b1-a3aa-4efb-8805-46d541cc1daf admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:43.843285 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcc360-ed5a-42af-87c6-f0d697eb19f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:43.843974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcc360-ed5a-42af-87c6-f0d697eb19f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.844265 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcc360-ed5a-42af-87c6-f0d697eb19f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.844543 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcc360-ed5a-42af-87c6-f0d697eb19f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.847681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dcc360-ed5a-42af-87c6-f0d697eb19f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:43.849696 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dcc360-ed5a-42af-87c6-f0d697eb19f3 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:43.881179 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1422/2853] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:43 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:43.882904 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25a00a-54ed-4311-a638-32a08579726e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:43.897080 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25a00a-54ed-4311-a638-32a08579726e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:43.961618 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873c4da-1718-41a1-9110-8eeb40c3137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:43.962375 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873c4da-1718-41a1-9110-8eeb40c3137f admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:43.962659 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873c4da-1718-41a1-9110-8eeb40c3137f admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:43.962935 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873c4da-1718-41a1-9110-8eeb40c3137f admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:43.963663 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873c4da-1718-41a1-9110-8eeb40c3137f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:43.965633 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873c4da-1718-41a1-9110-8eeb40c3137f admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:43.989560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1432/2854] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:43 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:43.993881 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcc360-ed5a-42af-87c6-f0d697eb19f3 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:44.004958 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcc360-ed5a-42af-87c6-f0d697eb19f3 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:44.009874 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9dedb-4c0d-4192-a6a2-c47ddc8b0ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:44.010650 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9dedb-4c0d-4192-a6a2-c47ddc8b0ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:44.011021 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9dedb-4c0d-4192-a6a2-c47ddc8b0ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:44.011365 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9dedb-4c0d-4192-a6a2-c47ddc8b0ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:44.012295 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9dedb-4c0d-4192-a6a2-c47ddc8b0ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:44.014084 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9dedb-4c0d-4192-a6a2-c47ddc8b0ba4 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:44.026401 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1423/2855] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:44.030855 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873c4da-1718-41a1-9110-8eeb40c3137f admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:44.041461 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873c4da-1718-41a1-9110-8eeb40c3137f admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:44.046680 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a732a-a5c4-470d-ba66-3d1aa26d12c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:44.047493 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a732a-a5c4-470d-ba66-3d1aa26d12c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:44.047783 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a732a-a5c4-470d-ba66-3d1aa26d12c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:44.048061 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a732a-a5c4-470d-ba66-3d1aa26d12c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:44.048810 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a732a-a5c4-470d-ba66-3d1aa26d12c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:44.050470 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a732a-a5c4-470d-ba66-3d1aa26d12c9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:44.061878 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1433/2856] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:44.066022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9dedb-4c0d-4192-a6a2-c47ddc8b0ba4 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:44.076928 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9dedb-4c0d-4192-a6a2-c47ddc8b0ba4 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:44.081569 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96f818-15fd-441a-996a-477f8d0cd166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:44.082499 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96f818-15fd-441a-996a-477f8d0cd166 admin admin] REQUEST_METHOD: `PUT` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:44.082780 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96f818-15fd-441a-996a-477f8d0cd166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:44.083055 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96f818-15fd-441a-996a-477f8d0cd166 admin admin] PATH_INFO: `/v3/projects/856754d3c5b74c69b544271bdf685f7c/users/7baf5f5cef2a4b1a807ab111dbfd7cc9/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:44.101823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96f818-15fd-441a-996a-477f8d0cd166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=856754d3c5b74c69b544271bdf685f7c, user_id=7baf5f5cef2a4b1a807ab111dbfd7cc9, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:44.104555 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96f818-15fd-441a-996a-477f8d0cd166 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:44.119547 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1424/2857] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:44 2022] PUT /identity/v3/projects/856754d3c5b74c69b544271bdf685f7c/users/7baf5f5cef2a4b1a807ab111dbfd7cc9/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:44.130157 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ebfe2-2768-4e7e-9881-8c154a51d7dc None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:44.130431 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ebfe2-2768-4e7e-9881-8c154a51d7dc None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:44.130729 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ebfe2-2768-4e7e-9881-8c154a51d7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:44.160543 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-805ebfe2-2768-4e7e-9881-8c154a51d7dc None None] MFA Rules not processed for user `7baf5f5cef2a4b1a807ab111dbfd7cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:44.161843 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-805ebfe2-2768-4e7e-9881-8c154a51d7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:44.201110 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:44.239036 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1434/2858] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:45:44.243945 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96f818-15fd-441a-996a-477f8d0cd166 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:44.305933 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96f818-15fd-441a-996a-477f8d0cd166 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:44.315421 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871161b-6ef8-4c8b-bbe4-062857957c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:44.316149 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871161b-6ef8-4c8b-bbe4-062857957c42 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:44.316437 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871161b-6ef8-4c8b-bbe4-062857957c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:44.316687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871161b-6ef8-4c8b-bbe4-062857957c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:44.317454 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871161b-6ef8-4c8b-bbe4-062857957c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:44.319587 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871161b-6ef8-4c8b-bbe4-062857957c42 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:44.334505 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:44.348743 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1425/2859] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:44 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:44.353136 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ebfe2-2768-4e7e-9881-8c154a51d7dc None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:44.364076 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ebfe2-2768-4e7e-9881-8c154a51d7dc None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:44.427078 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38876e0-5221-4f88-8f2a-59f3cb626e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:44.427784 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38876e0-5221-4f88-8f2a-59f3cb626e37 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:44.428068 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38876e0-5221-4f88-8f2a-59f3cb626e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:44.428383 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38876e0-5221-4f88-8f2a-59f3cb626e37 admin admin] PATH_INFO: `/v3/users` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:44.429044 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38876e0-5221-4f88-8f2a-59f3cb626e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:44.430986 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38876e0-5221-4f88-8f2a-59f3cb626e37 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:44.465456 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1435/2860] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:44 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:44.467608 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871161b-6ef8-4c8b-bbe4-062857957c42 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:44.480234 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871161b-6ef8-4c8b-bbe4-062857957c42 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:44.487605 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03073b34-6273-4450-a371-be1e281b8b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:44.488737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03073b34-6273-4450-a371-be1e281b8b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:44.489139 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03073b34-6273-4450-a371-be1e281b8b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:44.489706 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03073b34-6273-4450-a371-be1e281b8b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:44.490614 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03073b34-6273-4450-a371-be1e281b8b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:44.492338 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03073b34-6273-4450-a371-be1e281b8b7d admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:44.504823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1426/2861] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:44.508963 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38876e0-5221-4f88-8f2a-59f3cb626e37 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:44.519642 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38876e0-5221-4f88-8f2a-59f3cb626e37 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:44.524639 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf0b2f-f709-4c23-a002-dbb3832be7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:44.525595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf0b2f-f709-4c23-a002-dbb3832be7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:44.525880 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf0b2f-f709-4c23-a002-dbb3832be7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:44.526160 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf0b2f-f709-4c23-a002-dbb3832be7d8 admin admin] PATH_INFO: `/v3/projects/3f17c9b5fbda432e81f3c2e43ee00309/users/3b5747257db24c46b7a303aedc70023a/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:44.547604 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf0b2f-f709-4c23-a002-dbb3832be7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f17c9b5fbda432e81f3c2e43ee00309, user_id=3b5747257db24c46b7a303aedc70023a, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:44.550528 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf0b2f-f709-4c23-a002-dbb3832be7d8 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:44.567412 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1436/2862] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:44 2022] PUT /identity/v3/projects/3f17c9b5fbda432e81f3c2e43ee00309/users/3b5747257db24c46b7a303aedc70023a/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:44.571500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03073b34-6273-4450-a371-be1e281b8b7d admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:44.581751 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03073b34-6273-4450-a371-be1e281b8b7d admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:44.642476 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921400b3-56b4-4dd3-804f-c8ed07f13836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:44.643155 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921400b3-56b4-4dd3-804f-c8ed07f13836 admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:44.643436 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921400b3-56b4-4dd3-804f-c8ed07f13836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:44.643710 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921400b3-56b4-4dd3-804f-c8ed07f13836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:44.644457 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921400b3-56b4-4dd3-804f-c8ed07f13836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:44.646198 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921400b3-56b4-4dd3-804f-c8ed07f13836 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:44.656552 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1427/2863] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:44.660717 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf0b2f-f709-4c23-a002-dbb3832be7d8 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:44.674398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf0b2f-f709-4c23-a002-dbb3832be7d8 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:44.679738 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e3cc3-fac5-4d4a-b16a-2d9da2fba932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:44.680680 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e3cc3-fac5-4d4a-b16a-2d9da2fba932 admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:44.680965 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e3cc3-fac5-4d4a-b16a-2d9da2fba932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:44.681239 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e3cc3-fac5-4d4a-b16a-2d9da2fba932 admin admin] PATH_INFO: `/v3/projects/3f17c9b5fbda432e81f3c2e43ee00309/users/3b5747257db24c46b7a303aedc70023a/roles/6181294868a04e3890ff8a30bafdccf3` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:44.683725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e3cc3-fac5-4d4a-b16a-2d9da2fba932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f17c9b5fbda432e81f3c2e43ee00309, user_id=3b5747257db24c46b7a303aedc70023a, role_id=6181294868a04e3890ff8a30bafdccf3)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:44.686401 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e3cc3-fac5-4d4a-b16a-2d9da2fba932 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:44.697813 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1437/2864] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:44 2022] PUT /identity/v3/projects/3f17c9b5fbda432e81f3c2e43ee00309/users/3b5747257db24c46b7a303aedc70023a/roles/6181294868a04e3890ff8a30bafdccf3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:44.708391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b48632-7cf8-41f9-8ccc-11dc5ad1474a None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:44.708690 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b48632-7cf8-41f9-8ccc-11dc5ad1474a None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:44.708979 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b48632-7cf8-41f9-8ccc-11dc5ad1474a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:44.740705 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-e3b48632-7cf8-41f9-8ccc-11dc5ad1474a None None] MFA Rules not processed for user `3b5747257db24c46b7a303aedc70023a`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:44.742159 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-e3b48632-7cf8-41f9-8ccc-11dc5ad1474a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:44.815219 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1428/2865] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:44.833828 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e3cc3-fac5-4d4a-b16a-2d9da2fba932 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:44.835721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-473e3cc3-fac5-4d4a-b16a-2d9da2fba932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:44.898207 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e3cc3-fac5-4d4a-b16a-2d9da2fba932 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:44.902054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580db29-7e11-4b49-b173-57bce7866e74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:44.902720 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580db29-7e11-4b49-b173-57bce7866e74 service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:44.903003 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580db29-7e11-4b49-b173-57bce7866e74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:44.903282 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580db29-7e11-4b49-b173-57bce7866e74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:44.937850 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:44.966030 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580db29-7e11-4b49-b173-57bce7866e74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:44.968777 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580db29-7e11-4b49-b173-57bce7866e74 service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:44.982636 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1438/2866] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:46.509961 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b48632-7cf8-41f9-8ccc-11dc5ad1474a None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:46.520513 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b48632-7cf8-41f9-8ccc-11dc5ad1474a None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:46.524795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedd426-2400-4fad-a441-df9e4d9ca491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:46.525470 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedd426-2400-4fad-a441-df9e4d9ca491 service cinder] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:46.525757 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedd426-2400-4fad-a441-df9e4d9ca491 service cinder] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:46.526035 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedd426-2400-4fad-a441-df9e4d9ca491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:46.584254 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedd426-2400-4fad-a441-df9e4d9ca491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:46.585687 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedd426-2400-4fad-a441-df9e4d9ca491 service cinder] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:46.594814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1429/2867] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 15 00:45:47.185191 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580db29-7e11-4b49-b173-57bce7866e74 service cinder] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:47.198100 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580db29-7e11-4b49-b173-57bce7866e74 service cinder] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:47.202084 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f787e-43d2-4c99-83d6-fb0836f6b68c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:47.202743 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f787e-43d2-4c99-83d6-fb0836f6b68c service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:47.203027 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f787e-43d2-4c99-83d6-fb0836f6b68c service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:47.203304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f787e-43d2-4c99-83d6-fb0836f6b68c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:47.214860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f787e-43d2-4c99-83d6-fb0836f6b68c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:47.216315 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f787e-43d2-4c99-83d6-fb0836f6b68c service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:47.227075 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1439/2868] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:51.113128 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedd426-2400-4fad-a441-df9e4d9ca491 service cinder] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:51.117594 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:51.179246 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedd426-2400-4fad-a441-df9e4d9ca491 service cinder] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:51.183999 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cc194-1fd7-4aa4-9f9e-e868725244d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:51.184898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cc194-1fd7-4aa4-9f9e-e868725244d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:51.185180 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cc194-1fd7-4aa4-9f9e-e868725244d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:51.185481 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cc194-1fd7-4aa4-9f9e-e868725244d1 admin admin] PATH_INFO: `/v3/users/73eb3c5174464509b0f5ca581128a783` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:51.186706 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cc194-1fd7-4aa4-9f9e-e868725244d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73eb3c5174464509b0f5ca581128a783)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:51.188644 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cc194-1fd7-4aa4-9f9e-e868725244d1 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:51.240464 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-123cc194-1fd7-4aa4-9f9e-e868725244d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73eb3c5174464509b0f5ca581128a783'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:51.248907 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-123cc194-1fd7-4aa4-9f9e-e868725244d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73eb3c5174464509b0f5ca581128a783'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:51.249617 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-123cc194-1fd7-4aa4-9f9e-e868725244d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73eb3c5174464509b0f5ca581128a783'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:51.250246 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-123cc194-1fd7-4aa4-9f9e-e868725244d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73eb3c5174464509b0f5ca581128a783'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:51.262384 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-123cc194-1fd7-4aa4-9f9e-e868725244d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73eb3c5174464509b0f5ca581128a783'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:51.274726 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1430/2869] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:51 2022] DELETE /identity/v3/users/73eb3c5174464509b0f5ca581128a783 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:51.279303 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b0d1a-4a0f-4426-b1f8-a675b3214005 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:51.279798 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b0d1a-4a0f-4426-b1f8-a675b3214005 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:51.279905 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b0d1a-4a0f-4426-b1f8-a675b3214005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:51.303671 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-477b0d1a-4a0f-4426-b1f8-a675b3214005 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:51.305529 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-477b0d1a-4a0f-4426-b1f8-a675b3214005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:51.369797 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1440/2870] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:51.379677 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cc194-1fd7-4aa4-9f9e-e868725244d1 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:51.381235 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-123cc194-1fd7-4aa4-9f9e-e868725244d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:51.442075 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cc194-1fd7-4aa4-9f9e-e868725244d1 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:51.446686 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985ebbd-c1b9-4aba-95b8-f5019d117082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:51.447344 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985ebbd-c1b9-4aba-95b8-f5019d117082 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:51.447627 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985ebbd-c1b9-4aba-95b8-f5019d117082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:51.447901 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985ebbd-c1b9-4aba-95b8-f5019d117082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:51.457760 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985ebbd-c1b9-4aba-95b8-f5019d117082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:51.459218 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985ebbd-c1b9-4aba-95b8-f5019d117082 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:51.469374 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1431/2871] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:51.747326 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b0d1a-4a0f-4426-b1f8-a675b3214005 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:51.748773 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-477b0d1a-4a0f-4426-b1f8-a675b3214005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:51.760962 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b0d1a-4a0f-4426-b1f8-a675b3214005 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:51.765762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:51.766679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:51.766953 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:51.767199 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0 admin admin] PATH_INFO: `/v3/projects/b520d4afa13f4d73a3115add9533a63d` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:51.768382 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b520d4afa13f4d73a3115add9533a63d)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:51.770494 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:51.824123 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b520d4afa13f4d73a3115add9533a63d', 'request_id': 'req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:51.829707 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b520d4afa13f4d73a3115add9533a63d', 'request_id': 'req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:51.835820 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b520d4afa13f4d73a3115add9533a63d', 'request_id': 'req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:51.850139 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0 admin admin] The token cache is being invalidate because project b520d4afa13f4d73a3115add9533a63d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:51.850447 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:51.851142 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:51.853077 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1441/2872] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:51 2022] DELETE /identity/v3/projects/b520d4afa13f4d73a3115add9533a63d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:51.857366 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985ebbd-c1b9-4aba-95b8-f5019d117082 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:51.867414 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985ebbd-c1b9-4aba-95b8-f5019d117082 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:51.887391 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:51.925317 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15901ff9-2f6b-4370-ba51-a8c6bc52edcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:51.926281 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15901ff9-2f6b-4370-ba51-a8c6bc52edcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:51.926597 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15901ff9-2f6b-4370-ba51-a8c6bc52edcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:51.926919 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15901ff9-2f6b-4370-ba51-a8c6bc52edcd admin admin] PATH_INFO: `/v3/users/7baf5f5cef2a4b1a807ab111dbfd7cc9` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:51.928129 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15901ff9-2f6b-4370-ba51-a8c6bc52edcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7baf5f5cef2a4b1a807ab111dbfd7cc9)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:51.930176 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15901ff9-2f6b-4370-ba51-a8c6bc52edcd admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:51.978983 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-15901ff9-2f6b-4370-ba51-a8c6bc52edcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7baf5f5cef2a4b1a807ab111dbfd7cc9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:51.987863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-15901ff9-2f6b-4370-ba51-a8c6bc52edcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7baf5f5cef2a4b1a807ab111dbfd7cc9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:51.988477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-15901ff9-2f6b-4370-ba51-a8c6bc52edcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7baf5f5cef2a4b1a807ab111dbfd7cc9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:51.989175 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-15901ff9-2f6b-4370-ba51-a8c6bc52edcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7baf5f5cef2a4b1a807ab111dbfd7cc9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:52.002730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-15901ff9-2f6b-4370-ba51-a8c6bc52edcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7baf5f5cef2a4b1a807ab111dbfd7cc9'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:52.016758 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1432/2873] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:51 2022] DELETE /identity/v3/users/7baf5f5cef2a4b1a807ab111dbfd7cc9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:52.303492 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:52.305227 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:52.321247 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7aa8c-e5c2-4540-8587-2fb29c264ce0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:52.370964 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:52.385725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d80466-242c-4f84-8892-b2c8e9af26a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:52.386908 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d80466-242c-4f84-8892-b2c8e9af26a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:52.387199 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d80466-242c-4f84-8892-b2c8e9af26a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:52.387477 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d80466-242c-4f84-8892-b2c8e9af26a3 admin admin] PATH_INFO: `/v3/projects/856754d3c5b74c69b544271bdf685f7c` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:52.388721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d80466-242c-4f84-8892-b2c8e9af26a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=856754d3c5b74c69b544271bdf685f7c)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:52.390763 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d80466-242c-4f84-8892-b2c8e9af26a3 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:52.440366 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d3d80466-242c-4f84-8892-b2c8e9af26a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856754d3c5b74c69b544271bdf685f7c', 'request_id': 'req-d3d80466-242c-4f84-8892-b2c8e9af26a3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:52.446734 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d3d80466-242c-4f84-8892-b2c8e9af26a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856754d3c5b74c69b544271bdf685f7c', 'request_id': 'req-d3d80466-242c-4f84-8892-b2c8e9af26a3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:52.453815 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d3d80466-242c-4f84-8892-b2c8e9af26a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856754d3c5b74c69b544271bdf685f7c', 'request_id': 'req-d3d80466-242c-4f84-8892-b2c8e9af26a3'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:52.469443 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d3d80466-242c-4f84-8892-b2c8e9af26a3 admin admin] The token cache is being invalidate because project 856754d3c5b74c69b544271bdf685f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:52.469732 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d3d80466-242c-4f84-8892-b2c8e9af26a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:52.470369 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-d3d80466-242c-4f84-8892-b2c8e9af26a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:52.472319 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1442/2874] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:52 2022] DELETE /identity/v3/projects/856754d3c5b74c69b544271bdf685f7c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:52.476452 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15901ff9-2f6b-4370-ba51-a8c6bc52edcd admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:52.478148 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-15901ff9-2f6b-4370-ba51-a8c6bc52edcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:52.491223 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15901ff9-2f6b-4370-ba51-a8c6bc52edcd admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:52.554276 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f28b2-0b6c-4a09-baa8-8628dd06d7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:52.555244 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f28b2-0b6c-4a09-baa8-8628dd06d7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:52.555532 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f28b2-0b6c-4a09-baa8-8628dd06d7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:52.555814 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f28b2-0b6c-4a09-baa8-8628dd06d7c6 admin admin] PATH_INFO: `/v3/users/3b5747257db24c46b7a303aedc70023a` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:52.557177 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f28b2-0b6c-4a09-baa8-8628dd06d7c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b5747257db24c46b7a303aedc70023a)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:52.559249 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f28b2-0b6c-4a09-baa8-8628dd06d7c6 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:52.610009 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:52.611582 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9a0f28b2-0b6c-4a09-baa8-8628dd06d7c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5747257db24c46b7a303aedc70023a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:52.620349 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9a0f28b2-0b6c-4a09-baa8-8628dd06d7c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5747257db24c46b7a303aedc70023a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:52.621039 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9a0f28b2-0b6c-4a09-baa8-8628dd06d7c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5747257db24c46b7a303aedc70023a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:52.621688 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9a0f28b2-0b6c-4a09-baa8-8628dd06d7c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5747257db24c46b7a303aedc70023a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:52.634756 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9a0f28b2-0b6c-4a09-baa8-8628dd06d7c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5747257db24c46b7a303aedc70023a'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:52.648418 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1433/2875] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:52 2022] DELETE /identity/v3/users/3b5747257db24c46b7a303aedc70023a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:52.945423 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d80466-242c-4f84-8892-b2c8e9af26a3 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:52.947885 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-d3d80466-242c-4f84-8892-b2c8e9af26a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:52.964150 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d80466-242c-4f84-8892-b2c8e9af26a3 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:53.028703 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4b8a1-0025-4aa3-babe-7843aa39ff73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:53.029610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4b8a1-0025-4aa3-babe-7843aa39ff73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:53.029893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4b8a1-0025-4aa3-babe-7843aa39ff73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:53.030167 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4b8a1-0025-4aa3-babe-7843aa39ff73 admin admin] PATH_INFO: `/v3/projects/3f17c9b5fbda432e81f3c2e43ee00309` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:53.031353 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4b8a1-0025-4aa3-babe-7843aa39ff73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f17c9b5fbda432e81f3c2e43ee00309)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:53.033237 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4b8a1-0025-4aa3-babe-7843aa39ff73 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:53.085560 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0ee4b8a1-0025-4aa3-babe-7843aa39ff73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f17c9b5fbda432e81f3c2e43ee00309', 'request_id': 'req-0ee4b8a1-0025-4aa3-babe-7843aa39ff73'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:53.092221 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0ee4b8a1-0025-4aa3-babe-7843aa39ff73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f17c9b5fbda432e81f3c2e43ee00309', 'request_id': 'req-0ee4b8a1-0025-4aa3-babe-7843aa39ff73'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:53.099508 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0ee4b8a1-0025-4aa3-babe-7843aa39ff73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f17c9b5fbda432e81f3c2e43ee00309', 'request_id': 'req-0ee4b8a1-0025-4aa3-babe-7843aa39ff73'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:53.112771 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0ee4b8a1-0025-4aa3-babe-7843aa39ff73 admin admin] The token cache is being invalidate because project 3f17c9b5fbda432e81f3c2e43ee00309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:53.113059 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0ee4b8a1-0025-4aa3-babe-7843aa39ff73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:53.113679 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-0ee4b8a1-0025-4aa3-babe-7843aa39ff73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:53.115218 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1443/2876] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:52 2022] DELETE /identity/v3/projects/3f17c9b5fbda432e81f3c2e43ee00309 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:53.120239 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f2274-9a95-469a-8026-91d8da1f3d76 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:53.120528 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f2274-9a95-469a-8026-91d8da1f3d76 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:53.120805 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f2274-9a95-469a-8026-91d8da1f3d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:53.138590 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-972f2274-9a95-469a-8026-91d8da1f3d76 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:53.139713 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-972f2274-9a95-469a-8026-91d8da1f3d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:53.201795 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1434/2877] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:53.209709 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5369d3-cfd8-487b-8d20-86fd9042ac8e None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:53.210001 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5369d3-cfd8-487b-8d20-86fd9042ac8e None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:53.210279 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5369d3-cfd8-487b-8d20-86fd9042ac8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:53.223595 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:53.230196 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-ea5369d3-cfd8-487b-8d20-86fd9042ac8e None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:53.231845 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-ea5369d3-cfd8-487b-8d20-86fd9042ac8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:53.240484 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1444/2878] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:53.244730 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f2274-9a95-469a-8026-91d8da1f3d76 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:53.254792 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f2274-9a95-469a-8026-91d8da1f3d76 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:53.260496 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c6463-5cba-4c33-ab13-4f29a6961cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:53.261160 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c6463-5cba-4c33-ab13-4f29a6961cac admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:53.261477 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c6463-5cba-4c33-ab13-4f29a6961cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:53.261746 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c6463-5cba-4c33-ab13-4f29a6961cac admin admin] PATH_INFO: `/v3/domains` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:53.262625 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c6463-5cba-4c33-ab13-4f29a6961cac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80188) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 15 00:45:53.263008 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c6463-5cba-4c33-ab13-4f29a6961cac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:53.264647 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c6463-5cba-4c33-ab13-4f29a6961cac admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:53.277770 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1435/2879] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Jun 15 00:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 15 00:45:53.282178 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5369d3-cfd8-487b-8d20-86fd9042ac8e None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:53.291928 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5369d3-cfd8-487b-8d20-86fd9042ac8e None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:53.297821 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ae599-d569-42dc-ae06-2771e9249ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:53.298482 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ae599-d569-42dc-ae06-2771e9249ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:53.298778 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ae599-d569-42dc-ae06-2771e9249ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:53.299052 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ae599-d569-42dc-ae06-2771e9249ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:53.299816 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ae599-d569-42dc-ae06-2771e9249ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:53.301736 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ae599-d569-42dc-ae06-2771e9249ad0 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:53.332612 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1445/2880] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Jun 15 00:45:53 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 15 00:45:53.337643 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c6463-5cba-4c33-ab13-4f29a6961cac admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:53.348987 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c6463-5cba-4c33-ab13-4f29a6961cac admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:53.413791 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b651e64-8185-4aba-b74c-c7eea06a95e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:53.414513 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b651e64-8185-4aba-b74c-c7eea06a95e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:53.414793 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b651e64-8185-4aba-b74c-c7eea06a95e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:53.415163 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b651e64-8185-4aba-b74c-c7eea06a95e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:53.415896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b651e64-8185-4aba-b74c-c7eea06a95e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:53.417892 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b651e64-8185-4aba-b74c-c7eea06a95e9 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:53.439063 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1436/2881] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Jun 15 00:45:53 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 15 00:45:53.443270 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ae599-d569-42dc-ae06-2771e9249ad0 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:53.454725 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ae599-d569-42dc-ae06-2771e9249ad0 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:53.459911 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4912159-14cc-4ffb-affe-4dff4051c730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:53.460571 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4912159-14cc-4ffb-affe-4dff4051c730 admin admin] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:53.460857 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4912159-14cc-4ffb-affe-4dff4051c730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:53.461130 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4912159-14cc-4ffb-affe-4dff4051c730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:53.461963 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4912159-14cc-4ffb-affe-4dff4051c730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:53.463563 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4912159-14cc-4ffb-affe-4dff4051c730 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:53.474927 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1446/2882] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 15 00:45:53.478865 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b651e64-8185-4aba-b74c-c7eea06a95e9 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:53.491319 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b651e64-8185-4aba-b74c-c7eea06a95e9 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:53.498656 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107a43c-3ca3-4769-999a-5f7ab02dc30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:53.499371 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107a43c-3ca3-4769-999a-5f7ab02dc30e admin admin] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:53.499763 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107a43c-3ca3-4769-999a-5f7ab02dc30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:53.500049 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107a43c-3ca3-4769-999a-5f7ab02dc30e admin admin] PATH_INFO: `/v3/roles` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:53.500792 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107a43c-3ca3-4769-999a-5f7ab02dc30e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:53.502447 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107a43c-3ca3-4769-999a-5f7ab02dc30e admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:53.512737 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1437/2883] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Jun 15 00:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 15 00:45:53.516967 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4912159-14cc-4ffb-affe-4dff4051c730 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:53.527135 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4912159-14cc-4ffb-affe-4dff4051c730 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:53.531908 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee171bf-895e-4b31-9b75-d2a46185344d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:53.532799 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee171bf-895e-4b31-9b75-d2a46185344d admin admin] REQUEST_METHOD: `PUT` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:53.533089 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee171bf-895e-4b31-9b75-d2a46185344d admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:53.533374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee171bf-895e-4b31-9b75-d2a46185344d admin admin] PATH_INFO: `/v3/projects/d2e8082d8a9a4ff5898c36207c77fd61/users/f829f51d36c943629d74a1fde83fc635/roles/5dd696285c0b41d3acb854981774eaae` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:53.549364 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee171bf-895e-4b31-9b75-d2a46185344d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2e8082d8a9a4ff5898c36207c77fd61, user_id=f829f51d36c943629d74a1fde83fc635, role_id=5dd696285c0b41d3acb854981774eaae)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:53.552105 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee171bf-895e-4b31-9b75-d2a46185344d admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:53.573233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1447/2884] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Jun 15 00:45:53 2022] PUT /identity/v3/projects/d2e8082d8a9a4ff5898c36207c77fd61/users/f829f51d36c943629d74a1fde83fc635/roles/5dd696285c0b41d3acb854981774eaae => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:53.589062 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caaaf5-b87c-44d0-80c2-a4782b1b53f9 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:53.589373 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caaaf5-b87c-44d0-80c2-a4782b1b53f9 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:53.589721 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caaaf5-b87c-44d0-80c2-a4782b1b53f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:53.618120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-74caaaf5-b87c-44d0-80c2-a4782b1b53f9 None None] MFA Rules not processed for user `f829f51d36c943629d74a1fde83fc635`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:53.619438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-74caaaf5-b87c-44d0-80c2-a4782b1b53f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:53.636925 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:53.692367 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1438/2885] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:45:53.703823 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee171bf-895e-4b31-9b75-d2a46185344d admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:53.705624 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-7ee171bf-895e-4b31-9b75-d2a46185344d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:53.766924 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee171bf-895e-4b31-9b75-d2a46185344d admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:53.771122 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0d8fb-23d3-408a-a83e-46b819b70c0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd41065b495234fd98552222fc32cc53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:53.771800 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0d8fb-23d3-408a-a83e-46b819b70c0c service cinder] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:53.772091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0d8fb-23d3-408a-a83e-46b819b70c0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:53.772378 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0d8fb-23d3-408a-a83e-46b819b70c0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:53.780900 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0d8fb-23d3-408a-a83e-46b819b70c0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:53.782385 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0d8fb-23d3-408a-a83e-46b819b70c0c service cinder] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:53.791445 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1448/2886] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:53.818655 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74caaaf5-b87c-44d0-80c2-a4782b1b53f9 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:53.898654 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74caaaf5-b87c-44d0-80c2-a4782b1b53f9 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:53.904249 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b343964-5572-4829-985a-79ae8fd100db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:53.905150 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b343964-5572-4829-985a-79ae8fd100db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:53.905501 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b343964-5572-4829-985a-79ae8fd100db admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:53.905773 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b343964-5572-4829-985a-79ae8fd100db admin admin] PATH_INFO: `/v3/users/f829f51d36c943629d74a1fde83fc635` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:53.907117 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b343964-5572-4829-985a-79ae8fd100db admin admin] RBAC: Authorizing `identity:delete_user(user_id=f829f51d36c943629d74a1fde83fc635)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:53.909087 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b343964-5572-4829-985a-79ae8fd100db admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:53.967823 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8b343964-5572-4829-985a-79ae8fd100db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f829f51d36c943629d74a1fde83fc635'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:53.976849 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8b343964-5572-4829-985a-79ae8fd100db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f829f51d36c943629d74a1fde83fc635'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:53.977489 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8b343964-5572-4829-985a-79ae8fd100db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f829f51d36c943629d74a1fde83fc635'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:53.978612 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8b343964-5572-4829-985a-79ae8fd100db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f829f51d36c943629d74a1fde83fc635'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:53.990681 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-8b343964-5572-4829-985a-79ae8fd100db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f829f51d36c943629d74a1fde83fc635'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:54.004803 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1439/2887] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:45:53 2022] DELETE /identity/v3/users/f829f51d36c943629d74a1fde83fc635 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:54.009782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de2ded-4ebe-4ff3-be94-ba56d9cd2830 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:54.010083 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de2ded-4ebe-4ff3-be94-ba56d9cd2830 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:54.010361 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de2ded-4ebe-4ff3-be94-ba56d9cd2830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:54.027685 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-63de2ded-4ebe-4ff3-be94-ba56d9cd2830 None None] MFA Rules not processed for user `d38407cead4d4c429e0e7ef7b966bf82`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:45:54.028890 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-63de2ded-4ebe-4ff3-be94-ba56d9cd2830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:54.096876 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1449/2888] 10.222.0.36 () {58 vars in 957 bytes} [Wed Jun 15 00:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 15 00:45:54.107255 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b343964-5572-4829-985a-79ae8fd100db admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:54.108887 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8b343964-5572-4829-985a-79ae8fd100db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:54.153898 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:54.170155 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b343964-5572-4829-985a-79ae8fd100db admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:54.173804 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60044e60-5c8b-4bfd-86bf-016b2cabd913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:54.174458 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60044e60-5c8b-4bfd-86bf-016b2cabd913 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:54.174740 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60044e60-5c8b-4bfd-86bf-016b2cabd913 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:54.175013 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60044e60-5c8b-4bfd-86bf-016b2cabd913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:54.184283 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60044e60-5c8b-4bfd-86bf-016b2cabd913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:54.185761 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60044e60-5c8b-4bfd-86bf-016b2cabd913 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:54.195168 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1440/2889] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:45:54.486686 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de2ded-4ebe-4ff3-be94-ba56d9cd2830 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:54.488304 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-63de2ded-4ebe-4ff3-be94-ba56d9cd2830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:54.501233 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de2ded-4ebe-4ff3-be94-ba56d9cd2830 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:54.506073 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec97e4-6417-4821-8fc8-0509d5ce52da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:54.506955 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec97e4-6417-4821-8fc8-0509d5ce52da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:54.507240 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec97e4-6417-4821-8fc8-0509d5ce52da admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:54.507540 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec97e4-6417-4821-8fc8-0509d5ce52da admin admin] PATH_INFO: `/v3/projects/d2e8082d8a9a4ff5898c36207c77fd61` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:54.508739 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec97e4-6417-4821-8fc8-0509d5ce52da admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2e8082d8a9a4ff5898c36207c77fd61)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:54.510676 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec97e4-6417-4821-8fc8-0509d5ce52da admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:54.552925 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:45:54.559893 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6fec97e4-6417-4821-8fc8-0509d5ce52da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2e8082d8a9a4ff5898c36207c77fd61', 'request_id': 'req-6fec97e4-6417-4821-8fc8-0509d5ce52da'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:54.565782 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6fec97e4-6417-4821-8fc8-0509d5ce52da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2e8082d8a9a4ff5898c36207c77fd61', 'request_id': 'req-6fec97e4-6417-4821-8fc8-0509d5ce52da'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:54.571915 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6fec97e4-6417-4821-8fc8-0509d5ce52da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2e8082d8a9a4ff5898c36207c77fd61', 'request_id': 'req-6fec97e4-6417-4821-8fc8-0509d5ce52da'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:54.585730 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6fec97e4-6417-4821-8fc8-0509d5ce52da admin admin] The token cache is being invalidate because project d2e8082d8a9a4ff5898c36207c77fd61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:45:54.586021 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6fec97e4-6417-4821-8fc8-0509d5ce52da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:54.586665 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-6fec97e4-6417-4821-8fc8-0509d5ce52da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:45:54.588231 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1450/2890] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:45:54 2022] DELETE /identity/v3/projects/d2e8082d8a9a4ff5898c36207c77fd61 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:45:59.003324 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60044e60-5c8b-4bfd-86bf-016b2cabd913 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:45:59.004951 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-60044e60-5c8b-4bfd-86bf-016b2cabd913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:59.017287 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60044e60-5c8b-4bfd-86bf-016b2cabd913 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:45:59.071290 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649baed4-e98b-47c8-a123-94793e6e1b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:45:59.071969 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649baed4-e98b-47c8-a123-94793e6e1b51 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:45:59.072256 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649baed4-e98b-47c8-a123-94793e6e1b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:45:59.072536 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649baed4-e98b-47c8-a123-94793e6e1b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:45:59.075192 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-649baed4-e98b-47c8-a123-94793e6e1b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:45:59.088944 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649baed4-e98b-47c8-a123-94793e6e1b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:45:59.090563 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649baed4-e98b-47c8-a123-94793e6e1b51 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:45:59.099044 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1441/2891] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:45:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:04.582693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=9,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:06.748173 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec97e4-6417-4821-8fc8-0509d5ce52da admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:06.749936 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6fec97e4-6417-4821-8fc8-0509d5ce52da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:06.839151 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec97e4-6417-4821-8fc8-0509d5ce52da admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:06.846082 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12963c-8a6c-4326-8190-ce6d60634240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:06.847555 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12963c-8a6c-4326-8190-ce6d60634240 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:06.848062 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12963c-8a6c-4326-8190-ce6d60634240 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:06.848509 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12963c-8a6c-4326-8190-ce6d60634240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:06.851425 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2a12963c-8a6c-4326-8190-ce6d60634240 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:06.865781 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12963c-8a6c-4326-8190-ce6d60634240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:06.867374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12963c-8a6c-4326-8190-ce6d60634240 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:06.878423 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1451/2892] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:09.095054 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=35 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:09.473203 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649baed4-e98b-47c8-a123-94793e6e1b51 service neutron] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:46:09.474856 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-649baed4-e98b-47c8-a123-94793e6e1b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:09.485500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649baed4-e98b-47c8-a123-94793e6e1b51 service neutron] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:46:09.489914 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7fe43-b75a-4d3c-b871-993b7a2df1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:46:09.490561 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7fe43-b75a-4d3c-b871-993b7a2df1df service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:46:09.490844 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7fe43-b75a-4d3c-b871-993b7a2df1df service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:46:09.491119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7fe43-b75a-4d3c-b871-993b7a2df1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:46:09.492941 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-62b7fe43-b75a-4d3c-b871-993b7a2df1df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:46:09.559452 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7fe43-b75a-4d3c-b871-993b7a2df1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:46:09.560896 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7fe43-b75a-4d3c-b871-993b7a2df1df service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:46:09.570948 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1442/2893] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:46:09 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:46:16.874049 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=34 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:46:19.566656 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=30 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:20.342534 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12963c-8a6c-4326-8190-ce6d60634240 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:20.344339 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-2a12963c-8a6c-4326-8190-ce6d60634240 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:20.489835 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12963c-8a6c-4326-8190-ce6d60634240 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:20.495468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2c70c-7691-4d8d-bd01-4fcb4b973b71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e6dd029a3d45f6aeb4da06db9753dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:20.496134 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2c70c-7691-4d8d-bd01-4fcb4b973b71 service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:20.496423 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2c70c-7691-4d8d-bd01-4fcb4b973b71 service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:20.496705 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2c70c-7691-4d8d-bd01-4fcb4b973b71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:20.498579 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-80f2c70c-7691-4d8d-bd01-4fcb4b973b71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:20.510136 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2c70c-7691-4d8d-bd01-4fcb4b973b71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:20.511721 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2c70c-7691-4d8d-bd01-4fcb4b973b71 service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:20.521921 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1452/2894] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:48:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:48:22.044781 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481ad52-2916-4729-b110-2c1b2fdb721e None None] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:22.045428 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481ad52-2916-4729-b110-2c1b2fdb721e None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:22.045428 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481ad52-2916-4729-b110-2c1b2fdb721e None None] PATH_INFO: `/` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:22.046779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1443/2895] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 15 00:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:48:22.052584 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eeae6-f133-4959-b82c-e1755e361250 None None] REQUEST_METHOD: `POST` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:22.053091 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eeae6-f133-4959-b82c-e1755e361250 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:22.053238 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9eeae6-f133-4959-b82c-e1755e361250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:22.129177 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.auth.core [None req-4f9eeae6-f133-4959-b82c-e1755e361250 None None] MFA Rules not processed for user `46c398ec4dcc438895f054f616fc9e41`. Rule list: `[]` (Enabled: `True`). {{(pid=80189) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:48:22.130512 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-4f9eeae6-f133-4959-b82c-e1755e361250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:22.147617 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1453/2896] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 15 00:48:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:48:22.159090 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481ad52-2916-4729-b110-2c1b2fdb721e None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:22.160876 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-c481ad52-2916-4729-b110-2c1b2fdb721e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:22.174102 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481ad52-2916-4729-b110-2c1b2fdb721e None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:22.177628 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d670317-2ea6-461c-94b7-9396f99c0f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:22.178275 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d670317-2ea6-461c-94b7-9396f99c0f44 service neutron] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:22.178557 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d670317-2ea6-461c-94b7-9396f99c0f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:22.178884 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d670317-2ea6-461c-94b7-9396f99c0f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:22.185828 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d670317-2ea6-461c-94b7-9396f99c0f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:22.187261 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d670317-2ea6-461c-94b7-9396f99c0f44 service neutron] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:22.194836 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1444/2897] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:48:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:48:22.281423 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d9ed7-9815-40b4-b973-205591301194 None None] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:22.281747 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d9ed7-9815-40b4-b973-205591301194 None None] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:22.282058 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d9ed7-9815-40b4-b973-205591301194 None None] PATH_INFO: `/` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:22.283467 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1454/2898] 10.222.0.36 () {54 vars in 921 bytes} [Wed Jun 15 00:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 15 00:48:22.289093 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af15241-0773-4177-b004-5e083fa13c07 None None] REQUEST_METHOD: `POST` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:22.289378 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af15241-0773-4177-b004-5e083fa13c07 None None] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:22.289727 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af15241-0773-4177-b004-5e083fa13c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:22.322574 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.auth.core [None req-8af15241-0773-4177-b004-5e083fa13c07 None None] MFA Rules not processed for user `6d0ae1707c7041a0989889dbefeaf267`. Rule list: `[]` (Enabled: `True`). {{(pid=80188) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 15 00:48:22.323779 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8af15241-0773-4177-b004-5e083fa13c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:22.352665 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1445/2899] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Jun 15 00:48:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 15 00:48:22.369961 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d9ed7-9815-40b4-b973-205591301194 None None] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:22.380610 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d9ed7-9815-40b4-b973-205591301194 None None] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:22.384680 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12779d74-52a4-4b8a-8b22-9443a950167e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46c398ec4dcc438895f054f616fc9e41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:22.385331 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12779d74-52a4-4b8a-8b22-9443a950167e service neutron] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:22.385652 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12779d74-52a4-4b8a-8b22-9443a950167e service neutron] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:22.385929 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12779d74-52a4-4b8a-8b22-9443a950167e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:22.396664 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12779d74-52a4-4b8a-8b22-9443a950167e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:22.398176 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12779d74-52a4-4b8a-8b22-9443a950167e service neutron] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:22.409374 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1455/2900] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:48:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:48:22.475784 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af15241-0773-4177-b004-5e083fa13c07 None None] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:48:22.477442 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-8af15241-0773-4177-b004-5e083fa13c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:22.492508 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af15241-0773-4177-b004-5e083fa13c07 None None] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:48:22.498690 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1026b-455b-4d45-b2a7-c6e26c4bac81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e6dd029a3d45f6aeb4da06db9753dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:48:22.499342 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1026b-455b-4d45-b2a7-c6e26c4bac81 service placement] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:48:22.499631 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1026b-455b-4d45-b2a7-c6e26c4bac81 service placement] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:48:22.499912 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1026b-455b-4d45-b2a7-c6e26c4bac81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:48:22.501698 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-b9b1026b-455b-4d45-b2a7-c6e26c4bac81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:48:22.513861 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1026b-455b-4d45-b2a7-c6e26c4bac81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:48:22.515394 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1026b-455b-4d45-b2a7-c6e26c4bac81 service placement] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:48:22.525744 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1446/2901] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:48:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:48:32.404556 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=95 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:48:32.521405 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=27 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:46.810590 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12779d74-52a4-4b8a-8b22-9443a950167e service neutron] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:46.811699 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-12779d74-52a4-4b8a-8b22-9443a950167e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:46.827691 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12779d74-52a4-4b8a-8b22-9443a950167e service neutron] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:46.833546 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabb824-f171-4501-b766-705201a76218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d0ae1707c7041a0989889dbefeaf267', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:46.834203 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabb824-f171-4501-b766-705201a76218 service nova] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:46.834491 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabb824-f171-4501-b766-705201a76218 service nova] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:46.834808 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabb824-f171-4501-b766-705201a76218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:46.836584 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-cbabb824-f171-4501-b766-705201a76218 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:46.849178 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabb824-f171-4501-b766-705201a76218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:46.851274 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabb824-f171-4501-b766-705201a76218 service nova] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:46.862649 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1456/2902] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:49:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:49:53.754233 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1026b-455b-4d45-b2a7-c6e26c4bac81 service placement] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:53.770297 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1026b-455b-4d45-b2a7-c6e26c4bac81 service placement] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:53.775893 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63890b88-1675-491c-9afa-ea95dc6da9d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e6dd029a3d45f6aeb4da06db9753dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:53.776678 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63890b88-1675-491c-9afa-ea95dc6da9d0 service placement] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:53.776972 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63890b88-1675-491c-9afa-ea95dc6da9d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:53.777252 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63890b88-1675-491c-9afa-ea95dc6da9d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:53.779197 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-63890b88-1675-491c-9afa-ea95dc6da9d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:53.793363 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63890b88-1675-491c-9afa-ea95dc6da9d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:53.795296 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63890b88-1675-491c-9afa-ea95dc6da9d0 service placement] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:53.807101 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1447/2903] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:49:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:49:56.861919 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=6 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:57.165389 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabb824-f171-4501-b766-705201a76218 service nova] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:57.177056 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabb824-f171-4501-b766-705201a76218 service nova] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:57.182211 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94527a-2265-4221-8045-4385f9d245ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e6dd029a3d45f6aeb4da06db9753dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:57.182865 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94527a-2265-4221-8045-4385f9d245ae service placement] REQUEST_METHOD: `GET` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:57.183138 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94527a-2265-4221-8045-4385f9d245ae service placement] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:57.183421 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94527a-2265-4221-8045-4385f9d245ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:57.185273 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-6c94527a-2265-4221-8045-4385f9d245ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:57.197390 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94527a-2265-4221-8045-4385f9d245ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:57.198888 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94527a-2265-4221-8045-4385f9d245ae service placement] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:57.210517 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1457/2904] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:49:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:49:57.224046 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63890b88-1675-491c-9afa-ea95dc6da9d0 service placement] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:57.226119 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-63890b88-1675-491c-9afa-ea95dc6da9d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:57.327729 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63890b88-1675-491c-9afa-ea95dc6da9d0 service placement] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:57.333292 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489adcfd-5476-439a-9dc4-21e0e988eca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:57.334216 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489adcfd-5476-439a-9dc4-21e0e988eca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:57.334500 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489adcfd-5476-439a-9dc4-21e0e988eca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:57.334770 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489adcfd-5476-439a-9dc4-21e0e988eca8 admin admin] PATH_INFO: `/v3/users/31dc205473554444947cb744ad2cafef` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:57.336066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489adcfd-5476-439a-9dc4-21e0e988eca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31dc205473554444947cb744ad2cafef)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:57.338050 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489adcfd-5476-439a-9dc4-21e0e988eca8 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:57.386301 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-489adcfd-5476-439a-9dc4-21e0e988eca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31dc205473554444947cb744ad2cafef'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:57.394495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-489adcfd-5476-439a-9dc4-21e0e988eca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31dc205473554444947cb744ad2cafef'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:57.395120 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-489adcfd-5476-439a-9dc4-21e0e988eca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31dc205473554444947cb744ad2cafef'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:57.395752 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-489adcfd-5476-439a-9dc4-21e0e988eca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31dc205473554444947cb744ad2cafef'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:57.407703 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-489adcfd-5476-439a-9dc4-21e0e988eca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31dc205473554444947cb744ad2cafef'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:57.419693 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1448/2905] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:49:57 2022] DELETE /identity/v3/users/31dc205473554444947cb744ad2cafef => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:49:57.606860 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94527a-2265-4221-8045-4385f9d245ae service placement] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:57.622054 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94527a-2265-4221-8045-4385f9d245ae service placement] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:57.687128 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abc34c-cab0-47e4-9539-e23c93ae6ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:57.688004 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abc34c-cab0-47e4-9539-e23c93ae6ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:57.688290 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abc34c-cab0-47e4-9539-e23c93ae6ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:57.688568 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abc34c-cab0-47e4-9539-e23c93ae6ec9 admin admin] PATH_INFO: `/v3/projects/a20bfeb0158143079a58df9685bc2594` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:57.689814 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abc34c-cab0-47e4-9539-e23c93ae6ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a20bfeb0158143079a58df9685bc2594)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:57.691724 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abc34c-cab0-47e4-9539-e23c93ae6ec9 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:57.740445 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-82abc34c-cab0-47e4-9539-e23c93ae6ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a20bfeb0158143079a58df9685bc2594', 'request_id': 'req-82abc34c-cab0-47e4-9539-e23c93ae6ec9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:57.746074 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-82abc34c-cab0-47e4-9539-e23c93ae6ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a20bfeb0158143079a58df9685bc2594', 'request_id': 'req-82abc34c-cab0-47e4-9539-e23c93ae6ec9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:57.752214 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-82abc34c-cab0-47e4-9539-e23c93ae6ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a20bfeb0158143079a58df9685bc2594', 'request_id': 'req-82abc34c-cab0-47e4-9539-e23c93ae6ec9'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:57.765473 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-82abc34c-cab0-47e4-9539-e23c93ae6ec9 admin admin] The token cache is being invalidate because project a20bfeb0158143079a58df9685bc2594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:49:57.765762 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-82abc34c-cab0-47e4-9539-e23c93ae6ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:57.766398 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-82abc34c-cab0-47e4-9539-e23c93ae6ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:57.767973 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1458/2906] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:49:57 2022] DELETE /identity/v3/projects/a20bfeb0158143079a58df9685bc2594 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:49:57.772196 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489adcfd-5476-439a-9dc4-21e0e988eca8 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:57.773646 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-489adcfd-5476-439a-9dc4-21e0e988eca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:57.786556 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489adcfd-5476-439a-9dc4-21e0e988eca8 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:57.827831 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:57.862863 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa0948-2f01-49f3-8f7e-c3213b589e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:57.863752 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa0948-2f01-49f3-8f7e-c3213b589e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:57.864051 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa0948-2f01-49f3-8f7e-c3213b589e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:57.864328 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa0948-2f01-49f3-8f7e-c3213b589e53 admin admin] PATH_INFO: `/v3/users/80052f06d9bf488d948bb1c76c010984` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:57.865616 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa0948-2f01-49f3-8f7e-c3213b589e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80052f06d9bf488d948bb1c76c010984)` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:57.867542 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa0948-2f01-49f3-8f7e-c3213b589e53 admin admin] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:57.915495 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9afa0948-2f01-49f3-8f7e-c3213b589e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80052f06d9bf488d948bb1c76c010984'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:57.925066 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9afa0948-2f01-49f3-8f7e-c3213b589e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80052f06d9bf488d948bb1c76c010984'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:57.926022 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9afa0948-2f01-49f3-8f7e-c3213b589e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80052f06d9bf488d948bb1c76c010984'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:57.926702 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9afa0948-2f01-49f3-8f7e-c3213b589e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80052f06d9bf488d948bb1c76c010984'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:57.939736 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.notifications [None req-9afa0948-2f01-49f3-8f7e-c3213b589e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80052f06d9bf488d948bb1c76c010984'} {{(pid=80188) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:57.952406 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1449/2907] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Jun 15 00:49:57 2022] DELETE /identity/v3/users/80052f06d9bf488d948bb1c76c010984 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:49:58.135186 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abc34c-cab0-47e4-9539-e23c93ae6ec9 admin admin] Authenticating user token {{(pid=80189) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:49:58.136841 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.fernet_utils [None req-82abc34c-cab0-47e4-9539-e23c93ae6ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80189) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:49:58.151524 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abc34c-cab0-47e4-9539-e23c93ae6ec9 admin admin] Validating token access rules against request {{(pid=80189) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:49:58.214693 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a21366-b951-4870-9d02-21f42da6c2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38407cead4d4c429e0e7ef7b966bf82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ac65417652594c99a423cc960be9081e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80189) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:49:58.215697 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a21366-b951-4870-9d02-21f42da6c2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:49:58.216127 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a21366-b951-4870-9d02-21f42da6c2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:49:58.216468 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a21366-b951-4870-9d02-21f42da6c2b1 admin admin] PATH_INFO: `/v3/projects/1cee81a6c64d4c8da25c2e6ff423c0c4` {{(pid=80189) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:49:58.218279 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a21366-b951-4870-9d02-21f42da6c2b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cee81a6c64d4c8da25c2e6ff423c0c4)` {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:49:58.220202 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a21366-b951-4870-9d02-21f42da6c2b1 admin admin] RBAC: Authorization granted {{(pid=80189) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:49:58.241937 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:49:58.269169 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-65a21366-b951-4870-9d02-21f42da6c2b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cee81a6c64d4c8da25c2e6ff423c0c4', 'request_id': 'req-65a21366-b951-4870-9d02-21f42da6c2b1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:58.275086 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-65a21366-b951-4870-9d02-21f42da6c2b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cee81a6c64d4c8da25c2e6ff423c0c4', 'request_id': 'req-65a21366-b951-4870-9d02-21f42da6c2b1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:58.281074 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-65a21366-b951-4870-9d02-21f42da6c2b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cee81a6c64d4c8da25c2e6ff423c0c4', 'request_id': 'req-65a21366-b951-4870-9d02-21f42da6c2b1'} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:58.295444 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-65a21366-b951-4870-9d02-21f42da6c2b1 admin admin] The token cache is being invalidate because project 1cee81a6c64d4c8da25c2e6ff423c0c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80189) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 15 00:49:58.295756 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-65a21366-b951-4870-9d02-21f42da6c2b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:58.296388 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG keystone.notifications [None req-65a21366-b951-4870-9d02-21f42da6c2b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80189) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 15 00:49:58.298007 dv-cinder-835384-6-smb devstack@keystone.service[80189]: [pid: 80189|app: 0|req: 1459/2908] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Jun 15 00:49:58 2022] DELETE /identity/v3/projects/1cee81a6c64d4c8da25c2e6ff423c0c4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 15 00:50:07.948974 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:50:08.292148 dv-cinder-835384-6-smb devstack@keystone.service[80189]: DEBUG dbcounter [-] [80189] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80189) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 15 00:54:07.389759 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa0948-2f01-49f3-8f7e-c3213b589e53 admin admin] Authenticating user token {{(pid=80188) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 15 00:54:07.391438 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-9afa0948-2f01-49f3-8f7e-c3213b589e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:54:07.465474 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa0948-2f01-49f3-8f7e-c3213b589e53 admin admin] Validating token access rules against request {{(pid=80188) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 15 00:54:07.526571 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe99ee-036c-4437-9491-72cd1e489904 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24e6dd029a3d45f6aeb4da06db9753dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc0f2a3e075946f1ad06146dfa252aa6', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80188) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 15 00:54:07.527231 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe99ee-036c-4437-9491-72cd1e489904 service placement] REQUEST_METHOD: `GET` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 15 00:54:07.527518 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe99ee-036c-4437-9491-72cd1e489904 service placement] SCRIPT_NAME: `/identity` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 15 00:54:07.527801 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe99ee-036c-4437-9491-72cd1e489904 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80188) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 15 00:54:07.529769 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.fernet_utils [None req-6ebe99ee-036c-4437-9491-72cd1e489904 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80188) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 15 00:54:07.541839 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe99ee-036c-4437-9491-72cd1e489904 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 15 00:54:07.543435 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe99ee-036c-4437-9491-72cd1e489904 service placement] RBAC: Authorization granted {{(pid=80188) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 15 00:54:07.554487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: [pid: 80188|app: 0|req: 1450/2909] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Jun 15 00:54:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 15 00:54:17.549487 dv-cinder-835384-6-smb devstack@keystone.service[80188]: DEBUG dbcounter [-] [80188] Writing DB stats keystone:SELECT=58 {{(pid=80188) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}